Uploaded image for project: 'ORC'
  1. ORC
  2. ORC-1586

Fix IllegalAccessError when SparkBenchmark runs on JDK17

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0, 1.9.3
    • None
    • None

    Description

      java.lang.IllegalAccessError: class org.apache.spark.storage.StorageUtils$ (in unnamed module @0x5b2c883c) cannot access class sun.nio.ch.DirectBuffer (in module java.base) because module java.base does not export sun.nio.ch to unnamed module @0x5b2c883c
          at org.apache.spark.storage.StorageUtils$.<init>(StorageUtils.scala:213)
          at org.apache.spark.storage.StorageUtils$.<clinit>(StorageUtils.scala)
          at org.apache.spark.storage.BlockManagerMasterEndpoint.<init>(BlockManagerMasterEndpoint.scala:121)
          at org.apache.spark.SparkEnv$.$anonfun$create$9(SparkEnv.scala:358)
          at org.apache.spark.SparkEnv$.registerOrLookupEndpoint$1(SparkEnv.scala:295)
          at org.apache.spark.SparkEnv$.create(SparkEnv.scala:344)
          at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:196)
          at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:284)
          at org.apache.spark.SparkContext.<init>(SparkContext.scala:483)
          at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2888)
          at org.apache.spark.sql.SparkSession$Builder.$anonfun$getOrCreate$2(SparkSession.scala:1099)
          at scala.Option.getOrElse(Option.scala:189)
          at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:1093)
          at org.apache.orc.bench.spark.SparkBenchmark$InputSource.setup(SparkBenchmark.java:129)
          at org.apache.orc.bench.spark.jmh_generated.SparkBenchmark_fullRead_jmhTest._jmh_tryInit_f_inputsource1_1(SparkBenchmark_fullRead_jmhTest.java:403) 

      Attachments

        Activity

          People

            dzcxzl dzcxzl
            dzcxzl dzcxzl
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: