[SPARK-34258] Upgrade Scala to avoid Scala's bug about illegal cyclic reference

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 3.2.0
• Component/s: Build
• Assignee: Unassigned
• Reporter: wuyi
• Created: 27/Jan/21 07:57
• Updated: 25/Feb/21 23:43
• Resolved: 25/Feb/21 23:43

Description

There is a regression in Scala 2.13. We should probably upgrade maintenance version of Scala 2.13 before Spark 3.2.0 release. Otherwise:

scalaVersion := "2.13.2"

libraryDependencies ++= Seq(
  "org.scala-lang" % "scala-reflect" % scalaVersion.value,
  "com.google.protobuf" % "protobuf-java" % "3.11.4"
)

package foo

import scala.reflect.runtime.universe
import com.google.protobuf.DescriptorProtos.FileDescriptorProto

object Hello {
  def fromJava(t: FileDescriptorProto): Unit = {}
}

object Main {
  def main(args: Array[String]): Unit = {
    val mirror = universe.runtimeMirror(getClass.getClassLoader())

    println(
      mirror.reflectModule(
        mirror.staticModule("foo.Hello$"))
      .instance)
  }

fails with the error below:

[info] running foo.Main
[error] (run-main-b) scala.reflect.internal.Symbols$CyclicReference: illegal cyclic reference involving type BuilderType

See https://github.com/scala/bug/issues/12038 for more details.

Issue Links

• duplicates: SPARK-34505 Upgrade Scala to 2.13.5