Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-26583

Add `paranamer` dependency to `core` module

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.4.0, 3.0.0
    • Fix Version/s: 2.4.1, 3.0.0
    • Component/s: Build, Spark Core
    • Labels:
      None

      Description

      With Scala-2.12 profile, Spark application fails while Spark is okay. For example, our documented `SimpleApp` example succeeds to compile but it fails at runtime because it doesn't use `paranamer 2.8` and hits SPARK-22128.

      https://dist.apache.org/repos/dist/dev/spark/3.0.0-SNAPSHOT-2019_01_09_13_59-e853afb-docs/_site/quick-start.html

      $ mvn dependency:tree -Dincludes=com.thoughtworks.paranamer
      [INFO] --- maven-dependency-plugin:2.8:tree (default-cli) @ simple ---
      [INFO] my.test:simple:jar:1.0-SNAPSHOT
      [INFO] \- org.apache.spark:spark-sql_2.12:jar:3.0.0-SNAPSHOT:compile
      [INFO]    \- org.apache.spark:spark-core_2.12:jar:3.0.0-SNAPSHOT:compile
      [INFO]       \- org.apache.avro:avro:jar:1.8.2:compile
      [INFO]          \- com.thoughtworks.paranamer:paranamer:jar:2.7:compile
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                dongjoon Dongjoon Hyun
                Reporter:
                dongjoon Dongjoon Hyun
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: