Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-13780

SQL "incremental" build in maven is broken

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.0
    • Component/s: Build, SQL
    • Labels:
      None

      Description

      If you build Spark, and later try to build just the SQL module like this:

      mvn ... -pl :spark-sql_2.11
      

      You end up with a nasty error:

      [error] uncaught exception during compilation: scala.reflect.internal.Types$TypeError
      scala.reflect.internal.Types$TypeError: bad symbolic reference. A signature in WebUI.class refers to term servlet
      in value org.jetty which is not available.
      It may be completely missing from the current classpath, or the version on
      

      This is because of bad interaction between shading, Scala's signature field, and internal APIs exposing shaded classes.

      The fix is simple, we just need to add an explicit dependency on the jetty artifacts to the sql module.

        Attachments

          Activity

            People

            • Assignee:
              vanzin Marcelo Masiero Vanzin
              Reporter:
              vanzin Marcelo Masiero Vanzin
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: