Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-25682

Docker images generated from dev build and from dist tarball are different

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.4.0
    • Fix Version/s: 3.0.0
    • Component/s: Kubernetes, Spark Core
    • Labels:
      None

      Description

      There's at least one difference I noticed, because of this line:

      COPY examples /opt/spark/examples
      

      In a dev build, "examples" contains your usual source code and maven-style directories, whereas in the dist version, it's this:

      cp "$SPARK_HOME"/examples/target/scala*/jars/* "$DISTDIR/examples/jars"
      

      So the path to the actual jar files ends up being different depending on how you built the image.

        Attachments

          Activity

            People

            • Assignee:
              vanzin Marcelo Masiero Vanzin
              Reporter:
              vanzin Marcelo Masiero Vanzin
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: