Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-22994

Require a single container image for Spark-on-K8S

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.3.0
    • Fix Version/s: 2.3.0
    • Component/s: Kubernetes
    • Labels:
      None

      Description

      Current k8s backend requires 3 separate container images to be provided by the user to submit an app. The 3 images are pretty much the same except for the entry point.

      Instead, we should require a single image by default, but still allow the user to override individual images (e.g. executor) if desired.

      This should also make it easier to publish an "official" Spark docker image, and should simplify things like the build-push-docker-images.sh script.

        Attachments

          Activity

            People

            • Assignee:
              vanzin Marcelo Vanzin
              Reporter:
              vanzin Marcelo Vanzin
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: