Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-49524 Improve K8s support
  3. SPARK-49117

Fix `docker-image-tool.sh` to be up-to-date

    XMLWordPrintableJSON

Details

    Description

      Apache Spark 4 dropped Java 11 support. So, we should fix the following.

      -  - Build and push Java11-based image with tag "v3.4.0" to docker.io/myrepo
      +  - Build and push Java17-based image with tag "v4.0.0" to docker.io/myrepo
      

      Apache Spark 4 requires JDK instead of JRE. So, we should fix the following.

      -    $0 -r docker.io/myrepo -t v3.4.0 -b java_image_tag=11-jre build
      +    $0 -r docker.io/myrepo -t v4.0.0 -b java_image_tag=17 build
      

      Lastly, `3.4.0` is too old because it's released on April 13, 2023. We had better use v4.0.0.

      -    $0 -r docker.io/myrepo -t v3.4.0 -p kubernetes/dockerfiles/spark/bindings/python/Dockerfile build
      +    $0 -r docker.io/myrepo -t v4.0.0 -p kubernetes/dockerfiles/spark/bindings/python/Dockerfile build
      

      Attachments

        Issue Links

          Activity

            People

              dongjoon Dongjoon Hyun
              dongjoon Dongjoon Hyun
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: