Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-26742

Bump Kubernetes Client Version to 4.1.2

    XMLWordPrintableJSON

Details

    • Dependency upgrade
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.4.0, 3.0.0
    • 2.4.1, 3.0.0
    • Kubernetes, Spark Core

    Description

      Spark 2.x is using Kubernetes Client 3.x which is pretty old, the master branch has 4.0, the client should be upgraded to 4.1.1 to have the broadest Kubernetes compatibility support for newer clusters: https://github.com/fabric8io/kubernetes-client#compatibility-matrix

      Attachments

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. SPARK-25590 kubernetes-model-2.0.0.jar masks default Spark logging config

          • Major - Major loss of function.
          • Closed
          is related to

          Bug - A problem which impairs or prevents the functions of the product. SPARK-27812 kubernetes client import non-daemon thread which block jvm exit.

          • Major - Major loss of function.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-26603 Update minikube backend in K8s integration tests

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #23814

          Web Link GitHub Pull Request #23993

          Web Link GitHub Pull Request #24002

          Activity

            People

              jiaxin Jiaxin Shan
              sdavids Steve Davids
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: