Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-35956

Support auto-assigning labels to less important pods (e.g. decommissioning pods)

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.2.0
    • 3.3.0
    • Kubernetes
    • None

    Description

      To allow for folks to use pod disruption budgets or replicasets we should indicate which pods Spark cares about "the least", those would be pods that are otherwise exiting soon.

       

      With PDBs the user would create a PDB representing the label of decommissioning executors and this could have a higher number of unavailable than the PDB for the "regular" execs. For people using replicasets in 1.21 we could also set a label of "controller.kubernetes.io/pod-deletion-cost" (see https://github.com/kubernetes/kubernetes/pull/99163 ) to hint to the controller that a pod is less important to us.

      Attachments

        Activity

          People

            holden Holden Karau
            holden Holden Karau
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: