Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-36052

Introduce pending pod limit for Spark on K8s

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.3, 3.1.2, 3.2.0, 3.3.0
    • Fix Version/s: 3.2.0, 3.3.0
    • Component/s: Kubernetes
    • Labels:

      Description

      Introduce a new configuration to limit the number of pending PODs for Spark on K8S as the K8S scheduler could be overloaded with requests which slows down the resource allocations (especially in case of dynamic allocation).

        Attachments

          Activity

            People

            • Assignee:
              attilapiros Attila Zsolt Piros
              Reporter:
              attilapiros Attila Zsolt Piros
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: