Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-24434

Support user-specified driver and executor pod templates

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.4.0
    • 3.0.0
    • Kubernetes, Spark Core
    • None

    Description

      With more requests for customizing the driver and executor pods coming, the current approach of adding new Spark configuration options has some serious drawbacks: 1) it means more Kubernetes specific configuration options to maintain, and 2) it widens the gap between the declarative model used by Kubernetes and the configuration model used by Spark. We should start designing a solution that allows users to specify pod templates as central places for all customization needs for the driver and executor pods. 

      Attachments

        Issue Links

          Activity

            People

              onursatici Onur Satici
              liyinan926 Yinan Li
              Votes:
              2 Vote for this issue
              Watchers:
              22 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: