Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-36219

Add flag to allow Driver to request for OPPORTUNISTIC containers

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.3.0
    • None
    • YARN
    • None

    Description

      YARN-2882 and YARN-4335 introduces the concept of container ExecutionTypes and specifically OPPORTUNISTIC containers.
      The default ExecutionType is GUARANTEED. This JIRA proposes to allow users to provide hints via config to the SPARK framework as to the number of containers it would like to schedule as OPPORTUNISTIC.

      like MAPREDUCE-6703 .

      Attachments

        Activity

          People

            Unassigned Unassigned
            chaosju chaosju
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: