Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-29762

GPU Scheduling - default task resource amount to 1

    XMLWordPrintableJSON

Details

    • Story
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.0.0
    • None
    • Spark Core
    • None

    Description

      Default the task level resource configs (for gpu/fpga, etc) to 1.  So if the user specifies the executor resource then to make it more user friendly lets have the task resource config default to 1.  This is ok right now since we require resources to have an address.  It also matches what we do for the spark.task.cpus configs.

      Attachments

        Issue Links

          relates to

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. SPARK-24615 SPIP: Accelerator-aware task scheduling for Spark

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              tgraves Thomas Graves
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: