Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-8425

Add blacklist mechanism for task scheduling

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 2.2.0
    • Scheduler, Spark Core, YARN
    • None

    Attachments

      Issue Links

        blocks

        New Feature - A new feature of the product, which has yet to be developed. SPARK-16554 Spark should kill executors when they are blacklisted

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. SPARK-16654 UI Should show blacklisted executors & nodes

        • Major - Major loss of function.
        • Resolved
        is blocked by

        Task - A task that needs to be done. SPARK-17675 Add Blacklisting of Executors & Nodes within one TaskSet

        • Major - Major loss of function.
        • Resolved
        is duplicated by

        Improvement - An improvement or enhancement to an existing feature or task. SPARK-8426 Add blacklist mechanism for YARN container allocation

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. SPARK-4681 Turn on executor level blacklisting by default

        • Major - Major loss of function.
        • Closed
        links to

        Pull request #6870 [Github] Pull Request #6870 (jerryshao)

        Pull request #13951 [Github] Pull Request #13951 (squito)

        Pull request #14079 [Github] Pull Request #14079 (squito)

        Pull request #16298 [Github] Pull Request #16298 (squito)

        Web Link Google doc for design document

        Activity

          People

            mwws Mao, Wei
            jerryshao Saisai Shao
            Votes:
            0 Vote for this issue
            Watchers:
            15 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: