Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4193 Support heterogeneity (node-labels) in the YARN ReservationSystem
  3. YARN-4198

CapacityScheduler locking / synchronization improvements

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • capacity scheduler

    Description

      In the context of YARN-4193 (which stresses the RM/CS performance) we found several performance problems with in the locking/synchronization of the CapacityScheduler, as well as inconsistencies that do not normally surface (incorrect locking-order of queues protected by CS locks etc). This JIRA proposes several refactoring that improve this.

      Attachments

        1. YARN-4198-v1.patch
          38 kB
          Alexey Tumanov

        Activity

          People

            atumanov Alexey Tumanov
            curino Carlo Curino
            Votes:
            0 Vote for this issue
            Watchers:
            14 Start watching this issue

            Dates

              Created:
              Updated: