Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-128 [Umbrella] RM Restart Phase 1: State storage and non-work-preserving recovery
  3. YARN-1307

Rethink znode structure for RM HA

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.3.0
    • resourcemanager
    • None
    • Reviewed

    Description

      Rethink for znode structure for RM HA is proposed in some JIRAs(YARN-659, YARN-1222). The motivation of this JIRA is quoted from Bikas' comment in YARN-1222:

      We should move to creating a node hierarchy for apps such that all znodes for an app are stored under an app znode instead of the app root znode. This will help in removeApplication and also in scaling better on ZK. The earlier code was written this way to ensure create/delete happens under a root znode for fencing. But given that we have moved to multi-operations globally, this isnt required anymore.

      Attachments

        1. YARN-1307.13.patch
          43 kB
          Vinod Kumar Vavilapalli
        2. YARN-1307.12.patch
          43 kB
          Tsuyoshi Ozawa
        3. YARN-1307.11.patch
          41 kB
          Tsuyoshi Ozawa
        4. YARN-1307.10.patch
          38 kB
          Tsuyoshi Ozawa
        5. YARN-1307.9.patch
          36 kB
          Tsuyoshi Ozawa
        6. YARN-1307.9.patch
          36 kB
          Tsuyoshi Ozawa
        7. YARN-1307.8.patch
          36 kB
          Tsuyoshi Ozawa
        8. YARN-1307.7.patch
          36 kB
          Tsuyoshi Ozawa
        9. YARN-1307.6.patch
          36 kB
          Tsuyoshi Ozawa
        10. YARN-1307.5.patch
          34 kB
          Tsuyoshi Ozawa
        11. YARN-1307.4-3.patch
          23 kB
          Tsuyoshi Ozawa
        12. YARN-1307.4-2.patch
          23 kB
          Tsuyoshi Ozawa
        13. YARN-1307.4.patch
          23 kB
          Tsuyoshi Ozawa
        14. YARN-1307.3.patch
          21 kB
          Tsuyoshi Ozawa
        15. YARN-1307.2.patch
          22 kB
          Tsuyoshi Ozawa
        16. YARN-1307.1.patch
          20 kB
          Tsuyoshi Ozawa

        Issue Links

          blocks

          Sub-task - The sub-task of the issue YARN-659 RMStateStore's removeApplication APIs should just take an applicationId

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue YARN-1222 Make improvements in ZKRMStateStore for fencing

          • Major - Major loss of function.
          • Closed

          Sub-task - The sub-task of the issue YARN-1239 Save version information in the state store

          • Major - Major loss of function.
          • Closed

          Activity

            People

              ozawa Tsuyoshi Ozawa
              ozawa Tsuyoshi Ozawa
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: