Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-128 [Umbrella] RM Restart Phase 1: State storage and non-work-preserving recovery
  3. YARN-1307

Rethink znode structure for RM HA

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.3.0
    • resourcemanager
    • None
    • Reviewed

    Description

      Rethink for znode structure for RM HA is proposed in some JIRAs(YARN-659, YARN-1222). The motivation of this JIRA is quoted from Bikas' comment in YARN-1222:

      We should move to creating a node hierarchy for apps such that all znodes for an app are stored under an app znode instead of the app root znode. This will help in removeApplication and also in scaling better on ZK. The earlier code was written this way to ensure create/delete happens under a root znode for fencing. But given that we have moved to multi-operations globally, this isnt required anymore.

      Attachments

        1. YARN-1307.1.patch
          20 kB
          Tsuyoshi Ozawa
        2. YARN-1307.2.patch
          22 kB
          Tsuyoshi Ozawa
        3. YARN-1307.3.patch
          21 kB
          Tsuyoshi Ozawa
        4. YARN-1307.4.patch
          23 kB
          Tsuyoshi Ozawa
        5. YARN-1307.4-2.patch
          23 kB
          Tsuyoshi Ozawa
        6. YARN-1307.4-3.patch
          23 kB
          Tsuyoshi Ozawa
        7. YARN-1307.5.patch
          34 kB
          Tsuyoshi Ozawa
        8. YARN-1307.6.patch
          36 kB
          Tsuyoshi Ozawa
        9. YARN-1307.7.patch
          36 kB
          Tsuyoshi Ozawa
        10. YARN-1307.8.patch
          36 kB
          Tsuyoshi Ozawa
        11. YARN-1307.9.patch
          36 kB
          Tsuyoshi Ozawa
        12. YARN-1307.9.patch
          36 kB
          Tsuyoshi Ozawa
        13. YARN-1307.10.patch
          38 kB
          Tsuyoshi Ozawa
        14. YARN-1307.11.patch
          41 kB
          Tsuyoshi Ozawa
        15. YARN-1307.12.patch
          43 kB
          Tsuyoshi Ozawa
        16. YARN-1307.13.patch
          43 kB
          Vinod Kumar Vavilapalli

        Issue Links

        blocks

        Sub-task - The sub-task of the issue YARN-659 RMStateStore's removeApplication APIs should just take an applicationId

        • Major - Major loss of function.
        • Resolved
        is related to

        Sub-task - The sub-task of the issue YARN-1222 Make improvements in ZKRMStateStore for fencing

        • Major - Major loss of function.
        • Closed

        Sub-task - The sub-task of the issue YARN-1239 Save version information in the state store

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            ozawa Tsuyoshi Ozawa
            ozawa Tsuyoshi Ozawa
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment