Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-556 [Umbrella] RM Restart phase 2 - Work preserving restart
  3. YARN-2052

ContainerId creation after work preserving restart is broken

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.5.0
    • resourcemanager
    • None
    • Reviewed

    Description

      Container ids are made unique by using the app identifier and appending a monotonically increasing sequence number to it. Since container creation is a high churn activity the RM does not store the sequence number per app. So after restart it does not know what the new sequence number should be for new allocations.

      Attachments

        1. YARN-2052.9.patch
          37 kB
          Tsuyoshi Ozawa
        2. YARN-2052.9.patch
          37 kB
          Tsuyoshi Ozawa
        3. YARN-2052.8.patch
          37 kB
          Tsuyoshi Ozawa
        4. YARN-2052.7.patch
          45 kB
          Tsuyoshi Ozawa
        5. YARN-2052.6.patch
          36 kB
          Tsuyoshi Ozawa
        6. YARN-2052.5.patch
          35 kB
          Tsuyoshi Ozawa
        7. YARN-2052.4.patch
          4 kB
          Tsuyoshi Ozawa
        8. YARN-2052.3.patch
          7 kB
          Tsuyoshi Ozawa
        9. YARN-2052.2.patch
          6 kB
          Tsuyoshi Ozawa
        10. YARN-2052.12.patch
          38 kB
          Tsuyoshi Ozawa
        11. YARN-2052.11.patch
          38 kB
          Tsuyoshi Ozawa
        12. YARN-2052.10.patch
          37 kB
          Tsuyoshi Ozawa
        13. YARN-2052.1.patch
          5 kB
          Tsuyoshi Ozawa

        Issue Links

        relates to

        Sub-task - The sub-task of the issue YARN-2182 Update ContainerId#toString() to avoid conflicts before and after RM restart

        • Major - Major loss of function.
        • Closed

        Sub-task - The sub-task of the issue YARN-2229 ContainerId can overflow with RM restart

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            ozawa Tsuyoshi Ozawa
            ozawa Tsuyoshi Ozawa
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment