Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-128 [Umbrella] RM Restart Phase 1: State storage and non-work-preserving recovery
  3. YARN-514

Delayed store operations should not result in RM unavailability for app submission

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.1.0-beta
    • resourcemanager
    • None
    • Reviewed

    Description

      Currently, app submission is the only store operation performed synchronously because the app must be stored before the request returns with success. This makes the RM susceptible to blocking all client threads on slow store operations, resulting in RM being perceived as unavailable by clients.

      Attachments

        1. YARN-514.8.patch
          37 kB
          Zhijie Shen
        2. YARN-514.7.patch
          37 kB
          Zhijie Shen
        3. YARN-514.6.patch
          37 kB
          Zhijie Shen
        4. YARN-514.5.patch
          26 kB
          Zhijie Shen
        5. YARN-514.4.patch
          26 kB
          Zhijie Shen
        6. YARN-514.3.patch
          26 kB
          Zhijie Shen
        7. YARN-514.2.patch
          37 kB
          Zhijie Shen
        8. YARN-514.1.patch
          38 kB
          Zhijie Shen

        Issue Links

        blocks

        Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-5140 MR part of YARN-514

        • Major - Major loss of function.
        • Closed
        is related to

        Sub-task - The sub-task of the issue YARN-549 YarnClient.submitApplication should wait for application to be accepted by the RM

        • Major - Major loss of function.
        • Closed

        Bug - A problem which impairs or prevents the functions of the product. YARN-585 TestFairScheduler#testNotAllowSubmitApplication is broken due to YARN-514

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            zjshen Zhijie Shen
            bikassaha Bikas Saha
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment