Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4344

NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations

VotersStop watchingWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      After YARN-3802, if an NM re-connects to the RM with changed capabilities, there can arise situations where the overall cluster resource calculation for the cluster will be incorrect leading to inconsistencies in scheduling.

      Attachments

        1. YARN-4344-branch-2.6.001.patch
          12 kB
          Varun Vasudev
        2. YARN-4344.002.patch
          12 kB
          Varun Vasudev
        3. YARN-4344.001.patch
          11 kB
          Varun Vasudev

        Issue Links

        is related to

        Bug - A problem which impairs or prevents the functions of the product. YARN-4761 NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair scheduler

        • Major - Major loss of function.
        • Closed
        relates to

        Bug - A problem which impairs or prevents the functions of the product. YARN-3802 Two RMNodes for the same NodeId are used in RM sometimes after NM is reconnected.

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. YARN-3286 Cleanup RMNode#ReconnectNodeTransition

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            vvasudev Varun Vasudev
            vvasudev Varun Vasudev
            Votes:
            0 Vote for this issue
            Watchers:
            16 Stop watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment