Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1265

Fair Scheduler chokes on unhealthy node reconnect

VotersStop watchingWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.1.1-beta
    • 2.3.0
    • resourcemanager, scheduler
    • None
    • Reviewed

    Description

      Only nodes in the RUNNING state are tracked by schedulers. When a node reconnects, RMNodeImpl.ReconnectNodeTransition tries to remove it, even if it's in the RUNNING state. The FairScheduler doesn't guard against this.

      I think the best way to fix this is to check to see whether a node is RUNNING before telling the scheduler to remove it.

      Attachments

        1. YARN-1265.patch
          3 kB
          Sandy Ryza
        2. YARN-1265-1.patch
          1 kB
          Sandy Ryza

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            sandyr Sandy Ryza
            sandyr Sandy Ryza
            Votes:
            0 Vote for this issue
            Watchers:
            3 Stop watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Issue deployment