Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2432

RMStateStore should process the pending events before close

VotersStop watchingWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.7.0
    • resourcemanager
    • None

    Description

      Refer to discussion on YARN-2136 (https://issues.apache.org/jira/browse/YARN-2136?focusedCommentId=14097266&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14097266).

      As pointed out by Jian He, we should process the dispatcher event queue before closing the state store by flipping over the following statements in code.

      RMStateStore.java
       protected void serviceStop() throws Exception {
          closeInternal();
          dispatcher.stop();
        }
      

      Currently, if the state store is being stopped on events such as switching to standby, it will first close the state store(in case of ZKRMStateStore, close connection with ZK) and then process the pending events. Instead, we should first process the pending events and then call close.

      Attachments

        1. YARN-2432.patch
          0.8 kB
          Varun Saxena

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            varun_saxena Varun Saxena
            varun_saxena Varun Saxena
            Votes:
            0 Vote for this issue
            Watchers:
            4 Stop watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment