Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3718

Datanode won't shutdown because of runaway DataBlockScanner thread

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 2.0.1-alpha
    • 0.23.3, 2.0.2-alpha
    • datanode
    • None
    • Reviewed

    Description

      Datanode sometimes does not shutdown because the block pool scanner thread keeps running. It prints out "Starting a new period" every five seconds, even after shutdown() is called. Somehow the interrupt is missed.

      DataBlockScanner will also terminate if datanode.shouldRun is false, but in DataNode#shutdown, DataBlockScanner#shutdown() is invoked before it is being set to false.

      Is there any reason why datanode.shouldRun is set to false later?

      Attachments

        1. hdfs-3718.patch.txt
          0.8 kB
          Kihwal Lee

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            kihwal Kihwal Lee
            kihwal Kihwal Lee
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment