Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7225

Remove stale block invalidation work when DN re-registers with different UUID

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      BlockManager#invalidateWorkForOneNode looks up a DataNode by the datanodeUuid and passes the resultant DatanodeDescriptor to InvalidateBlocks#invalidateWork. However, if a wrong or outdated datanodeUuid is used, a null pointer will be passed to invalidateWork which will use it to lookup in a TreeMap. Since the key type is DatanodeDescriptor, key comparison is based on the IP address. A null key will crash the NameNode with an NPE.

      Attachments

        1. HDFS-7225.004.patch
          11 kB
          Andrew Wang
        2. HDFS-7225.005.patch
          11 kB
          Zhe Zhang
        3. HDFS-7225-v1.patch
          1 kB
          Zhe Zhang
        4. HDFS-7225-v2.patch
          3 kB
          Zhe Zhang
        5. HDFS-7225-v3.patch
          5 kB
          Zhe Zhang

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            zhz Zhe Zhang
            zhz Zhe Zhang
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment