Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7225

Remove stale block invalidation work when DN re-registers with different UUID

    XMLWordPrintableJSON

Details

    Description

      BlockManager#invalidateWorkForOneNode looks up a DataNode by the datanodeUuid and passes the resultant DatanodeDescriptor to InvalidateBlocks#invalidateWork. However, if a wrong or outdated datanodeUuid is used, a null pointer will be passed to invalidateWork which will use it to lookup in a TreeMap. Since the key type is DatanodeDescriptor, key comparison is based on the IP address. A null key will crash the NameNode with an NPE.

      Attachments

        1. HDFS-7225-v3.patch
          5 kB
          Zhe Zhang
        2. HDFS-7225-v2.patch
          3 kB
          Zhe Zhang
        3. HDFS-7225-v1.patch
          1 kB
          Zhe Zhang
        4. HDFS-7225.005.patch
          11 kB
          Zhe Zhang
        5. HDFS-7225.004.patch
          11 kB
          Andrew Wang

        Issue Links

          Activity

            People

              zhz Zhe Zhang
              zhz Zhe Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: