Details

    • Hadoop Flags:
      Reviewed

      Description

      Currently the NN updates DatanodeDescriptor#storageMap while processing block reports but not from heartbeats. This results in the DatanodeStorageInfo#blockContentsStale being stale even after the first heartbeat is received.

        void receivedBlockReport() {
          if (heartbeatedSinceFailover) {
            blockContentsStale = false;
      

      We need to update storageMap if we see a new storage ID in a heartbeart.

      1. h5455.01.patch
        2 kB
        Arpit Agarwal

        Issue Links

          Activity

          Hide
          Arpit Agarwal added a comment -

          Patch to update storageMap from heartbeat.

          Show
          Arpit Agarwal added a comment - Patch to update storageMap from heartbeat.
          Hide
          Tsz Wo Nicholas Sze added a comment -

          +1 patch looks good.

          Show
          Tsz Wo Nicholas Sze added a comment - +1 patch looks good.
          Hide
          Arpit Agarwal added a comment -

          Thanks Nicholas! Committed this to branch HDFS-2832.

          Show
          Arpit Agarwal added a comment - Thanks Nicholas! Committed this to branch HDFS-2832 .

            People

            • Assignee:
              Arpit Agarwal
              Reporter:
              Arpit Agarwal
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development