[HDFS-5455] NN should update storageMap on first heartbeat

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Heterogeneous Storage (HDFS-2832)
• Fix Version/s: Heterogeneous Storage (HDFS-2832)
• Component/s: namenode
• Hadoop Flags: Reviewed
• Assignee: Arpit Agarwal
• Reporter: Arpit Agarwal
• Created: 04/Nov/13 20:36
• Updated: 04/Nov/13 21:53
• Resolved: 04/Nov/13 21:49

Description

Currently the NN updates DatanodeDescriptor#storageMap while processing block reports but not from heartbeats. This results in the DatanodeStorageInfo#blockContentsStale being stale even after the first heartbeat is received.

  void receivedBlockReport() {
    if (heartbeatedSinceFailover) {
      blockContentsStale = false;

We need to update storageMap if we see a new storage ID in a heartbeart.

Issue Links

• is broken by: HDFS-5398 NameNode changes to process storage reports per storage directory