[HDFS-5390] Send one incremental block report per storage directory

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Heterogeneous Storage (HDFS-2832)
• Fix Version/s: Heterogeneous Storage (HDFS-2832)
• Component/s: datanode
• Assignee: Arpit Agarwal
• Reporter: Arpit Agarwal
• Created: 18/Oct/13 23:02
• Updated: 23/Oct/13 01:30
• Resolved: 23/Oct/13 01:30

Description

Incremental block reports should be sent per storage directory since the NameNode now expects all block reports to be sent per storage. Currently the Datanode tracks pending incremental block reports for all storages in a single queue.

This is a continuation of the work started by HDFS-5134 and HDFS-4988 to split block processing per storage directory.

Issue Links

• is related to: HDFS-4988 Datanode must support all the volumes as individual storages
• is related to: HDFS-5134 NameNode improvements to per-storage block processing
• relates to: HDFS-5406 Send incremental block reports for all storages in a single call
• requires: HDFS-5377 Heartbeats from Datandode should include one storage report per storage directory
• requires: HDFS-5398 NameNode changes to process storage reports per storage directory