[HDFS-7836] BlockManager Scalability Improvements

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Charles Lamb
• Reporter: Charles Lamb
• Created: 25/Feb/15 00:43
• Updated: 30/Apr/15 23:35

Description

Improvements to BlockManager scalability.

Issue Links

• is related to: HDFS-6658 Namenode memory optimization - Block replicas list

Sub-Tasks

• Create an off-heap hash table implementation: In Progress
• Create off-heap BlocksMap and BlockData structures: In Progress
• Use off-heap BlocksMap, BlockInfo, etc. in FSNamesystem: Open
• Compress block reports: Open
• Improve TestMemoryManager and TestProbingHashTable: Open
• Modify NNThroughputBenchmark to be able to provide some metrics: Open