[HDFS-4465] Optimize datanode ReplicasMap and ReplicaInfo

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.5-alpha
• Fix Version/s: 2.1.0-beta
• Component/s: datanode
• Target Version/s: 2.1.0-beta
• Hadoop Flags: Reviewed
• Assignee: Aaron Myers
• Reporter: Suresh Srinivas
• Created: 01/Feb/13 22:52
• Updated: 27/Aug/13 22:07
• Resolved: 04/Jul/13 06:00

Description

In Hadoop a lot of optimization has been done in namenode data structures to be memory efficient. Similar optimizations are necessary for Datanode process. With the growth in storage per datanode and number of blocks hosted on datanode, this jira intends to optimize long lived ReplicasMap and ReplicaInfo objects.

Issue Links

• is related to: HDFS-4461 DirectoryScanner: volume path prefix takes up memory for every block that is scanned