Issue Details (XML | Word | Printable)

Key: HADOOP-692
Type: Improvement Improvement
Status: Closed Closed
Resolution: Fixed
Priority: Major Major
Assignee: Hairong Kuang
Reporter: Hairong Kuang
Votes: 0
Watchers: 1
Operations

If you were logged in you would be able to see more operations.
Hadoop Common

Rack-aware Replica Placement

Created: 08/Nov/06 06:49 PM   Updated: 08/Jul/09 04:42 PM
Return to search
Component/s: None
Affects Version/s: 0.10.1
Fix Version/s: 0.11.0

Time Tracking:
Not Specified

File Attachments:
  File Name Date Attached Attached By Size
Text File Licensed for inclusion in ASF works rack.patch 2007-02-03 12:32 AM Hairong Kuang 101 kB
PDF File Licensed for inclusion in ASF works Rack_aware_HDFS_proposal.pdf 2006-11-17 08:26 PM Hairong Kuang 16 kB
Issue Links:
Dependants
 
dependent
 

Resolution Date: 03/Feb/07 01:11 AM


 Description  « Hide
This issue assumes that HDFS runs on a cluster of computers that spread across many racks. Communication between two nodes on different racks needs to go through switches. Bandwidth in/out of a rack may be less than the total bandwidth of machines in the rack. The purpose of rack-aware replica placement is to improve data reliability, availability, and network bandwidth utilization. The basic idea is that each data node determines to which rack it belongs at the startup time and notifies the name node of the rack id upon registration. The name node maintains a rackid-to-datanode map and tries to place replicas across racks.

 All   Comments   Work Log   Change History   Subversion Commits      Sort Order: Ascending order - Click to sort in descending order
Hairong Kuang made changes - 17/Nov/06 08:26 PM
Field Original Value New Value
Attachment Rack_aware_HDFS_proposal.pdf [ 12345251 ]
Doug Cutting made changes - 01/Dec/06 10:39 PM
Fix Version/s 0.9.0 [ 12312134 ]
Hairong Kuang made changes - 09/Jan/07 07:59 PM
Attachment rack.patch [ 12348575 ]
Hairong Kuang made changes - 13/Jan/07 01:21 AM
Attachment rack1.patch [ 12348881 ]
Hairong Kuang made changes - 19/Jan/07 11:39 PM
Attachment rack2.patch [ 12349293 ]
Hairong Kuang made changes - 19/Jan/07 11:40 PM
Attachment rack.patch [ 12348575 ]
Hairong Kuang made changes - 19/Jan/07 11:41 PM
Attachment rack1.patch [ 12348881 ]
Hairong Kuang made changes - 20/Jan/07 12:10 AM
Attachment rack2.patch [ 12349293 ]
Hairong Kuang made changes - 20/Jan/07 12:11 AM
Attachment rack.patch [ 12349295 ]
Hairong Kuang made changes - 25/Jan/07 09:00 PM
Link This issue depends upon HADOOP-937 [ HADOOP-937 ]
Doug Cutting made changes - 31/Jan/07 06:15 PM
Link This issue blocks HADOOP-951 [ HADOOP-951 ]
Hairong Kuang made changes - 02/Feb/07 08:09 PM
Attachment rack.patch [ 12349295 ]
Hairong Kuang made changes - 02/Feb/07 08:09 PM
Attachment rack.patch [ 12350247 ]
Hairong Kuang made changes - 03/Feb/07 12:32 AM
Attachment rack.patch [ 12350247 ]
Hairong Kuang made changes - 03/Feb/07 12:32 AM
Attachment rack.patch [ 12350262 ]
Hairong Kuang made changes - 03/Feb/07 12:33 AM
Status Open [ 1 ] Patch Available [ 10002 ]
Affects Version/s 0.8.0 [ 12312098 ]
Affects Version/s 0.10.1 [ 12312258 ]
Fix Version/s 0.11.0 [ 12312257 ]
Doug Cutting made changes - 03/Feb/07 01:11 AM
Status Patch Available [ 10002 ] Resolved [ 5 ]
Resolution Fixed [ 1 ]
Doug Cutting made changes - 03/Feb/07 03:23 AM
Status Resolved [ 5 ] Closed [ 6 ]
Jim Kellerman made changes - 15/Jan/08 07:42 PM
Link This issue blocks HADOOP-2138 [ HADOOP-2138 ]
Owen O'Malley made changes - 08/Jul/09 04:42 PM
Component/s dfs [ 12310710 ]

Powered by a free Atlassian JIRA open source license for Apache Software Foundation. Try JIRA - bug tracking software for your team.
Atlassian JIRA the Professional Issue Tracker. (Enterprise Edition, Version: 3.13.2-#335) - Bug/feature request - Atlassian news - Contact Administrators