[HDFS-290] Additional performance improvement to chooseTarget - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Resolved
Priority: Major
Resolution: Later
Affects Version/s: None
Fix Version/s: None
Component/s: None
Labels:
None

Description

A few additional thoughts to improve the performance of chooseTarget:
1. Reduce the # of calls to getDistance in sortedByDistance
2. Improve the performance of getNode by adding a rack name to rack node map

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

rackMap.patch
04/Apr/07 18:28
5 kB
Hairong Kuang
rackMap1.patch
10/Apr/07 01:12
6 kB
Hairong Kuang
rackMap2.patch
10/Apr/07 23:37
9 kB
Hairong Kuang
rackMap3.patch
11/Apr/07 21:02
10 kB
Hairong Kuang

Issue Links

depends upon

HADOOP-1073 DFS Scalability: high CPU usage in choosing replication targets and file open

Closed

Activity

People

Assignee:: Hairong Kuang

Reporter:: Hairong Kuang

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 23/Mar/07 22:59

Updated:: 02/May/13 02:29

Resolved:: 02/Nov/10 00:45