[HDFS-15255] Consider StorageType when DatanodeManager#sortLocatedBlock() - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: 3.3.1, 3.4.0
Fix Version/s: 3.3.1, 3.4.0
Component/s: hdfs
Labels:
None

Target Version/s:

3.4.0
Hadoop Flags:

Reviewed

Description

When only one replica of a block is SDD, the others are HDD.
When the client reads the data, the current logic is that it considers the distance between the client and the dn. I think it should also consider the StorageType of the replica. Priority to return fast StorageType node when the distance is same.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HDFS-15255.001.patch
04/Apr/20 09:49
9 kB
Lisheng Sun
HDFS-15255.002.patch
06/Apr/20 14:13
18 kB
Lisheng Sun
HDFS-15255.003.patch
08/Apr/20 12:19
19 kB
Lisheng Sun
HDFS-15255.004.patch
09/Apr/20 11:46
20 kB
Lisheng Sun
HDFS-15255.005.patch
15/Apr/20 14:36
19 kB
Lisheng Sun
HDFS-15255.006.patch
19/Apr/20 04:29
19 kB
Lisheng Sun
experiment-find-bugs.001.patch
21/Apr/20 12:05
19 kB
Stephen O'Donnell
HDFS-15255-findbugs-test.001.patch
03/May/20 06:47
3 kB
Lisheng Sun
HDFS-15255.007.patch
04/May/20 11:58
19 kB
Lisheng Sun
HDFS-15255.008.patch
05/May/20 07:35
19 kB
Lisheng Sun
HDFS-15255.009.patch
06/May/20 16:41
19 kB
Stephen O'Donnell
HDFS-15255.010.patch
07/May/20 10:54
21 kB
Stephen O'Donnell

Issue Links

incorporates

HDFS-15573 Only log warning if considerLoad and considerStorageType are both true

Resolved

Activity

People

Assignee:: Lisheng Sun

Reporter:: Lisheng Sun

Votes:: 0 Vote for this issue

Watchers:: 5 Start watching this issue

Dates

Created:: 01/Apr/20 15:08

Updated:: 27/Jan/24 03:26

Resolved:: 12/May/20 15:28