Affects Version/s: 0.23.0
Fix Version/s: 0.23.1
Release Note:Fixed MR AM to always use hostnames and never IPs when requesting containers so that scheduler can give off data local containers correctly.
BlockLocation.getHosts() returns IP addresses occasionally. Data locality is affected - since the RM requires hostnames.
Arun C Murthy made changes -
|Status||Resolved [ 5 ]||Closed [ 6 ]|
Vinod Kumar Vavilapalli made changes -
|Status||Patch Available [ 10002 ]||Resolved [ 5 ]|
|Hadoop Flags||Reviewed [ 10343 ]|
|Release Note||Fixed MR AM to always use hostnames and never IPs when requesting containers so that scheduler can give off data local containers correctly.|
|Fix Version/s||0.23.1 [ 12318883 ]|
|Resolution||Fixed [ 1 ]|
|Status||Open [ 1 ]||Patch Available [ 10002 ]|
|Summary||Data Locality suffers if HDFS returns IPs in getFileBlockLocations||Data Locality suffers if the AM asks for containers using IPs instead of hostnames|
|Field||Original Value||New Value|
|Assignee||Siddharth Seth [ sseth ]|