Details
-
Improvement
-
Status: Patch Available
-
Major
-
Resolution: Unresolved
-
0.20.1, 0.21.0
-
None
Description
JobTracker's hostnameToNodeMap cache can speed up JobInProgress.initTasks() and JobInProgress.createCache() significantly. A test for 1 job with 100000 maps on a 2400 cluster shows nearly 10 and 50 times speed up for initTasks() and createCache().