Details
-
Bug
-
Status: Closed
-
Minor
-
Resolution: Fixed
-
0.18.0
-
None
-
None
-
Reviewed
Description
ReduceTask.ReduceCopier.ShuffleRamManager initializes numRequiredMapOutputs to 0, so one of the predicates in ShuffleRamManager::waitForDataToMerge, numPendingRequests < numRequiredMapOutputs, is false until the first map output is fetched and false again after the last map output is fetched. The InMemFSMergeThread thread will loop busily in this state.