Details
-
Bug
-
Status: Closed
-
Major
-
Resolution: Fixed
-
0.20.1
-
None
-
None
-
Reviewed
-
Fixed Map/Reduce framework to not call commit task for special tasks like job setup/cleanup and task cleanup.
Description
Currently, Task.done() calls committer.needsTaskCommit() to know whether it needs a commit or not. This need not be called for task cleanup attempt as no commit is required for a cleanup attempt.
Due to MAPREDUCE-1409, we saw a case where cleanup attempt went into COMMIT_PENDING state.