Details
-
Bug
-
Status: Patch Available
-
Major
-
Resolution: Unresolved
-
0.23.0, 2.0.0-alpha
-
None
Description
To be able to truly fix issues like MAPREDUCE-4819 and MAPREDUCE-4832, we need a 2 phase commit where a subsequent AM can be sure that at a specific point in time it knows exactly if any tasks/jobs are committing. The job history log is already used for similar functionality so we would like to reuse this, but we need to be sure that errors while writing out to the job history log are now fatal.