Details
-
Bug
-
Status: Resolved
-
Critical
-
Resolution: Fixed
-
0.20.0
-
None
-
None
-
Reviewed
Description
Currently, the framework ignores jobs that have 0 maps. This is incorrect. Many pipelines need the job to run (if nothing else, to create the output directory!) so that subsequent jobs don't fail. Effectively, there will be no map tasks and the reduce tasks should immediately set up the Reducer and RecordWriter and then call close on both since there are no inputs to the reduce. I believe it should just work if we remove the check...