Details
-
Improvement
-
Status: Resolved
-
Trivial
-
Resolution: Fixed
-
2.3.0
-
None
Description
This is minor, and the root cause is my fault elsewhere, but its the patch I used to track down the problem.
If HadoopMapReduceCommitProtocol has a FileOutputCommitter for committing things, and somehow that's been configured with a JobAttemptContext, not a TaskAttemptContext, then the committer NPEs.
A require() statement can validate the working path and so point the blame at whoever's code is confused.