Hadoop seems to ignore the config options even though they are printed as deprecation warnings in the log: mapred.output.compress and
- settings that work on 0.20 but not on 0.23
- settings that work on 0.23
This breaks backwards compatibility and causes existing jobs to fail.
This was found to happen due to the JobSubmitter writing out the job.xml file with the old-style configs and can be fixed by handdling deprecation before the file is written out.