[MAPREDUCE-6613] Change mapreduce.jobhistory.jhist.format default from json to binary

• Type: New Feature
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.8.0
• Fix Version/s: 3.0.0-alpha1
• Hadoop Flags: Incompatible change, Reviewed
• Release Note: Default of 'mapreduce.jobhistory.jhist.format' property changed from 'json' to 'binary'. Creates smaller, binary Avro .jhist files for faster JHS performance.
• Assignee: Ray Chiang
• Reporter: Ray Chiang
• Created: 22/Jan/16 00:43
• Updated: 12/May/16 18:22
• Resolved: 20/Feb/16 01:16

Description

MAPREDUCE-6376 added a configuration setting to set up .jhist internal format:

mapreduce.jobhistory.jhist.format

Currently, the default is "json". Changing the default to "binary" allows faster parsing, but with the downside of making the file not output friendly by using "hadoop fs cat".

Issue Links

• is related to: MAPREDUCE-6376 Add avro binary support for jhist files