Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6613

Change mapreduce.jobhistory.jhist.format default from json to binary

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.8.0
    • Fix Version/s: 3.0.0-alpha1
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      Default of 'mapreduce.jobhistory.jhist.format' property changed from 'json' to 'binary'. Creates smaller, binary Avro .jhist files for faster JHS performance.

      Description

      MAPREDUCE-6376 added a configuration setting to set up .jhist internal format:

      mapreduce.jobhistory.jhist.format

      Currently, the default is "json". Changing the default to "binary" allows faster parsing, but with the downside of making the file not output friendly by using "hadoop fs cat".

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                rchiang Ray Chiang
                Reporter:
                rchiang Ray Chiang
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: