Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1658

[Rumen] Extract some job configurations.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • None
    • tools/rumen
    • None

    Description

      Enhance Rumen to extract the following configuration parameters from JobConf that may be relevant to job execution:

      • mapred.map.tasks.speculative.execution, mapred.reduce.tasks.speculative.execution
      • mapred.reduce.slowstart.completed.maps
      • io.sort.factor, io.sort.mb, io.sort.record.percent, io.sort.spill.percent
      • mapreduce.reduce.shuffle.connect.timeout, mapreduce.reduce.shuffle.read.timeout
      • mapred.job.shuffle.merge.percent, mapred.job.shuffle.input.buffer.percent
      • mapred.inmem.merge.threshold

      Attachments

        Activity

          People

            Unassigned Unassigned
            hong.tang Hong Tang
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: