Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2725

Make Gridmix configure job specific config properties for the simulated jobs

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • contrib/gridmix
    • None

    Description

      As Rumen gets all the config properties into the trace file now(after MAPREDUCE-2153), Gridmix can set some of the important job-specific config properties obtained from trace to the simulated jobs. This imply that with same amount of input/output data for mapTask/reduceTask, the behavior of different other things like number of spills, sizes of spills, number of intermediate merges, etc would be similar to those were seen in original job(s).

      Attachments

        1. MR2725.patch
          6 kB
          Ravi Gummadi

        Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-2153 Bring in more job configuration properties in to the trace file

          • Major - Major loss of function.
          • Closed

          Activity

            People

              ravidotg Ravi Gummadi
              ravidotg Ravi Gummadi
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated: