Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2725

Make Gridmix configure job specific config properties for the simulated jobs

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: contrib/gridmix
    • Labels:
      None

      Description

      As Rumen gets all the config properties into the trace file now(after MAPREDUCE-2153), Gridmix can set some of the important job-specific config properties obtained from trace to the simulated jobs. This imply that with same amount of input/output data for mapTask/reduceTask, the behavior of different other things like number of spills, sizes of spills, number of intermediate merges, etc would be similar to those were seen in original job(s).

        Attachments

        1. MR2725.patch
          6 kB
          Ravi Gummadi

          Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-2153 Bring in more job configuration properties in to the trace file

          • Major - Major loss of function.
          • Closed

            Activity

              People

              • Assignee:
                ravidotg Ravi Gummadi
                Reporter:
                ravidotg Ravi Gummadi
              • Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Dates

                • Created:
                  Updated: