Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-3770

improve composition, submission and result collection of gridmix

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.20.0
    • benchmarks
    • None
    • Reviewed

    Description

      Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
      Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.

      Attachments

        1. patch-3770.txt
          175 kB
          Lingyun Yang
        2. patch-3770.txt
          178 kB
          Lingyun Yang
        3. patch-3770.v2.txt
          104 kB
          Runping Qi

        Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-3769 expose static SampleMapper and SampleReducer classes of GenericMRLoadGenerator class for gridmix reuse

          • Major - Major loss of function.
          • Closed
          is duplicated by

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-4627 gridmix version 2

          • Major - Major loss of function.
          • Closed

          Activity

            People

              runping Runping Qi
              lyyang Lingyun Yang
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: