Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-2233

General example for modeling m/r load in Java

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 0.16.0
    • test
    • None

    Description

      This matches the hadoop.sort.(map|reduce).keep.percent interface in HADOOP-2127 and includes an "indirect" sort matching some user apps (when locality information is unavailable). It mostly, merely merges parts of the RandomWriter and Sort examples to effect sample loads in map/reduce.

      Attachments

        1. 2233-4.patch
          33 kB
          Christopher Douglas
        2. 2233-3.patch
          14 kB
          Christopher Douglas
        3. 2233-2.patch
          16 kB
          Christopher Douglas
        4. 2233-1.patch
          21 kB
          Christopher Douglas
        5. 2233-0.patch
          15 kB
          Christopher Douglas

        Issue Links

          is depended upon by

          Test - A new unit, integration or system test. HADOOP-2369 Representative mix of jobs for large cluster throughput benchmarking

          • Major - Major loss of function.
          • Closed
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-2127 Add pipes sort example

          • Major - Major loss of function.
          • Closed

          Activity

            People

              cdouglas Christopher Douglas
              cdouglas Christopher Douglas
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: