Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-2233

General example for modeling m/r load in Java

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 0.16.0
    • test
    • None

    Description

      This matches the hadoop.sort.(map|reduce).keep.percent interface in HADOOP-2127 and includes an "indirect" sort matching some user apps (when locality information is unavailable). It mostly, merely merges parts of the RandomWriter and Sort examples to effect sample loads in map/reduce.

      Attachments

        1. 2233-4.patch
          33 kB
          Christopher Douglas
        2. 2233-3.patch
          14 kB
          Christopher Douglas
        3. 2233-2.patch
          16 kB
          Christopher Douglas
        4. 2233-1.patch
          21 kB
          Christopher Douglas
        5. 2233-0.patch
          15 kB
          Christopher Douglas

        Issue Links

        is depended upon by

        Test - A new unit, integration or system test. HADOOP-2369 Representative mix of jobs for large cluster throughput benchmarking

        • Major - Major loss of function.
        • Closed
        is related to

        Improvement - An improvement or enhancement to an existing feature or task. HADOOP-2127 Add pipes sort example

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            cdouglas Christopher Douglas
            cdouglas Christopher Douglas
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment