Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-4845

Shuffle counter issues

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.20.0
    • 0.20.0
    • None
    • None
    • Reviewed

    Description

      HADOOP-4749 added a new counter tracking the bytes shuffled into the reduce. It adds an accumulator to ReduceCopier instead of simply incrementing the new counter and did not define a human-readable value in src/mapred/org/apache/hadoop/mapred/Task_Counter.properties.

      Attachments

        1. Hadoop-4845.patch
          5 kB
          He Yongqiang

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            he yongqiang He Yongqiang
            cdouglas Christopher Douglas
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment