Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6068

Illegal progress value warnings in map tasks

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha1
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: mrv2, task
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      When running a terasort on latest trunk, I see the following in my task logs:

      2014-09-02 17:42:28,437 INFO [main] org.apache.hadoop.mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
      2014-09-02 17:42:42,238 WARN [main] org.apache.hadoop.util.Progress: Illegal progress value found, progress is larger than 1. Progress will be changed to 1
      2014-09-02 17:42:42,238 WARN [main] org.apache.hadoop.util.Progress: Illegal progress value found, progress is larger than 1. Progress will be changed to 1
      2014-09-02 17:42:42,241 INFO [main] org.apache.hadoop.mapred.MapTask: Starting flush of map output
      

      We should eliminate these warnings.

        Attachments

        1. MAPREDUCE-6068.002.patch
          1 kB
          Binglin Chang
        2. MAPREDUCE-6068.003.patch
          2 kB
          Binglin Chang
        3. MAPREDUCE-6068.v1.patch
          1 kB
          Binglin Chang

          Activity

            People

            • Assignee:
              decster Binglin Chang
              Reporter:
              tlipcon Todd Lipcon
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: