Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2456

Show the reducer taskid and map/reduce tasktrackers for "Failed fetch notification #_ for task attempt..." log messages

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Trivial Trivial
    • Resolution: Fixed
    • Affects Version/s: 0.20.204.0
    • Fix Version/s: 0.20.204.0, 0.23.0
    • Component/s: jobtracker
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      This jira is to provide more useful log information for debugging the "Too many fetch-failures" error.

      Looking at the JobTracker node, we see messages like this:
      "2010-12-14 00:00:06,911 INFO org.apache.hadoop.mapred.JobInProgress: Failed fetch notification #8 for task
      attempt_201011300729_189729_m_007458_0".

      I would be useful to see which reducer is reporting the error here.

      So, I propose we add the following to these log messages:
      1. reduce task ID
      2. TaskTracker nodenames for both the mapper and the reducer

      1. MAPREDUCE-2456-0.20s.patch
        3 kB
        Jeffrey Naisbitt
      2. MAPREDUCE-2456-trunk.patch
        3 kB
        Jeffrey Naisbitt
      3. MAPREDUCE-2456-trunk.patch
        3 kB
        Jeffrey Naisbitt

        Activity

        Jeffrey Naisbitt created issue -
        Jeffrey Naisbitt made changes -
        Field Original Value New Value
        Fix Version/s 0.23.0 [ 12315570 ]
        Component/s jobtracker [ 12312907 ]
        Jeffrey Naisbitt made changes -
        Attachment MAPREDUCE-2456-trunk.patch [ 12478209 ]
        Jeffrey Naisbitt made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Fix Version/s 0.20.205.0 [ 12316391 ]
        Jeffrey Naisbitt made changes -
        Attachment MAPREDUCE-2456-0.20s.patch [ 12478210 ]
        Jeffrey Naisbitt made changes -
        Attachment MAPREDUCE-2456-trunk.patch [ 12478616 ]
        Chris Douglas made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Fix Version/s 0.20.205.0 [ 12316391 ]
        Resolution Fixed [ 1 ]
        Owen O'Malley made changes -
        Fix Version/s 0.20.204.0 [ 12316318 ]
        Owen O'Malley made changes -
        Fix Version/s 0.20.205.0 [ 12316391 ]
        Owen O'Malley made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Jeffrey Naisbitt
            Reporter:
            Jeffrey Naisbitt
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - 24h
              24h
              Remaining:
              Remaining Estimate - 24h
              24h
              Logged:
              Time Spent - Not Specified
              Not Specified

                Development