Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2456

Show the reducer taskid and map/reduce tasktrackers for "Failed fetch notification #_ for task attempt..." log messages

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Trivial Trivial
    • Resolution: Fixed
    • Affects Version/s: 0.20.204.0
    • Fix Version/s: 0.20.204.0, 0.23.0
    • Component/s: jobtracker
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      This jira is to provide more useful log information for debugging the "Too many fetch-failures" error.

      Looking at the JobTracker node, we see messages like this:
      "2010-12-14 00:00:06,911 INFO org.apache.hadoop.mapred.JobInProgress: Failed fetch notification #8 for task
      attempt_201011300729_189729_m_007458_0".

      I would be useful to see which reducer is reporting the error here.

      So, I propose we add the following to these log messages:
      1. reduce task ID
      2. TaskTracker nodenames for both the mapper and the reducer

      1. MAPREDUCE-2456-trunk.patch
        3 kB
        Jeffrey Naisbitt
      2. MAPREDUCE-2456-0.20s.patch
        3 kB
        Jeffrey Naisbitt
      3. MAPREDUCE-2456-trunk.patch
        3 kB
        Jeffrey Naisbitt

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Jeffrey Naisbitt
            Reporter:
            Jeffrey Naisbitt
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - 24h
              24h
              Remaining:
              Remaining Estimate - 24h
              24h
              Logged:
              Time Spent - Not Specified
              Not Specified

                Development