Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2456

Show the reducer taskid and map/reduce tasktrackers for "Failed fetch notification #_ for task attempt..." log messages

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Trivial
    • Resolution: Fixed
    • Affects Version/s: 0.20.204.0
    • Fix Version/s: 0.20.204.0, 0.23.0
    • Component/s: jobtracker
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      This jira is to provide more useful log information for debugging the "Too many fetch-failures" error.

      Looking at the JobTracker node, we see messages like this:
      "2010-12-14 00:00:06,911 INFO org.apache.hadoop.mapred.JobInProgress: Failed fetch notification #8 for task
      attempt_201011300729_189729_m_007458_0".

      I would be useful to see which reducer is reporting the error here.

      So, I propose we add the following to these log messages:
      1. reduce task ID
      2. TaskTracker nodenames for both the mapper and the reducer

        Attachments

        1. MAPREDUCE-2456-trunk.patch
          3 kB
          Jeffrey Naisbitt
        2. MAPREDUCE-2456-trunk.patch
          3 kB
          Jeffrey Naisbitt
        3. MAPREDUCE-2456-0.20s.patch
          3 kB
          Jeffrey Naisbitt

          Activity

            People

            • Assignee:
              naisbitt Jeffrey Naisbitt
              Reporter:
              naisbitt Jeffrey Naisbitt
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 24h
                24h
                Remaining:
                Remaining Estimate - 24h
                24h
                Logged:
                Time Spent - Not Specified
                Not Specified