Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2456

Show the reducer taskid and map/reduce tasktrackers for "Failed fetch notification #_ for task attempt..." log messages

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Trivial
    • Resolution: Fixed
    • 0.20.204.0
    • 0.20.204.0, 0.23.0
    • jobtracker
    • None
    • Reviewed

    Description

      This jira is to provide more useful log information for debugging the "Too many fetch-failures" error.

      Looking at the JobTracker node, we see messages like this:
      "2010-12-14 00:00:06,911 INFO org.apache.hadoop.mapred.JobInProgress: Failed fetch notification #8 for task
      attempt_201011300729_189729_m_007458_0".

      I would be useful to see which reducer is reporting the error here.

      So, I propose we add the following to these log messages:
      1. reduce task ID
      2. TaskTracker nodenames for both the mapper and the reducer

      Attachments

        1. MAPREDUCE-2456-trunk.patch
          3 kB
          Jeffrey Naisbitt
        2. MAPREDUCE-2456-0.20s.patch
          3 kB
          Jeffrey Naisbitt
        3. MAPREDUCE-2456-trunk.patch
          3 kB
          Jeffrey Naisbitt

        Activity

          People

            naisbitt Jeffrey Naisbitt
            naisbitt Jeffrey Naisbitt
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 24h
                24h
                Remaining:
                Remaining Estimate - 24h
                24h
                Logged:
                Time Spent - Not Specified
                Not Specified