Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6574

MR AM should print host of failed tasks.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.8.0, 3.0.0-alpha1
    • None
    • None
    • Reviewed

    Description

      Something tasks failed because of issues on NMs. For example, bad disk/network could cause reducer fetching failure and mappers need to be re-scheduled.

      It will be very helpful to identify such issues if we could print host of failed tasks, which we can simply grep MR AM's log to see what happened.

      Attachments

        1. MAPREDUCE-6574-v1.patch
          1 kB
          Mohammad Shahid Khan
        2. MAPREDUCE-6574-v2.patch
          1 kB
          Mohammad Shahid Khan
        3. MAPREDUCE-6574-v3.patch
          2 kB
          Mohammad Shahid Khan
        4. MAPREDUCE-6574-v4.patch
          2 kB
          Mohammad Shahid Khan

        Activity

          People

            mohdshahidkhan Mohammad Shahid Khan
            leftnoteasy Wangda Tan
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: