Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5711

When JobTracker writing JobHistory to HDFS, it may hung for long time due to DataNode error

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 1.2.0
    • Fix Version/s: 1.2.2
    • Component/s: None
    • Labels:
      None

      Description

      When writing JobHistory to HDFS, it may takes very long time due to DataNode error, unfortunately, it also hold JobTracker lock, so it makes JobTracker hung for long time. It happens couple of times on our cluster.

        Attachments

        1. MAPREDUCE-5711-branch-1.2.patch
          7 kB
          yunjiong zhao

          Issue Links

            Activity

              People

              • Assignee:
                zhaoyunjiong yunjiong zhao
                Reporter:
                zhaoyunjiong yunjiong zhao
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: