[MAPREDUCE-5711] When JobTracker writing JobHistory to HDFS, it may hung for long time due to DataNode error - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Duplicate
Affects Version/s: 1.2.0
Fix Version/s: 1.2.2
Component/s: None
Labels:
None

Description

When writing JobHistory to HDFS, it may takes very long time due to DataNode error, unfortunately, it also hold JobTracker lock, so it makes JobTracker hung for long time. It happens couple of times on our cluster.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

MAPREDUCE-5711-branch-1.2.patch
07/Jan/14 13:38
7 kB
yunjiong zhao

Issue Links

is related to

MAPREDUCE-1144 JT should not hold lock while writing user history logs to DFS

Resolved

Activity

People

Assignee:: yunjiong zhao

Reporter:: yunjiong zhao

Votes:: 0 Vote for this issue

Watchers:: 5 Start watching this issue

Dates

Created:: 07/Jan/14 13:17

Updated:: 10/Jan/14 01:44

Resolved:: 10/Jan/14 01:44