[MAPREDUCE-2374] "Text File Busy" errors launching MR tasks - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: 0.22.0
Fix Version/s: 0.23.3, 2.0.2-alpha, 1.1.2
Component/s: None
Labels:
None

Hadoop Flags:

Reviewed

Description

Some very small percentage of tasks fail with a "Text file busy" error.

The following was the original diagnosis:

Our use of PrintWriter in TaskController.writeCommand is unsafe, since that class swallows all IO exceptions. We're not currently checking for errors, which I'm seeing result in occasional task failures with the message "Text file busy" - assumedly because the close() call is failing silently for some reason.

.. but turned out to be another issue as well (see below)

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

successfull_taskjvmsh.strace
24/Jul/12 04:28
33 kB
Shrinivas Joshi
mapreduce-2374-on-20sec.txt
09/Mar/11 22:55
2 kB
Todd Lipcon
mapreduce-2374-branch-1.patch
24/Jul/12 21:29
3 kB
Shrinivas Joshi
mapreduce-2374-2.txt
25/Jul/12 23:44
1 kB
Andy Isaacson
mapreduce-2374.txt
23/Jul/12 19:32
0.9 kB
Andy Isaacson
mapreduce-2374.txt
23/Jul/12 19:33
0.9 kB
Andy Isaacson
mapreduce-2374.txt
22/Aug/12 23:46
1 kB
Andy Isaacson
failed_taskjvmsh.strace
24/Jul/12 04:28
10 kB
Shrinivas Joshi

Issue Links

is cloned by

YARN-59 "Text File Busy" errors launching MR tasks

Resolved

is related to

MAPREDUCE-4857 Fix 126 error during map/reduce phase

Resolved

Activity

People

Assignee:: Andy Isaacson

Reporter:: Todd Lipcon

Votes:: 0 Vote for this issue

Watchers:: 23 Start watching this issue

Dates

Created:: 09/Mar/11 22:04

Updated:: 07/Feb/13 04:29

Resolved:: 23/Aug/12 18:32