[HADOOP-1983] jobs using pipes interface with tasks not using java output format have a good chance of not updating progress and timing out - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: 0.15.0
Fix Version/s: 0.15.0
Component/s: None
Labels:
None

Description

When using C++-pipes interface, mappers/reducers not emitting any key-values pairs, but running longer than 'mapred.task.timeout' might timeout even when they send periodical status updates upstream.

The cause of the problem is that all upstream messages are buffered. Progress and status updates should be flushed immediately.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

pipe-flush.patch
03/Oct/07 23:22
3 kB
Owen O'Malley

Activity

People

Assignee:: Owen O'Malley

Reporter:: Christian Kunz

Votes:: 0 Vote for this issue

Watchers:: 0 Start watching this issue

Dates

Created:: 02/Oct/07 05:26

Updated:: 08/Jul/09 16:41

Resolved:: 05/Oct/07 21:10