[HADOOP-2639] Reducers stuck in shuffle - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Blocker
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.16.0
Component/s: None
Labels:
None

Description

I started sort benchmark on 500 nodes. It has 40000 maps and 900 reducers.
There are 11 reducers stuck in shuffle with 33% progress. I could see a node down which ran 80 maps on it. And all these reducers are trying to fetch map output from that node.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HADOOP-2639.patch
24/Jan/08 19:42
1 kB
Amar Kamat
HADOOP-2639_1_20080128.patch
29/Jan/08 02:07
3 kB
Arun Murthy

Activity

People

Assignee:: Arun Murthy

Reporter:: Amareshwari Sriramadasu

Votes:: 0 Vote for this issue

Watchers:: 0 Start watching this issue

Dates

Created:: 17/Jan/08 08:27

Updated:: 08/Jul/09 16:52

Resolved:: 29/Jan/08 18:41