[PIG-4922] Deadlock between SpillableMemoryManager and InternalSortedBag$SortedDataBagIterator

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: 0.18.0
• Assignee: Rohini Palaniswamy
• Reporter: Rohini Palaniswamy
• Created: 06/Jun/16 21:21
• Updated: 24/May/17 23:03

Description

This one ran into a deadlock, when the data was really huge and InternalSortedBag was reading spilled data from disk.

grpd = FOREACH (GROUP data BY $0){
    sorted = ORDER data BY timestamp DESC;
    latest = LIMIT sorted 1;
    GENERATE latest;
};