[HADOOP-3603] Setting spill threshold to 100% fails to detect spill for records

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.17.0
• Fix Version/s: 0.18.0
• Hadoop Flags: Reviewed
• Assignee: Christopher Douglas
• Reporter: Christopher Douglas
• Created: 20/Jun/08 01:01
• Updated: 08/Jul/09 16:52
• Resolved: 21/Jun/08 23:29

Description

If io.sort.record.percent is set to 1.0, the simultaneous collection and spill is disabled. However, if one exhausts the offset allocation before the serialization allocation, the limit will not be detected and the write will block forever.