[PIG-3327] Pig hits OOM when fetching task Reports

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.10.1
• Fix Version/s: 0.12.0
• Assignee: Rohini Palaniswamy
• Reporter: Rohini Palaniswamy
• Created: 15/May/13 21:22
• Updated: 14/Oct/13 16:45
• Resolved: 03/Jun/13 14:51

Description

java.lang.OutOfMemoryError: GC overhead limit exceeded is hit with hadoop 23 by the pig script when a launched job has 80K+ maps. The TaskReport[] array is causing OOM.