[PIG-1366] PigStorage's pushProjection implementation results in NPE under certain data conditions

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.6.0, 0.7.0
• Fix Version/s: 0.7.0
• Hadoop Flags: Reviewed
• Assignee: Pradeep Kamath
• Reporter: Pradeep Kamath
• Created: 08/Apr/10 03:43
• Updated: 14/May/10 06:47
• Resolved: 09/Apr/10 16:16

Description

Under the following conditions, a NullPointerException is caused when PigStorage is used:
If in the script, only the 2nd and 3rd column of the data (say) are used, the PruneColumns optimization passes this information to PigStorage through the pushProjection() method. If the data contains a row with only one column (malformed data due to missing cols in certain rows), PigStorage returns a Tuple backed by a null ArrayList. Subsequent projection operations on this tuple result in the NPE.