[PIG-3100] If a .pig_schema file is present, can get an index out of bounds error

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.12.0
• Assignee: Jonathan Coveney
• Reporter: Jonathan Coveney
• Created: 19/Dec/12 19:04
• Updated: 30/Sep/15 17:43
• Resolved: 20/Dec/12 18:51

Description

In the case that a .pig_schema file is present, if you have a record with fewer than expected fields, pig errors out with an index out of bounds exception that is annoying, unnecessary, and unhelpful.

Instead of improving logging, I decided to just do what pig should do, which is fill in the records.

Patch will include a test and the fix.

Issue Links

• is duplicated by: PIG-3056 CLONE - PigStorageSchema need to deal with missing field
• is related to: PIG-3102 Option for PigStorage load to error out when input record is incomplete (instead of filling in null)
• relates to: PIG-3828 PigStorage should properly handle \r, \n, \r\n in record itself