Details
-
Bug
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
In the case that a .pig_schema file is present, if you have a record with fewer than expected fields, pig errors out with an index out of bounds exception that is annoying, unnecessary, and unhelpful.
Instead of improving logging, I decided to just do what pig should do, which is fill in the records.
Patch will include a test and the fix.
Attachments
Attachments
Issue Links
- is duplicated by
-
PIG-3056 CLONE - PigStorageSchema need to deal with missing field
- Resolved
- is related to
-
PIG-3102 Option for PigStorage load to error out when input record is incomplete (instead of filling in null)
- Open
- relates to
-
PIG-3828 PigStorage should properly handle \r, \n, \r\n in record itself
- Open