[PIG-814] Make Binstorage more robust when data contains record markers

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.3.0
• Fix Version/s: 0.3.0
• Hadoop Flags: Reviewed
• Assignee: Pradeep Kamath
• Reporter: Pradeep Kamath
• Created: 21/May/09 23:11
• Updated: 24/Mar/10 22:11
• Resolved: 22/May/09 20:30

Description

When the inputstream for BinStorage is at a position where the data has the record marker sequence, the code incorrectly assumes that it is at the beginning of a record (tuple) and calls DataReaderWriter.readDatum() trying to read the tuple. The problem is more likely when RandomSampleLoader (used in order by implementation) skips the input stream for sampling and calls Binstorage.getNext(). The code should be more robust in such cases