[BEAM-10170] TextBasedReader may not respect the source end offset

• Type: Bug
• Status: Resolved
• Priority: P3
• Resolution: Won't Fix
• Fix Version/s: Missing
• Component/s: beam-model
• Assignee: Unassigned
• Reporter: Jessica Wise
• Created: 01/Jun/20 22:37
• Updated: 13/Jan/22 21:48
• Resolved: 14/Sep/21 23:11

Description

TextBasedReader is backed by a TextSource, which may have a start and end offset. If the end offset does not correspond to a delimiter, the TextBasedReader will not respect the end offset and will instead read past the end offset to the next instance of a delimiter. See TextBasedReader#findDelimiterBounds which finds the end of the next record to read: this method will "consume the channel till either EOF or the delimiter bounds are found." I believe this is a bug and that this method should also check for the end offset, not just EOF or a delimiter.