[BEAM-5412] TFRecordIO fails with records larger than 8K

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Affects Version/s: 2.4.0
• Fix Version/s: 2.8.0
• Component/s: io-java-tfrecord
• Assignee: Chamikara Madhusanka Jayalath
• Reporter: Raghu Angadi
• Created: 17/Sep/18 19:40
• Updated: 16/May/20 13:51
• Resolved: 21/Sep/18 02:55

Description

This was reported on Stackoverflow. TFRecordIO reader assumes a single call to channel.read() returns as much as can fit in the input buffer. read() can return fewer bytes than requested. Assert failure : https://github.com/apache/beam/blob/release-2.4.0/sdks/java/core/src/main/java/org/apache/beam/sdk/io/TFRecordIO.java#L642

Issue Links

• links to: GitHub Pull Request #6440