[FLINK-11915] DataInputViewStream skip returns wrong value

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.6.3, 1.6.4, 1.7.2, 1.8.0
• Fix Version/s: 1.7.3, 1.8.1, 1.9.0
• Component/s: Formats (JSON, Avro, Parquet, ORC, SequenceFile), Runtime / Task
• Labels: pull-request-available
• Assignee: Biao Liu
• Reporter: Andrew Prudhomme
• Created: 14/Mar/19 01:33
• Updated: 24/Apr/19 11:41
• Resolved: 24/Apr/19 11:41

Description

The flink-core:org.apache.flink.api.java.typeutils.runtime.DataInputViewStream overrides the InputSteam skip function. This function should be returning the actual number of bytes skipped, but there is a bug which makes it return a lower value.

The fix should be something simple like:

-  return n - counter - inputView.skipBytes((int) counter);
+  return n - (counter - inputView.skipBytes((int) counter));

For context, I ran into this when trying to decode an Avro record where the writer schema had fields not present in the reader schema. The decoder would attempt to skip the unneeded data in the stream, but would throw an EOFException because the return value was wrong.

Issue Links

• links to: GitHub Pull Request #8195