[FLINK-25446] Avoid sanity check on read bytes on DataInputStream#read(byte[])

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.14.2
• Fix Version/s: 1.14.3, 1.15.0
• Component/s: Runtime / Checkpointing, Runtime / State Backends
• Labels: pull-request-available
• Assignee: Yun Tang
• Reporter: Yun Tang
• Created: 27/Dec/21 03:41
• Updated: 28/Dec/21 14:05
• Resolved: 28/Dec/21 14:05

Description

Current changelog related code would check the number of read bytes whether equal to target bytes:

checkState(size == input.read(bytes));

However, this is not correct as the java doc said: "An attempt is made to read as many as len bytes, but a smaller number may be read, possibly zero."

Issue Links

• blocks: FLINK-25144 Test Changelog State Backend manually
• fixes: FLINK-25260 Recovery fails when using changelog+s3+presto
• links to: GitHub Pull Request #18202