[FLINK-28602] StateChangeFsUploader cannot close stream normally while enabling compression

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.15.1, 1.16.0
• Fix Version/s: 1.16.0, 1.15.2
• Component/s: Runtime / State Backends
• Labels: pull-request-available
• Assignee: Hangxiang Yu
• Reporter: Hangxiang Yu
• Created: 19/Jul/22 05:32
• Updated: 29/Jul/22 07:05
• Resolved: 29/Jul/22 07:05

Description

While enabling compression, Changelog part will wrap output stream using   

StreamCompressionDecorator#decorateWithCompression.

As the comment said, "IMPORTANT: For streams returned by this method, {@link OutputStream#close()} is not propagated to the inner stream. The inner stream must be closed separately.".

But StateChangeFsUploader will not close inner stream if wrapped stream has been closed.

So the upload may not complete when enabling compression even if it returns success.

Issue Links

• is related to: FLINK-28581 Test Changelog StateBackend V2 Manually
• links to: GitHub Pull Request #20306