[FLINK-9794] JDBCOutputFormat does not consider idle connection and multithreads synchronization

• Type: Bug
• Status: Open
• Priority: Not a Priority
• Resolution: Unresolved
• Affects Version/s: 1.4.0, 1.5.0
• Component/s: Connectors / JDBC
• Labels: auto-deprioritized-major auto-deprioritized-minor auto-unassigned pull-request-available
• Assignee: Unassigned
• Reporter: jrthe42
• Created: 10/Jul/18 16:13
• Updated: 28/Dec/21 22:38

Description

Current implementation of JDBCOutputFormat has two potential problems:

1. The Connection was established when JDBCOutputFormat is opened, and will be used all the time. But if this connection lies idle for a long time, the database will force close the connection, thus errors may occur.
2. The flush() method is called when batchCount exceeds the threshold, but it is also called while snapshotting state. So two threads may modify upload and batchCount, but without synchronization.

We need fix these two problems to make JDBCOutputFormat more reliable.

Issue Links

• links to: GitHub Pull Request #6301
• links to: GitHub Pull Request #6301