[FLINK-36044] In flink-connector-mysql-cdc-2.4.0 version, scan.snapshot.fetch.size does not take effect

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: cdc-3.1.0
• Component/s: Flink CDC
• Labels: CDC
• Assignee: Unassigned
• Reporter: zhanghuaibei
• Created: 13/Aug/24 10:51
• Updated: 19/Aug/24 00:57

Description

In version 2.4 of the code, scan.snapshot.fetch.size was not read and loaded. In this version, how to implement MySQL stream reading, useCursorfetch=true, and debezium.snapshot.fetch.size for processing? can set Interger.MIN_VALUE?

Is ResultSet.TYPE-FORWARD_ONLY necessary?

 
flink-connector-mysql-cdc/src/main/java/com/ververica/cdc/connectors/mysql/source/utils/StatementUtils.java,
private static PreparedStatement initStatement(JdbcConnection jdbc, String sql, int fetchSize)
throws SQLException

{ final Connection connection = jdbc.connection(); connection.setAutoCommit(false); final PreparedStatement statement = connection.prepareStatement(sql); statement.setFetchSize(fetchSize); return statement; }

,Is this writing method correct?
This configuration does not work, and does it have a big impact on memory?