[IGNITE-22813] Exception `Max retry limit exceeded: 10` while creating 50 tables in 10 threads with replication 3

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Cannot Reproduce
• Affects Version/s: 3.0
• Component/s: general, persistence
• Labels: ignite-3

Environment

3 server nodes running on 1 or 3 separate hosts.

• Ignite Flags: Docs Required, Release Notes Required
• Assignee: Unassigned
• Reporter: Igor
• Created: 23/Jul/24 17:44
• Updated: 19/Sep/24 06:36
• Resolved: 19/Sep/24 06:36

Description

Steps to reproduce:

Cluster of 3 servers located on 1 or 3 hosts.

In 10 threads (create 50 tables):

1. Create zone if not exists (same name for all tables) with replication 3.
2. Create table (all tables have different names).

 

Expected:
All tables are created.

Actual:
Exception on client side:

Max retry limit exceeded: 10
java.sql.SQLException: Max retry limit exceeded: 10
    at org.apache.ignite.internal.jdbc.proto.IgniteQueryErrorCode.createJdbcSqlException(IgniteQueryErrorCode.java:57)
    at org.apache.ignite.internal.jdbc.JdbcStatement.execute0(JdbcStatement.java:154)
    at org.apache.ignite.internal.jdbc.JdbcStatement.executeUpdate(JdbcStatement.java:177)
    at org.gridgain.qaaas.sql.generator.TableGeneratorHelper.createTable(TableGeneratorHelper.java:98)
    at org.gridgain.ai3tests.tests.amountcapacity.TablesAmountCapacityBaseTest.lambda$createTablesParallel$0(TablesAmountCapacityBaseTest.java:121)
    at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
    at java.base/java.lang.Thread.run(Thread.java:833) 

Server logs: server logs.zip

Comment:

The same code running on 1 server with replication 1 creates 850-950 tables: https://issues.apache.org/jira/browse/IGNITE-22814.

Issue Links

• is superceded by: IGNITE-22209 Creation of new tables in multinode cluster stuck after 150+ tables
• supercedes: IGNITE-22727 java.sql.SQLException: null after 400 tables are created