[SOLR-12100] TestPullReplica.testKillLeader fails when PULL replica has the same version but different generation from the leader

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 9.0, 8.9
• Component/s: Tests
• Assignee: Timothy Potter
• Reporter: Tomas Eduardo Fernandez Lobbe
• Created: 15/Mar/18 12:56
• Updated: 23/Jun/21 13:43
• Resolved: 20/May/21 19:55

Description

Saw this failures in the BeastIt logs:

   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPullReplica -Dtests.method=testKillLeader -Dtests.seed=CCF279559DA396A -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=sr-RS -Dtests.timezone=Africa/Dar_es_Salaam -Dtests.asserts=true -Dtests.file.encoding=ANSI_X3.4-1968
   [junit4] FAILURE 60.5s | TestPullReplica.testKillLeader <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Replica core_node4 not up to date after 10 seconds expected:<1> but was:<0>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([CCF279559DA396A:45D9D3213B61AD3C]:0)
   [junit4]    > 	at org.apache.solr.cloud.TestPullReplica.waitForNumDocsInAllReplicas(TestPullReplica.java:538)
   [junit4]    > 	at org.apache.solr.cloud.TestPullReplica.doTestNoLeader(TestPullReplica.java:486)
   [junit4]    > 	at org.apache.solr.cloud.TestPullReplica.testKillLeader(TestPullReplica.java:305)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)

An interesting part of the logs is:

o.a.s.c.S.Request [pull_replica_test_kill_leader_shard1_replica_n1]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 119221 INFO  (indexFetcher-265-thread-1) [n:127.0.0.1:35263_solr c:pull_replica_test_kill_leader s:shard1 r:core_node4 x:pull_replica_test_kill_leader_shard1_replica_p2] o.a.s.h.IndexFetcher Master's generation: 2
   [junit4]   2> 119221 INFO  (indexFetcher-265-thread-1) [n:127.0.0.1:35263_solr c:pull_replica_test_kill_leader s:shard1 r:core_node4 x:pull_replica_test_kill_leader_shard1_replica_p2] o.a.s.h.IndexFetcher Master's version: 1520834006983
   [junit4]   2> 119221 INFO  (indexFetcher-265-thread-1) [n:127.0.0.1:35263_solr c:pull_replica_test_kill_leader s:shard1 r:core_node4 x:pull_replica_test_kill_leader_shard1_replica_p2] o.a.s.h.IndexFetcher Slave's generation: 3
   [junit4]   2> 119221 INFO  (indexFetcher-265-thread-1) [n:127.0.0.1:35263_solr c:pull_replica_test_kill_leader s:shard1 r:core_node4 x:pull_replica_test_kill_leader_shard1_replica_p2] o.a.s.h.IndexFetcher Slave's version: 1520834006983
   [junit4]   2> 119221 INFO  (indexFetcher-265-thread-1) [n:127.0.0.1:35263_solr c:pull_replica_test_kill_leader s:shard1 r:core_node4 x:pull_replica_test_kill_leader_shard1_replica_p2] o.a.s.h.IndexFetcher Slave in sync with master.

Issue Links

• is fixed by: SOLR-15399 TestPullReplica and TestPullReplicaWithAuth are flaky