Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-11278

Fix race in cdcr bootstrap process

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 6.6.1, 7.0
    • Fix Version/s: 7.1
    • Component/s: CDCR
    • Labels:

      Description

      CdcrBootstrapTest is failing while running beasts for significant iterations.

      The bootstrapping is failing in the test, after the first batch is indexed for each testmethod, which results in documents mismatch ::

        [beaster]   2> 39167 ERROR (updateExecutor-39-thread-1-processing-n:127.0.0.1:42155_solr x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) [n:127.0.0.1:42155_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.h.CdcrRequestHandler Bootstrap operation failed
        [beaster]   2> java.util.concurrent.ExecutionException: java.lang.AssertionError
        [beaster]   2> 	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        [beaster]   2> 	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        [beaster]   2> 	at org.apache.solr.handler.CdcrRequestHandler.lambda$handleBootstrapAction$0(CdcrRequestHandler.java:654)
        [beaster]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
        [beaster]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        [beaster]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        [beaster]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
        [beaster]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        [beaster]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        [beaster]   2> 	at java.lang.Thread.run(Thread.java:748)
        [beaster]   2> Caused by: java.lang.AssertionError
        [beaster]   2> 	at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:813)
        [beaster]   2> 	at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:724)
        [beaster]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
        [beaster]   2> 	... 5 more
      
        [beaster] [01:37:16.282] FAILURE  153s | CdcrBootstrapTest.testBootstrapWithSourceCluster <<<
        [beaster]    > Throwable #1: java.lang.AssertionError: Document mismatch on target after sync expected:<2000> but was:<1000>
      

        Attachments

        1. test_results
          14.40 MB
          Amrit Sarkar
        2. SOLR-11278.patch
          7 kB
          Amrit Sarkar
        3. SOLR-11278-cancel-bootstrap-on-stop.patch
          2 kB
          Shalin Shekhar Mangar
        4. master-bs.patch
          11 kB
          Amrit Sarkar
        5. SOLR-11278-awaits-fix.patch
          0.7 kB
          Amrit Sarkar
        6. SOLR-11278.patch
          3 kB
          Amrit Sarkar
        7. SOLR-11278.patch
          2 kB
          Amrit Sarkar
        8. SOLR-11278.patch
          3 kB
          Amrit Sarkar

          Activity

            People

            • Assignee:
              varun Varun Thacker
              Reporter:
              sarkaramrit2@gmail.com Amrit Sarkar

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment