Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-6640

Replication can cause index corruption.

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 5.0
    • Fix Version/s: 5.0, 6.0
    • Component/s: replication (java)
    • Labels:
      None

      Description

      Test failure found on jenkins:
      http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Linux/11333/

      1 tests failed.
      REGRESSION:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
      
      Error Message:
      shard2 is not consistent.  Got 62 from http://127.0.0.1:57436/collection1lastClient and got 24 from http://127.0.0.1:53065/collection1
      
      Stack Trace:
      java.lang.AssertionError: shard2 is not consistent.  Got 62 from http://127.0.0.1:57436/collection1lastClient and got 24 from http://127.0.0.1:53065/collection1
              at __randomizedtesting.SeedInfo.seed([F4B371D421E391CD:7555FFCC56BCF1F1]:0)
              at org.junit.Assert.fail(Assert.java:93)
              at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1255)
              at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1234)
              at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:162)
              at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
      

      Cause of inconsistency is:

      Caused by: org.apache.lucene.index.CorruptIndexException: file mismatch, expected segment id=yhq3vokoe1den2av9jbd3yp8, got=yhq3vokoe1den2av9jbd3yp7 (resource=BufferedChecksumIndexInput(MMapIndexInput(path="/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-F4B371D421E391CD-001/tempDir-001/jetty3/index/_1_2.liv")))
         [junit4]   2> 		at org.apache.lucene.codecs.CodecUtil.checkSegmentHeader(CodecUtil.java:259)
         [junit4]   2> 		at org.apache.lucene.codecs.lucene50.Lucene50LiveDocsFormat.readLiveDocs(Lucene50LiveDocsFormat.java:88)
         [junit4]   2> 		at org.apache.lucene.codecs.asserting.AssertingLiveDocsFormat.readLiveDocs(AssertingLiveDocsFormat.java:64)
         [junit4]   2> 		at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:102)
      

        Attachments

        1. corruptindex.log
          4.47 MB
          Mark Miller
        2. Lucene-Solr-5.x-Linux-64bit-jdk1.8.0_20-Build-11333.txt
          889 kB
          Shalin Shekhar Mangar
        3. SOLR-6640_new_index_dir.patch
          12 kB
          Varun Thacker
        4. SOLR-6640.patch
          8 kB
          Shalin Shekhar Mangar
        5. SOLR-6640.patch
          4 kB
          Shalin Shekhar Mangar
        6. SOLR-6640.patch
          3 kB
          Varun Thacker
        7. SOLR-6640.patch
          36 kB
          Varun Thacker
        8. SOLR-6640-test.patch
          4 kB
          Shalin Shekhar Mangar
        9. SOLR-6920.patch
          16 kB
          Varun Thacker

          Issue Links

            Activity

              People

              • Assignee:
                markrmiller@gmail.com Mark Miller
                Reporter:
                shalinmangar Shalin Shekhar Mangar
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: