Solr
  1. Solr
  2. SOLR-5608

Frequently reproducible failures in CollectionsAPIDistributedZkTest#testDistribSearch

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 4.7
    • Fix Version/s: 4.7, 6.0
    • Component/s: Tests
    • Labels:
      None
    • Environment:

      Description

      This is what looks like the relevant piece of the failure.

         [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=45A6C046A15FD121 -Dtests.slow=true -Dtests.locale=it_IT -Dtests.timezone=America/Creston -Dtests.file.encoding=US-ASCII
         [junit4] FAILURE  179s | CollectionsAPIDistributedZkTest.testDistribSearch <<<
         [junit4]    > Throwable #1: java.lang.AssertionError
         [junit4]    >        at __randomizedtesting.SeedInfo.seed([45A6C046A15FD121:C4404E5ED600B11D]:0)
         [junit4]    >        at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.deleteCollectionWithDownNodes(CollectionsAPIDistributedZkTest.java:390)
         [junit4]    >        at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:203)
         [junit4]    >        at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:849)
         [junit4]    >        at java.lang.Thread.run(Thread.java:724)
      

      This jenkins failure looks like it may be similar:

      http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/8868/

      1. SOLR-5608-failure1.txt
        5.04 MB
        Shawn Heisey
      2. SOLR-5608-failure2.txt
        4.84 MB
        Shawn Heisey
      3. SOLR-5608-failure3.txt
        3.86 MB
        Shawn Heisey
      4. SOLR-5608-lshw.txt
        48 kB
        Shawn Heisey

        Activity

        Hide
        Mark Miller added a comment -

        Thanks Shawn.

        Show
        Mark Miller added a comment - Thanks Shawn.
        Hide
        Shawn Heisey added a comment -

        Attaching full logs from three failures seen on this test. They are pretty big files. They use unicode character encoding and they're in Windows/DOS format, but the session log is from a Linux machine. I'm also including more information about that Linux machine than anyone probably wanted to know.

        Show
        Shawn Heisey added a comment - Attaching full logs from three failures seen on this test. They are pretty big files. They use unicode character encoding and they're in Windows/DOS format, but the session log is from a Linux machine. I'm also including more information about that Linux machine than anyone probably wanted to know.
        Hide
        ASF subversion and git services added a comment -

        Commit 1555659 from Mark Miller in branch 'dev/trunk'
        [ https://svn.apache.org/r1555659 ]

        SOLR-5608: Don't allow a closed SolrCore to publish state to ZooKeeper.

        Show
        ASF subversion and git services added a comment - Commit 1555659 from Mark Miller in branch 'dev/trunk' [ https://svn.apache.org/r1555659 ] SOLR-5608 : Don't allow a closed SolrCore to publish state to ZooKeeper.
        Hide
        ASF subversion and git services added a comment -

        Commit 1555660 from Mark Miller in branch 'dev/branches/branch_4x'
        [ https://svn.apache.org/r1555660 ]

        SOLR-5608: Don't allow a closed SolrCore to publish state to ZooKeeper.

        Show
        ASF subversion and git services added a comment - Commit 1555660 from Mark Miller in branch 'dev/branches/branch_4x' [ https://svn.apache.org/r1555660 ] SOLR-5608 : Don't allow a closed SolrCore to publish state to ZooKeeper.
        Hide
        ASF subversion and git services added a comment -

        Commit 1555661 from Mark Miller in branch 'dev/branches/lucene_solr_4_6'
        [ https://svn.apache.org/r1555661 ]

        SOLR-5608: Don't allow a closed SolrCore to publish state to ZooKeeper.

        Show
        ASF subversion and git services added a comment - Commit 1555661 from Mark Miller in branch 'dev/branches/lucene_solr_4_6' [ https://svn.apache.org/r1555661 ] SOLR-5608 : Don't allow a closed SolrCore to publish state to ZooKeeper.
        Hide
        ASF subversion and git services added a comment -

        Commit 1555685 from Mark Miller in branch 'dev/trunk'
        [ https://svn.apache.org/r1555685 ]

        SOLR-5608: Unregister core from cloud state after closing in unload.

        Show
        ASF subversion and git services added a comment - Commit 1555685 from Mark Miller in branch 'dev/trunk' [ https://svn.apache.org/r1555685 ] SOLR-5608 : Unregister core from cloud state after closing in unload.
        Hide
        ASF subversion and git services added a comment -

        Commit 1555686 from Mark Miller in branch 'dev/branches/branch_4x'
        [ https://svn.apache.org/r1555686 ]

        SOLR-5608: Unregister core from cloud state after closing in unload.

        Show
        ASF subversion and git services added a comment - Commit 1555686 from Mark Miller in branch 'dev/branches/branch_4x' [ https://svn.apache.org/r1555686 ] SOLR-5608 : Unregister core from cloud state after closing in unload.
        Hide
        ASF subversion and git services added a comment -

        Commit 1555687 from Mark Miller in branch 'dev/branches/lucene_solr_4_6'
        [ https://svn.apache.org/r1555687 ]

        SOLR-5608: Unregister core from cloud state after closing in unload.

        Show
        ASF subversion and git services added a comment - Commit 1555687 from Mark Miller in branch 'dev/branches/lucene_solr_4_6' [ https://svn.apache.org/r1555687 ] SOLR-5608 : Unregister core from cloud state after closing in unload.
        Hide
        Mark Miller added a comment -

        Hopefully the two above changes takes care of this.

        Show
        Mark Miller added a comment - Hopefully the two above changes takes care of this.
        Hide
        Mark Miller added a comment -

        I don't think it did - I'll have to do some more digging.

        Show
        Mark Miller added a comment - I don't think it did - I'll have to do some more digging.
        Hide
        ASF subversion and git services added a comment -

        Commit 1559600 from Mark Miller in branch 'dev/trunk'
        [ https://svn.apache.org/r1559600 ]

        SOLR-5608: Harden test.

        Show
        ASF subversion and git services added a comment - Commit 1559600 from Mark Miller in branch 'dev/trunk' [ https://svn.apache.org/r1559600 ] SOLR-5608 : Harden test.
        Hide
        ASF subversion and git services added a comment -

        Commit 1559602 from Mark Miller in branch 'dev/branches/branch_4x'
        [ https://svn.apache.org/r1559602 ]

        SOLR-5608: Harden test.

        Show
        ASF subversion and git services added a comment - Commit 1559602 from Mark Miller in branch 'dev/branches/branch_4x' [ https://svn.apache.org/r1559602 ] SOLR-5608 : Harden test.
        Hide
        Mark Miller added a comment -

        now I think I've gotten it

        Show
        Mark Miller added a comment - now I think I've gotten it
        Hide
        ASF subversion and git services added a comment -

        Commit 1559608 from Mark Miller in branch 'dev/branches/lucene_solr_4_6'
        [ https://svn.apache.org/r1559608 ]

        SOLR-5608: Harden test.

        Show
        ASF subversion and git services added a comment - Commit 1559608 from Mark Miller in branch 'dev/branches/lucene_solr_4_6' [ https://svn.apache.org/r1559608 ] SOLR-5608 : Harden test.
        Hide
        ASF subversion and git services added a comment -

        Commit 1559609 from Mark Miller in branch 'dev/trunk'
        [ https://svn.apache.org/r1559609 ]

        SOLR-5608: Raise wait for leader timeout from 1000 to 15000

        Show
        ASF subversion and git services added a comment - Commit 1559609 from Mark Miller in branch 'dev/trunk' [ https://svn.apache.org/r1559609 ] SOLR-5608 : Raise wait for leader timeout from 1000 to 15000
        Hide
        ASF subversion and git services added a comment -

        Commit 1559610 from Mark Miller in branch 'dev/branches/branch_4x'
        [ https://svn.apache.org/r1559610 ]

        SOLR-5608: Raise wait for leader timeout from 1000 to 15000

        Show
        ASF subversion and git services added a comment - Commit 1559610 from Mark Miller in branch 'dev/branches/branch_4x' [ https://svn.apache.org/r1559610 ] SOLR-5608 : Raise wait for leader timeout from 1000 to 15000
        Hide
        Mark Miller added a comment -

        Nope, still more to do here...

        Show
        Mark Miller added a comment - Nope, still more to do here...
        Hide
        ASF subversion and git services added a comment -

        Commit 1559724 from Mark Miller in branch 'dev/trunk'
        [ https://svn.apache.org/r1559724 ]

        SOLR-5608: Boost wait from 100ms to 300ms

        Show
        ASF subversion and git services added a comment - Commit 1559724 from Mark Miller in branch 'dev/trunk' [ https://svn.apache.org/r1559724 ] SOLR-5608 : Boost wait from 100ms to 300ms
        Hide
        ASF subversion and git services added a comment -

        Commit 1559725 from Mark Miller in branch 'dev/branches/branch_4x'
        [ https://svn.apache.org/r1559725 ]

        SOLR-5608: Boost wait from 100ms to 300ms

        Show
        ASF subversion and git services added a comment - Commit 1559725 from Mark Miller in branch 'dev/branches/branch_4x' [ https://svn.apache.org/r1559725 ] SOLR-5608 : Boost wait from 100ms to 300ms
        Hide
        ASF subversion and git services added a comment -

        Commit 1559788 from Mark Miller in branch 'dev/trunk'
        [ https://svn.apache.org/r1559788 ]

        SOLR-5608: Boost wait from 300ms to 500ms

        Show
        ASF subversion and git services added a comment - Commit 1559788 from Mark Miller in branch 'dev/trunk' [ https://svn.apache.org/r1559788 ] SOLR-5608 : Boost wait from 300ms to 500ms
        Hide
        ASF subversion and git services added a comment -

        Commit 1566492 from Mark Miller in branch 'dev/trunk'
        [ https://svn.apache.org/r1566492 ]

        SOLR-5608: Add short poll to test.

        Show
        ASF subversion and git services added a comment - Commit 1566492 from Mark Miller in branch 'dev/trunk' [ https://svn.apache.org/r1566492 ] SOLR-5608 : Add short poll to test.
        Hide
        ASF subversion and git services added a comment -

        Commit 1566493 from Mark Miller in branch 'dev/branches/branch_4x'
        [ https://svn.apache.org/r1566493 ]

        SOLR-5608: Add short poll to test.

        Show
        ASF subversion and git services added a comment - Commit 1566493 from Mark Miller in branch 'dev/branches/branch_4x' [ https://svn.apache.org/r1566493 ] SOLR-5608 : Add short poll to test.

          People

          • Assignee:
            Mark Miller
            Reporter:
            Shawn Heisey
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development