Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-13872

Backup can fail to read index files w/NoSuchFileException during merges (SOLR-11616 regression)

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 8.4, 9.0
    • None
    • None

    Description

      SOLR-11616 purports to fix a bug in Solr's backup functionality that causes 'NoSuchFileException' errors when attempting to backup an index while it is undergoing indexing (and segment merging)

      Although SOLR-11616 is marked with "Fix Version: 7.2" it's pretty easy to demonstrate that this bug still exists on master, branch_8x, and even in 7.2 - so it seems less like the current problem is a "regression" and more that the original fix didn't work.


      The crux of the problem seems to be concurrency bugs in if/how a commit is "reserved" before attempting to copy the files in that commit to the backup location.

      A possible work around discussed in more depth in the comments below is to update solrconfig.xml to explicitly configure the SolrDeletionPolicy with either the maxCommitsToKeep or maxCommitAge options to ensure the commits are kept around long enough for the backup to be created.

      Attachments

        1. index_churn.pl
          1 kB
          Chris M. Hostetter
        2. SOLR-13872.patch
          84 kB
          Chris M. Hostetter
        3. SOLR-13872.patch
          79 kB
          Chris M. Hostetter
        4. SOLR-13872.patch
          75 kB
          Chris M. Hostetter
        5. SOLR-13872.patch
          30 kB
          Chris M. Hostetter

        Issue Links

          Activity

            People

              hossman Chris M. Hostetter
              hossman Chris M. Hostetter
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: