Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-13872

Backup can fail to read index files w/NoSuchFileException during merges (SOLR-11616 regression)

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: master (9.0), 8.4
    • Component/s: None
    • Labels:
      None

      Description

      SOLR-11616 purports to fix a bug in Solr's backup functionality that causes 'NoSuchFileException' errors when attempting to backup an index while it is undergoing indexing (and segment merging)

      Although SOLR-11616 is marked with "Fix Version: 7.2" it's pretty easy to demonstrate that this bug still exists on master, branch_8x, and even in 7.2 - so it seems less like the current problem is a "regression" and more that the original fix didn't work.


      The crux of the problem seems to be concurrency bugs in if/how a commit is "reserved" before attempting to copy the files in that commit to the backup location.

      A possible work around discussed in more depth in the comments below is to update solrconfig.xml to explicitly configure the SolrDeletionPolicy with either the maxCommitsToKeep or maxCommitAge options to ensure the commits are kept around long enough for the backup to be created.

        Attachments

        1. SOLR-13872.patch
          84 kB
          Chris M. Hostetter
        2. SOLR-13872.patch
          79 kB
          Chris M. Hostetter
        3. SOLR-13872.patch
          75 kB
          Chris M. Hostetter
        4. SOLR-13872.patch
          30 kB
          Chris M. Hostetter
        5. index_churn.pl
          1 kB
          Chris M. Hostetter

          Issue Links

            Activity

              People

              • Assignee:
                hossman Chris M. Hostetter
                Reporter:
                hossman Chris M. Hostetter
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: