Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-13872

Backup can fail to read index files w/NoSuchFileException during merges (SOLR-11616 regression)

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 8.4, 9.0
    • None
    • None

    Description

      SOLR-11616 purports to fix a bug in Solr's backup functionality that causes 'NoSuchFileException' errors when attempting to backup an index while it is undergoing indexing (and segment merging)

      Although SOLR-11616 is marked with "Fix Version: 7.2" it's pretty easy to demonstrate that this bug still exists on master, branch_8x, and even in 7.2 - so it seems less like the current problem is a "regression" and more that the original fix didn't work.


      The crux of the problem seems to be concurrency bugs in if/how a commit is "reserved" before attempting to copy the files in that commit to the backup location.

      A possible work around discussed in more depth in the comments below is to update solrconfig.xml to explicitly configure the SolrDeletionPolicy with either the maxCommitsToKeep or maxCommitAge options to ensure the commits are kept around long enough for the backup to be created.

      Attachments

        1. index_churn.pl
          1 kB
          Chris M. Hostetter
        2. SOLR-13872.patch
          84 kB
          Chris M. Hostetter
        3. SOLR-13872.patch
          79 kB
          Chris M. Hostetter
        4. SOLR-13872.patch
          75 kB
          Chris M. Hostetter
        5. SOLR-13872.patch
          30 kB
          Chris M. Hostetter

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            hossman Chris M. Hostetter
            hossman Chris M. Hostetter
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment