Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-207

snappuller inefficient finding latest snapshot

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.2
    • replication (scripts)
    • None

    Description

      snapinstaller (and snappuller) do the following to find the latest snapshot:
      name=`find ${data_dir} -name snapshot.* -print|grep -v wip|sort -r|head -1`

      This recurses into all of the snapshot directories, doing much more disk-io than is necessary.
      I think it is the cause of bloated kernel memory usage we have seen on some of our Linux boxes, caused
      by kernel dentry and inode caches. Those caches compete with buffer cache (caching the actual data of the index)
      and can thus decrease performance.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            yseeley@gmail.com Yonik Seeley
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment