Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-207

snappuller inefficient finding latest snapshot

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.2
    • replication (scripts)
    • None

    Description

      snapinstaller (and snappuller) do the following to find the latest snapshot:
      name=`find ${data_dir} -name snapshot.* -print|grep -v wip|sort -r|head -1`

      This recurses into all of the snapshot directories, doing much more disk-io than is necessary.
      I think it is the cause of bloated kernel memory usage we have seen on some of our Linux boxes, caused
      by kernel dentry and inode caches. Those caches compete with buffer cache (caching the actual data of the index)
      and can thus decrease performance.

      Attachments

        1. find_maxdepth.patch
          3 kB
          Yonik Seeley
        2. find_maxdepth.patch
          2 kB
          Yonik Seeley

        Activity

          People

            Unassigned Unassigned
            yseeley@gmail.com Yonik Seeley
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: