Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-207

snappuller inefficient finding latest snapshot

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.2
    • Component/s: replication (scripts)
    • Labels:
      None

      Description

      snapinstaller (and snappuller) do the following to find the latest snapshot:
      name=`find ${data_dir} -name snapshot.* -print|grep -v wip|sort -r|head -1`

      This recurses into all of the snapshot directories, doing much more disk-io than is necessary.
      I think it is the cause of bloated kernel memory usage we have seen on some of our Linux boxes, caused
      by kernel dentry and inode caches. Those caches compete with buffer cache (caching the actual data of the index)
      and can thus decrease performance.

        Attachments

        1. find_maxdepth.patch
          3 kB
          Yonik Seeley
        2. find_maxdepth.patch
          2 kB
          Yonik Seeley

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              yseeley@gmail.com Yonik Seeley
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: