Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-15509 Issues to potentially improve JSON faceting and Stats performance with an SQL performance focus..
  3. SOLR-15562

Offer an MMapDirectoryFactory that writes with DirectIODirectory rather than FSDirectory.

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      DirectIODirectory uses a Java 10 feature to enable directio for merging so as to prevent merges from flooding the IO cache and replacing high value data with low value data.

      MMapDirectory is the top read side Directory, you should allow using it with a better write side Directory.

      Additionally, it might even be worth exploring how directio behaves in other read side spots.

      Word on the street is that it can reduce kernel memory management resources and improve the poor unmap performance and that with a random read heavy load on SSDs, it can be a win, especially in combination with other available application caches.

      Not wildly optimistic on the general read side, but perhaps worth taking a peak at.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            markrmiller Mark Robert Miller

            Dates

              Created:
              Updated:

              Slack

                Issue deployment