Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-9115

NRTCachingDirectory may put large files in the cache

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 8.5
    • Component/s: None
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      NRTCachingDirectory assumes that the length of a file to write is 0 if there is no merge info or flush info. This is not correct as there are situations when Lucene might write very large files that have neither of them, for instance:

      • Stored fields are written on the fly with IOContext.DEFAULT (which doesn't have flush or merge info) and without taking any of the IndexWriter buffer, so gigabytes could be written before a flush happens.
      • BKD trees are merged with IOContext.DEFAULT.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              jpountz Adrien Grand

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 0.5h
                0.5h

                  Issue deployment