Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-1009

LogByteSizeMergePolicy over-merges with autoCommit=false and documents with term vectors and/or stored fields

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.3
    • Fix Version/s: 2.3
    • Component/s: None
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      Mark Miller noticed this slowdown (see details in LUCENE-994) in his
      app.

      This happens because in SegmentInfo.sizeInBytes(), we just run through
      all files associated with that segment, summing up their byte sizes.

      But in the case of shared doc stores (which happens when
      autoCommit=false), this is not quite correct because those files are
      shared across multiple segments.

      I plan to fix sizeInBytes() to not include the size of the doc stores
      when they are shared.

        Attachments

          Activity

            People

            • Assignee:
              mikemccand Michael McCandless
              Reporter:
              mikemccand Michael McCandless
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: