Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-1009

LogByteSizeMergePolicy over-merges with autoCommit=false and documents with term vectors and/or stored fields

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.3
    • Fix Version/s: 2.3
    • Component/s: None
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      Mark Miller noticed this slowdown (see details in LUCENE-994) in his
      app.

      This happens because in SegmentInfo.sizeInBytes(), we just run through
      all files associated with that segment, summing up their byte sizes.

      But in the case of shared doc stores (which happens when
      autoCommit=false), this is not quite correct because those files are
      shared across multiple segments.

      I plan to fix sizeInBytes() to not include the size of the doc stores
      when they are shared.

        Activity

        There are no comments yet on this issue.

          People

          • Assignee:
            mikemccand Michael McCandless
            Reporter:
            mikemccand Michael McCandless
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development