Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-3216

Store DocValues per segment instead of per field

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 4.0-ALPHA
    • Fix Version/s: 4.0-ALPHA
    • Component/s: core/index
    • Labels:
      None
    • Lucene Fields:
      New, Patch Available

      Description

      currently we are storing docvalues per field which results in at least one file per field that uses docvalues (or at most two per field per segment depending on the impl.). Yet, we should try to by default pack docvalues into a single file if possible. To enable this we need to hold all docvalues in memory during indexing and write them to disk once we flush a segment.

        Attachments

        1. LUCENE-3216_floats.patch
          10 kB
          Simon Willnauer
        2. LUCENE-3216.patch
          25 kB
          Simon Willnauer
        3. LUCENE-3216.patch
          30 kB
          Simon Willnauer
        4. LUCENE-3216.patch
          40 kB
          Simon Willnauer
        5. LUCENE-3216.patch
          17 kB
          Simon Willnauer
        6. LUCENE-3216.patch
          69 kB
          Simon Willnauer
        7. LUCENE-3216.patch
          71 kB
          Simon Willnauer
        8. LUCENE-3216.patch
          60 kB
          Simon Willnauer

          Issue Links

            Activity

              People

              • Assignee:
                simonw Simon Willnauer
                Reporter:
                simonw Simon Willnauer
              • Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: