Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-5189

Numeric DocValues Updates

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 4.6, 6.0
    • core/index
    • None
    • New, Patch Available

    Description

      In LUCENE-4258 we started to work on incremental field updates, however the amount of changes are immense and hard to follow/consume. The reason is that we targeted postings, stored fields, DV etc., all from the get go.

      I'd like to start afresh here, with numeric-dv-field updates only. There are a couple of reasons to that:

      • NumericDV fields should be easier to update, if e.g. we write all the values of all the documents in a segment for the updated field (similar to how livedocs work, and previously norms).
      • It's a fairly contained issue, attempting to handle just one data type to update, yet requires many changes to core code which will also be useful for updating other data types.
      • It has value in and on itself, and we don't need to allow updating all the data types in Lucene at once ... we can do that gradually.

      I have some working patch already which I'll upload next, explaining the changes.

      Attachments

        1. LUCENE-5189-updates-order.patch
          9 kB
          Shai Erera
        2. LUCENE-5189-updates-order.patch
          12 kB
          Shai Erera
        3. LUCENE-5189-segdv.patch
          11 kB
          Shai Erera
        4. LUCENE-5189-renames.patch
          221 kB
          Shai Erera
        5. LUCENE-5189-no-lost-updates.patch
          9 kB
          Shai Erera
        6. LUCENE-5189-4x.patch
          216 kB
          Shai Erera
        7. LUCENE-5189-4x.patch
          398 kB
          Shai Erera
        8. LUCENE-5189.patch
          125 kB
          Shai Erera
        9. LUCENE-5189.patch
          125 kB
          Shai Erera
        10. LUCENE-5189.patch
          114 kB
          Shai Erera
        11. LUCENE-5189.patch
          118 kB
          Shai Erera
        12. LUCENE-5189.patch
          123 kB
          Shai Erera
        13. LUCENE-5189.patch
          129 kB
          Shai Erera
        14. LUCENE-5189.patch
          131 kB
          Shai Erera
        15. LUCENE-5189.patch
          149 kB
          Shai Erera
        16. LUCENE-5189.patch
          164 kB
          Shai Erera
        17. LUCENE-5189.patch
          164 kB
          Shai Erera
        18. LUCENE-5189.patch
          167 kB
          Shai Erera
        19. LUCENE-5189_process_events.patch
          2 kB
          Simon Willnauer
        20. LUCENE-5189_process_events.patch
          4 kB
          Simon Willnauer

        Activity

          People

            shaie Shai Erera
            shaie Shai Erera
            Votes:
            8 Vote for this issue
            Watchers:
            21 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: