Uploaded image for project: 'Jackrabbit Oak'
  1. Jackrabbit Oak
  2. OAK-5661

Make NRT indexing resilient against unbounded growth

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: lucene
    • Labels:
      None

      Description

      NRT Indexes for volatile indexes [1] can grow large if async index update faces issues. Like if it gets stuck for days or due to some bug index do not get updates like in OAK-5649 then the sizes can grow very large.

      For such cases we should add some checks in logic where system can ensure that some cleanup is performed or writes to indexes are stopped. Also such a situation should be flagged

      [1] Indexes which see lots of addition and deletions. So effective indexing size is smaller however if deletions are not applied (as is the case with NRT) such indexes can grow large

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                chetanm Chetan Mehrotra
                Reporter:
                chetanm Chetan Mehrotra
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: