Uploaded image for project: 'Jackrabbit Oak'
  1. Jackrabbit Oak
  2. OAK-4808

Index external changes as part of NRT indexing

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.5.18, 1.6.0
    • lucene
    • None

    Description

      With OAK-4412 NRT indexing support in hybrid index case indexes local changes. It would be useful to have an option to index external changes. In ideal world

      1. Async indexing is configured at 5 sec internal
      2. DocumentNodeStore background read is configured at 1 sec interval

      So we can index 5 external changes before changes via async indexing are picked up. In real world delays can happen in both parts so having such changes indexed via NRT mode would be useful to reduce the latency in reflecting external changes as part of query result.

      This part would though introduce a cost as it would do complete diff for each external change. So while implementing care must be taken to do it on best effort basis i.e. if queue becomes large then skip certain processing etc

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. OAK-9751 Exception while reading external changes from journal

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. OAK-5177 Non default MissingIndexProviderStrategy is not being passed to child editor

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. OAK-6513 Journal based Async Indexer

          • Major - Major loss of function.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. OAK-4412 Lucene hybrid index

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. OAK-3573 BackgroundObserver should decide about collapsing external events based on backend

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. OAK-5101 Enable prefiltering for external changes

          • Major - Major loss of function.
          • Closed
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. OAK-5434 Skip processing of queued changes if async index update is detected in ExternalIndexObserver

          • Major - Major loss of function.
          • Open

          Activity

            People

              chetanm Chetan Mehrotra
              chetanm Chetan Mehrotra
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: