Uploaded image for project: 'Jackrabbit Oak'
  1. Jackrabbit Oak
  2. OAK-4808

Index external changes as part of NRT indexing

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.5.18, 1.6.0
    • lucene
    • None

    Description

      With OAK-4412 NRT indexing support in hybrid index case indexes local changes. It would be useful to have an option to index external changes. In ideal world

      1. Async indexing is configured at 5 sec internal
      2. DocumentNodeStore background read is configured at 1 sec interval

      So we can index 5 external changes before changes via async indexing are picked up. In real world delays can happen in both parts so having such changes indexed via NRT mode would be useful to reduce the latency in reflecting external changes as part of query result.

      This part would though introduce a cost as it would do complete diff for each external change. So while implementing care must be taken to do it on best effort basis i.e. if queue becomes large then skip certain processing etc

      Attachments

        Issue Links

        is related to

        Bug - A problem which impairs or prevents the functions of the product. OAK-9751 Exception while reading external changes from journal

        • Major - Major loss of function.
        • Closed

        Bug - A problem which impairs or prevents the functions of the product. OAK-5177 Non default MissingIndexProviderStrategy is not being passed to child editor

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Closed

        New Feature - A new feature of the product, which has yet to be developed. OAK-6513 Journal based Async Indexer

        • Major - Major loss of function.
        • Open

        New Feature - A new feature of the product, which has yet to be developed. OAK-4412 Lucene hybrid index

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. OAK-3573 BackgroundObserver should decide about collapsing external events based on backend

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Open

        Improvement - An improvement or enhancement to an existing feature or task. OAK-5101 Enable prefiltering for external changes

        • Major - Major loss of function.
        • Closed
        relates to

        Improvement - An improvement or enhancement to an existing feature or task. OAK-5434 Skip processing of queued changes if async index update is detected in ExternalIndexObserver

        • Major - Major loss of function.
        • Open

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            chetanm Chetan Mehrotra
            chetanm Chetan Mehrotra
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment