Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-8487

Add CommitStream to Streaming API and Streaming Expressions

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Minor
    • Resolution: Implemented
    • Affects Version/s: 6.3
    • Fix Version/s: 6.3
    • Component/s: None
    • Labels:
      None

      Description

      (Paraphrased from Joel's idea/suggestions in the comments of SOLR-7535).

      With SOLR-7535, users can now index documents/tuples using an UpdateStream. However, there's no way currently using the Streaming API to force a commit on the collection that received these updates.

      The purpose of this ticket is to add a CommitStream, which can be used to trigger commit(s) on a given collection.

      The proposed usage/behavior would look a little bit like:
      commit(collection, parallel(update(search()))

      Note that...
      1.) CommitStream has a positional collection parameter, to indicate which collection to commit on. (Alternatively, it could recurse through children() nodes until it finds the UpdateStream, and then retrieve the collection from the UpdateStream).
      2.) CommitStream forwards all tuples received by an underlying, wrapped stream.
      3.) CommitStream commits when the underlying stream emits its EOF tuple. (Alternatively, it could commit every X tuples, based on a parameter).

        Attachments

        1. SOLR-8487.patch
          33 kB
          Dennis Gove
        2. SOLR-8487.patch
          13 kB
          Dennis Gove

          Issue Links

            Activity

              People

              • Assignee:
                dpgove Dennis Gove
                Reporter:
                gerlowskija Jason Gerlowski
              • Votes:
                1 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: