[SOLR-8591] Add BatchStream to the Streaming API

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Fix Version/s: 6.2, 7.0
• Assignee: Joel Bernstein
• Reporter: Joel Bernstein
• Created: 25/Jan/16 00:30
• Updated: 26/Aug/16 14:01
• Resolved: 24/Aug/16 22:01

Description

Now that we have synchronous streaming and continuous streaming (DaemonStream), it makes sense to add batch streaming.

Code will be added to the /stream handler so that when it sees the BatchStream it will send the stream to an executor to be run.

Sample syntax:

batch(parallel(update(rollup(search()))))

The pseudo code above runs a parallel rollup in batch mode and sends the output to a SolrCloud collection.

Issue Links

• is related to: SOLR-8125 Umbrella ticket for Streaming and SQL issues
• is superceded by: SOLR-9240 Support parallel ETL with the topic expression