[SOLR-9387] Allow topic expression to store queries and macros

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Assignee: Joel Bernstein
• Reporter: Joel Bernstein
• Created: 05/Aug/16 03:37
• Updated: 08/Jun/19 15:37
• Resolved: 16/Oct/16 00:57

Description

The topic expression already stores the checkpoints for a topic. This ticket will allow the topic to store the topic query and a macro to be performed with the topic.

Macros will be run using Solr's built-in parameter substitution:

Sample syntax:

topic(collection1, q="*:*", macro="update(classify(model, ${topic}))")

The query and macro will be stored with the topic. Topics can be retrieved and executed as part of the larger macro using Solr's built in parameter substitution.

http://localhost:8983/solr/collection1/stream?expr=update(classify(model, ${topic}))&topic=topic(collection1,....)

Because topics are stored in a SolrCloud collection this will allow for storing millions of topics and macros.

The parallel function can then be used to run the topics/macros in parallel across a large number of workers.

Issue Links

• is depended upon by: SOLR-9559 Add ExecutorStream to execute stored Streaming Expressions
• is superceded by: SOLR-9559 Add ExecutorStream to execute stored Streaming Expressions