Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-9387

Allow topic expression to store queries and macros

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      The topic expression already stores the checkpoints for a topic. This ticket will allow the topic to store the topic query and a macro to be performed with the topic.

      Macros will be run using Solr's built-in parameter substitution:

      Sample syntax:

      topic(collection1, q="*:*", macro="update(classify(model, ${topic}))")
      

      The query and macro will be stored with the topic. Topics can be retrieved and executed as part of the larger macro using Solr's built in parameter substitution.

      http://localhost:8983/solr/collection1/stream?expr=update(classify(model, ${topic}))&topic=topic(collection1,....)
      

      Because topics are stored in a SolrCloud collection this will allow for storing millions of topics and macros.

      The parallel function can then be used to run the topics/macros in parallel across a large number of workers.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jbernste Joel Bernstein
                Reporter:
                jbernste Joel Bernstein
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: