Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-14130

Add postlogs command line tool for indexing Solr logs

    XMLWordPrintableJSON

    Details

    • Type: Task
    • Status: Closed
    • Priority: Major
    • Resolution: Resolved
    • Affects Version/s: None
    • Fix Version/s: 8.5
    • Component/s: None
    • Labels:
      None

      Description

      This ticket adds a simple command line tool for posting Solr logs to a solr index. The tool works with the out of the box Solr log format. Still a work in progress but currently indexes:

      • queries
      • updates
      • commits
      • new searchers
      • errors - including stack traces

      Attached are some sample visualizations using Solr Streaming Expressions and Math Expressions after the data has been loaded. The visualizations show: time series, scatter plots, histograms and quantile plots, but really this is just scratching the surface of the visualizations that can be done with the Solr logs.

      Full documentation for Solr log analytics and visualization:

      https://github.com/apache/lucene-solr/blob/visual-guide/solr/solr-ref-guide/src/logs.adoc#log-analytics

       

        Attachments

        1. Screen Shot 2019-12-19 at 2.04.41 PM.png
          292 kB
          Joel Bernstein
        2. Screen Shot 2019-12-19 at 2.16.01 PM.png
          197 kB
          Joel Bernstein
        3. Screen Shot 2019-12-19 at 2.35.41 PM.png
          311 kB
          Joel Bernstein
        4. Screen Shot 2019-12-21 at 8.46.51 AM.png
          354 kB
          Joel Bernstein
        5. SOLR-14130.patch
          32 kB
          Joel Bernstein
        6. SOLR-14130.patch
          31 kB
          Joel Bernstein
        7. SOLR-14130.patch
          31 kB
          Joel Bernstein
        8. SOLR-14130.patch
          31 kB
          Joel Bernstein
        9. SOLR-14130.patch
          29 kB
          Joel Bernstein
        10. SOLR-14130.patch
          21 kB
          Joel Bernstein
        11. SOLR-14130.patch
          19 kB
          Joel Bernstein

          Activity

            People

            • Assignee:
              jbernste Joel Bernstein
              Reporter:
              jbernste Joel Bernstein
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: