Solr
  1. Solr
  2. SOLR-1806

Extend statistics provided by DIH components

    Details

      Description

      It would be useful to get more information from the DIH during an indexing run. The initial requirements for this patch are:

      1. Add a cumulative "documents per second" calculation for the currently-running index process
      2. Add the ability for each EntityProcessor to report its own custom statistics in a manner appropriate to the nature of its work

      For example, the SQLEntityProcessor might show the total number of queries performed, the average time to execute each of those queries, the total amount of time it spent executing its queries, etc.

      The CachedSQLEntityProcessor might show cache hit counts, cache miss counts, the current size of the cache, etc.

      1. solr-1806.patch
        7 kB
        Michael Henson

        Activity

        Hide
        Uwe Schindler added a comment -

        Move issue to Solr 4.9.

        Show
        Uwe Schindler added a comment - Move issue to Solr 4.9.
        Hide
        Steve Rowe added a comment -

        Bulk move 4.4 issues to 4.5 and 5.0

        Show
        Steve Rowe added a comment - Bulk move 4.4 issues to 4.5 and 5.0
        Hide
        Hoss Man added a comment -

        Bulk of fixVersion=3.6 -> fixVersion=4.0 for issues that have no assignee and have not been updated recently.

        email notification suppressed to prevent mass-spam
        psuedo-unique token identifying these issues: hoss20120321nofix36

        Show
        Hoss Man added a comment - Bulk of fixVersion=3.6 -> fixVersion=4.0 for issues that have no assignee and have not been updated recently. email notification suppressed to prevent mass-spam psuedo-unique token identifying these issues: hoss20120321nofix36
        Hide
        Robert Muir added a comment -

        3.4 -> 3.5

        Show
        Robert Muir added a comment - 3.4 -> 3.5
        Hide
        Robert Muir added a comment -

        Bulk move 3.2 -> 3.3

        Show
        Robert Muir added a comment - Bulk move 3.2 -> 3.3
        Hide
        Hoss Man added a comment -

        Bulk updating 240 Solr issues to set the Fix Version to "next" per the process outlined in this email...

        http://mail-archives.apache.org/mod_mbox/lucene-dev/201005.mbox/%3Calpine.DEB.1.10.1005251052040.24672@radix.cryptio.net%3E

        Selection criteria was "Unresolved" with a Fix Version of 1.5, 1.6, 3.1, or 4.0. email notifications were suppressed.

        A unique token for finding these 240 issues in the future: hossversioncleanup20100527

        Show
        Hoss Man added a comment - Bulk updating 240 Solr issues to set the Fix Version to "next" per the process outlined in this email... http://mail-archives.apache.org/mod_mbox/lucene-dev/201005.mbox/%3Calpine.DEB.1.10.1005251052040.24672@radix.cryptio.net%3E Selection criteria was "Unresolved" with a Fix Version of 1.5, 1.6, 3.1, or 4.0. email notifications were suppressed. A unique token for finding these 240 issues in the future: hossversioncleanup20100527
        Hide
        Michael Henson added a comment -

        This is a work-in-progress patch, showing my current approach to adding statistics collection and the interface for retrieving the per-entity statistics.

        The code that retrieves the entities' reports and presents them to a user hasn't been written yet.

        Show
        Michael Henson added a comment - This is a work-in-progress patch, showing my current approach to adding statistics collection and the interface for retrieving the per-entity statistics. The code that retrieves the entities' reports and presents them to a user hasn't been written yet.

          People

          • Assignee:
            Unassigned
            Reporter:
            Michael Henson
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:

              Development