Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-6816 Review SolrCloud Indexing Performance.
  3. SOLR-6838

Bulk loading with the default of updateDocument blocks all indexing for long periods of time.

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Issue Links

        Activity

        Hide
        ralph.tice Ralph Tice added a comment -

        Can you share your benchmark script for reproducing this case? As I posted on LUCENE-6161 I saw a big improvement after rolling out 4.10.4 to my SolrClouds.

        Show
        ralph.tice Ralph Tice added a comment - Can you share your benchmark script for reproducing this case? As I posted on LUCENE-6161 I saw a big improvement after rolling out 4.10.4 to my SolrClouds.
        Hide
        markrmiller@gmail.com Mark Miller added a comment -

        Could be - I've related them.

        Show
        markrmiller@gmail.com Mark Miller added a comment - Could be - I've related them.
        Hide
        shalinmangar Shalin Shekhar Mangar added a comment -

        Perhaps this slowness is related to LUCENE-6161?

        Show
        shalinmangar Shalin Shekhar Mangar added a comment - Perhaps this slowness is related to LUCENE-6161 ?
        Hide
        markrmiller@gmail.com Mark Miller added a comment -

        In a quick run, I see 3 large merges done by a concurrent indexing merge thread. Each time, this thread spends 10-20 seconds in IW#_mergeInit dealing with updates in BufferedUpdateStream#applyDeletesAndUpdates. This holds the IW lock and all indexing threads are blocked in updatePendingMerges or publishFlushedSegments.

        Show
        markrmiller@gmail.com Mark Miller added a comment - In a quick run, I see 3 large merges done by a concurrent indexing merge thread. Each time, this thread spends 10-20 seconds in IW#_mergeInit dealing with updates in BufferedUpdateStream#applyDeletesAndUpdates. This holds the IW lock and all indexing threads are blocked in updatePendingMerges or publishFlushedSegments.

          People

          • Assignee:
            Unassigned
            Reporter:
            markrmiller@gmail.com Mark Miller
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:

              Development