Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-12210

Perfomance degradation at High Load

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Duplicate
    • Affects Version/s: 7.2
    • Fix Version/s: None
    • Component/s: Hadoop Integration
    • Labels:
      None

      Description

      When hdfsDataFactory is used and the incoming data stream is large, the rate of indexation is degraded. This is not a problem when using a local file system. I think the problem is in cleaning hdfsBlockCache. Because the degradation of the indexing rate occurs precisely when this cache reaches its maximum value. The basis for hdfsBlockCache is caffeine cache, but it is configured to clean only when the maximum size is reached. At the same time, nothing prevents using timeEviction, I suggest testing the indexing speed using this type of cache cleaning.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                rnazarenko ROMAN NAZARENKO
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: