Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-2184

Avoid large allocations in MemRowSet arena

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.6.0
    • Fix Version/s: 1.6.0
    • Component/s: perf
    • Labels:
      None
    • Target Version/s:

      Description

      tcmalloc caches metadata for spans of free space only up to a certain size (1MB). For larger allocations, an O search is used, which can be quite slow according to https://github.com/gperftools/gperftools/issues/535 . Based on some recent analysis of latency outliers in a long-running cluster, I think we may be hitting this issue on the MRS Arena. We should set the max component size to 1MB to avoid it.

        Attachments

          Activity

            People

            • Assignee:
              tlipcon Todd Lipcon
              Reporter:
              tlipcon Todd Lipcon
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: