Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-3180

kudu don't always prefer to flush MRS/DMS that anchor more memory

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.13.0
    • Component/s: None
    • Labels:
      None

      Description

      Current time-based flush policy always give a flush op a high score if we haven't flushed for the tablet in a long time, that may lead to starvation of ops that could free more memory.

      We set  -flush_threshold_mb=32,  -flush_threshold_secs=1800 in a cluster, and find that some small MRS/DMS flushes has a higher perf score than big MRS/DMS flushes and compactions, which seems not so reasonable.

        Attachments

        1. image-2020-08-04-20-28-00-665.png
          87 kB
          YifanZhang
        2. image-2020-08-04-20-26-53-749.png
          86 kB
          YifanZhang

          Activity

            People

            • Assignee:
              zhangyifan27 YifanZhang
              Reporter:
              zhangyifan27 YifanZhang
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: