Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-3180

kudu don't always prefer to flush MRS/DMS that anchor more memory

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.13.0
    • None
    • None

    Description

      Current time-based flush policy always give a flush op a high score if we haven't flushed for the tablet in a long time, that may lead to starvation of ops that could free more memory.

      We set  -flush_threshold_mb=32,  -flush_threshold_secs=1800 in a cluster, and find that some small MRS/DMS flushes has a higher perf score than big MRS/DMS flushes and compactions, which seems not so reasonable.

      Attachments

        1. image-2020-08-04-20-26-53-749.png
          86 kB
          YifanZhang
        2. image-2020-08-04-20-28-00-665.png
          87 kB
          YifanZhang

        Activity

          People

            zhangyifan27 YifanZhang
            zhangyifan27 YifanZhang
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: