Uploaded image for project: 'Ignite'
  1. Ignite
  2. IGNITE-17446

Determine priority between checkpoint and merge delta files

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • 3.0
    • None

    Description

      When creating delta files in parallel and merging them with the main partition file, the write amplification may increase, and they may begin to interfere with each other.

      In RocksDb, these processes run in parallel, but checkpoint threads have higher thread priority.

      I think it can be done by analogy, but without thread priorities, but with slowing down the threads of the delta file merge.

      Attachments

        Issue Links

          is a child of

          Improvement - An improvement or enhancement to an existing feature or task. IGNITE-16657 [Native Persistence 3.0] Implement partitions chunks merger

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link RocksDb tuning flushes and compactions

          Web Link RocksDb write stalls

          Activity

            People

              Unassigned Unassigned
              ktkalenko@gridgain.com Kirill Tkalenko
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: