Uploaded image for project: 'Apache IoTDB'
  1. Apache IoTDB
  2. IOTDB-4645

Optimization of estimating memory usage of cross space compaction task

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 0.13.3
    • None
    • 2022-10-Cluster

    Description

      We find different file selection for cross space compaction between IoTDB-0.13.3 and IoTDB-master. 0.13.3 selects 110MB files in a single compaction task, but master selects 477MB.

      0.13.3:

      master:

       

      Then we find that the estimation for memory usage of cross space compaction is much larger than master, because 0.13.3 uses estimation algorithm in 0.12 version which is out of date. So this issue will use the latest memory estimation algorithm (in master) in 0.13.3. 

      Attachments

        1. image-2022-10-14-14-02-24-765.png
          79 kB
          Quan Siyi
        2. image-2022-10-14-14-03-42-752.png
          779 kB
          Quan Siyi

        Issue Links

          Activity

            People

              Mrquan Quan Siyi
              Mrquan Quan Siyi
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: