Uploaded image for project: 'Apache IoTDB'
  1. Apache IoTDB
  2. IOTDB-5589

[ compaction ] The "IoTDB-Compaction_Schedule" thread count needs to be controlled

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • mpp-cluster
    • 2023-2-Storage, 2023-3-Storage

    Description

      master_a3869ec_opt
      Each time partition opens a "IoTDB-Compaction_Schedule" thread,it's not a good design.

      示例:
      在192.168.10.68 (72CPU) , start-standalone.sh启动单节点集群,运行附件中的脚本,生成72个dataregion,每个dataregion 下目前只有1个时间分区,所以当前"IoTDB-Compaction_Schedule"线程数有72个,随着时间分区的增加,这个线程也会增大,需要控制,它的主要作用是用来选择合并文件,是比较快的操作,没必要开这么多。

      纠正:是每个dataregion 有1个 "IoTDB-Compaction_Schedule" thread,是否解决,可以讨论。如果dataregion多,是否有必要开这么多选文件的线程。

      Attachments

        1. comp1.conf
          14 kB
          刘珍
        2. comp2.conf
          14 kB
          刘珍
        3. dn_stack.out
          825 kB
          刘珍

        Activity

          People

            ChouBenson 周沛辰
            刘珍 刘珍
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: