Uploaded image for project: 'Apache IoTDB'
  1. Apache IoTDB
  2. IOTDB-5910

Execute "drop database" when starting compaction in loop, causing memory leak in the "IoTDB-Compaction_Schedule" thread.

    XMLWordPrintableJSON

Details

    Description

      问题描述:
      合并开始执行时,drop database,循环这一过程,发现合并线程有泄漏:


      脚本内容如下:

      测试环境:
      版本:iotdb master 0523_f8516ed
      机器:192.168.130.2 1C1D
      配置参数
      /ssd/iotdb/i_m_0523_f8516ed/conf/confignode-env.sh
      MAX_HEAP_SIZE="2G"
      MAX_DIRECT_MEMORY_SIZE="1G"

      /ssd/iotdb/i_m_0523_f8516ed/conf/datanode-env.sh
      MAX_HEAP_SIZE="16G"
      MAX_DIRECT_MEMORY_SIZE="4G"

      /ssd/iotdb/i_m_0523_f8516ed/conf/iotdb-common.properties
      default_storage_group_level=2
      query_timeout_threshold=36000000
      min_cross_compaction_unseq_file_level=0
      compaction_write_throughput_mb_per_sec=64

      /ssd/iotdb/i_m_0523_f8516ed/conf/iotdb-confignode.properties
      cn_internal_address=192.168.130.2
      cn_target_config_node_list=192.168.130.2:10710
      cn_metric_reporter_list=PROMETHEUS
      cn_metric_level=IMPORTANT
      cn_metric_prometheus_reporter_port=9081

      /ssd/iotdb/i_m_0523_f8516ed/conf/iotdb-datanode.properties
      dn_rpc_address=192.168.130.2
      dn_internal_address=192.168.130.2
      dn_target_config_node_list=192.168.130.2:10710
      dn_metric_reporter_list=PROMETHEUS
      dn_metric_level=IMPORTANT

      测试脚本在/ssd/iotdb/i_m_0523_f8516ed ,包含3个脚本,运行run_2_client.sh

      jstack见附件。

      Attachments

        1. image-2023-05-23-14-19-38-388.png
          200 kB
          刘珍
        2. image-2023-05-23-14-19-48-245.png
          5 kB
          刘珍
        3. image-2023-05-23-14-20-02-106.png
          40 kB
          刘珍
        4. load_insert_drop_db_1.sh
          1 kB
          刘珍
        5. load_insert_drop_db_2.sh
          0.9 kB
          刘珍
        6. run_2_client.sh
          0.1 kB
          刘珍
        7. ip2_dn_stack_thread.out
          634 kB
          刘珍
        8. screenshot-1.png
          7 kB
          刘珍
        9. screenshot-2.png
          7 kB
          刘珍
        10. screenshot-3.png
          130 kB
          刘珍

        Activity

          People

            caozhijia1 Zhijia Cao
            刘珍 刘珍
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: