Uploaded image for project: 'Apache IoTDB'
  1. Apache IoTDB
  2. IOTDB-3755

[ Compaction ] ERROR o.a.i.d.e.c.l.LevelCompactionTsFileManagement:567 - Error occurred in Compaction Merge thread

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • 0.12.6
    • None
    • Core/Compaction
    • None
    • 2022-7-Cluster

    Description

      rel/0.12 ffacd3f25965bdc2e1aca176bceae3d7ebab01b6

      长测配置(见附件)+ TTL ,合并报错:
      2022-07-06 05:47:26,576 [pool-10-IoTDB-Compaction-4] ERROR o.a.i.d.e.c.l.LevelCompactionTsFileManagement:567 - Error occurred in Compaction Merge thread
      java.io.IOException: null
      at org.apache.iotdb.db.engine.compaction.utils.CompactionUtils.merge(CompactionUtils.java:306)
      at org.apache.iotdb.db.engine.compaction.level.LevelCompactionTsFileManagement.merge(LevelCompactionTsFileManagement.java:509)
      at org.apache.iotdb.db.engine.compaction.level.LevelCompactionTsFileManagement.merge(LevelCompactionTsFileManagement.java:397)
      at org.apache.iotdb.db.engine.compaction.TsFileManagement$CompactionMergeTask.call(TsFileManagement.java:311)
      at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor.syncCompactOnePartition(StorageGroupProcessor.java:2041)
      at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor.access$100(StorageGroupProcessor.java:136)
      at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor$CompactionAllPartitionTask.call(StorageGroupProcessor.java:543)
      at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor.merge(StorageGroupProcessor.java:2177)
      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      at java.lang.Thread.run(Thread.java:748)

      复现流程:
      1. 私有云 172.20.70.28 8C32G
      MAX_HEAP_SIZE="16G"
      wal_buffer_size=1048576

      2. benchmark 172.20.70.30 ( /data/benchmark/bm_0620_7ec96c1_v12 )
      GROUP_NUMBER=50
      DEVICE_NUMBER=2000
      SENSOR_NUMBER=1000
      CLIENT_NUMBER=100
      OPERATION_PROPORTION=70:1:1:1:1:0:1:1:1:1:1

      设置TTL的脚本见附件。

      Attachments

        1. auto_set_ttl.sh
          0.8 kB
          刘珍
        2. config.properties
          14 kB
          刘珍
        3. log-all-20220705.1.log.gz
          3.87 MB
          刘珍

        Activity

          People

            ThuLiuxuxin Liuxuxin
            刘珍 刘珍
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: