[IOTDB-4034] [ IoTDB & NewIoTDB ] Exception in thread pool org.apache.iotdb.threadpool:type=Sub-Compaction NPE

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.14.0-SNAPSHOT
• Fix Version/s: 0.14.0
• Component/s: Core/Engine, mpp-cluster
• Labels: pull-request-available
• Sprint: 2022-8-Cluster
• Assignee: Liuxuxin
• Reporter: 刘珍
• Created: 03/Aug/22 06:41
• Updated: 25/Aug/22 09:49
• Resolved: 12/Aug/22 01:12

Description

master 0801 5f11830

单机/新单机，停服务，合并线程报错：
2022-08-02 18:03:24,726 [pool-9-IoTDB-Sub-Compaction-3] ERROR o.a.i.c.c.t.WrappedThreadPoolExecutor:104 - Exception in thread pool org.apache.iotdb.threadpool:type=Sub-Compaction
java.lang.NullPointerException: null
at org.apache.iotdb.db.engine.compaction.writer.CrossSpaceCompactionWriter.write(CrossSpaceCompactionWriter.java:107)
at org.apache.iotdb.db.engine.compaction.performer.impl.ReadPointCompactionPerformer.writeWithReader(ReadPointCompactionPerformer.java:384)
at org.apache.iotdb.db.engine.compaction.cross.rewrite.task.ReadPointPerformerSubTask.call(ReadPointPerformerSubTask.java:89)
at org.apache.iotdb.db.engine.compaction.cross.rewrite.task.ReadPointPerformerSubTask.call(ReadPointPerformerSubTask.java:44)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)

2022-08-02 18:03:24,749 [pool-8-IoTDB-Compaction-6] ERROR o.a.i.d.e.c.i.InnerSpaceCompactionTask:226 - root.test.g_9-0 [Compaction] Meet errors in inner space compaction.
java.nio.BufferUnderflowException: null
at java.nio.Buffer.nextGetIndex(Buffer.java:524)
at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:138)
at org.apache.iotdb.tsfile.file.header.ChunkHeader.deserializeFrom(ChunkHeader.java:180)
at org.apache.iotdb.tsfile.read.TsFileSequenceReader.readChunkHeader(TsFileSequenceReader.java:1060)
at org.apache.iotdb.tsfile.read.TsFileSequenceReader.readMemChunk(TsFileSequenceReader.java:1092)
at org.apache.iotdb.db.engine.compaction.inner.utils.SingleSeriesCompactionExecutor.execute(SingleSeriesCompactionExecutor.java:123)
at org.apache.iotdb.db.engine.compaction.performer.impl.ReadChunkCompactionPerformer.compactNotAlignedSeries(ReadChunkCompactionPerformer.java:149)
at org.apache.iotdb.db.engine.compaction.performer.impl.ReadChunkCompactionPerformer.perform(ReadChunkCompactionPerformer.java:77)
at org.apache.iotdb.db.engine.compaction.inner.InnerSpaceCompactionTask.doCompaction(InnerSpaceCompactionTask.java:144)
at org.apache.iotdb.db.engine.compaction.task.AbstractCompactionTask.start(AbstractCompactionTask.java:76)
at org.apache.iotdb.db.engine.compaction.CompactionWorker.run(CompactionWorker.java:66)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)

2022-08-02 18:03:24,765 [pool-9-IoTDB-Sub-Compaction-26] ERROR o.a.i.c.c.t.WrappedThreadPoolExecutor:104 - Exception in thread pool org.apache.iotdb.threadpool:type=Sub-Compaction
java.io.IOException: Stream Closed
at java.io.FileOutputStream.writeBytes(Native Method)
at java.io.FileOutputStream.write(FileOutputStream.java:326)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.write(BufferedOutputStream.java:121)
at org.apache.iotdb.tsfile.write.writer.LocalTsFileOutput.write(LocalTsFileOutput.java:63)
at org.apache.iotdb.tsfile.utils.PublicBAOS.writeTo(PublicBAOS.java:64)
at org.apache.iotdb.tsfile.write.writer.TsFileIOWriter.writeBytesToStream(TsFileIOWriter.java:137)
at org.apache.iotdb.tsfile.write.chunk.ChunkWriterImpl.writeAllPagesOfChunkToTsFile(ChunkWriterImpl.java:434)
at org.apache.iotdb.tsfile.write.chunk.ChunkWriterImpl.writeToFileWriter(ChunkWriterImpl.java:312)
at org.apache.iotdb.db.engine.compaction.writer.AbstractCompactionWriter.flushChunkToFileWriter(AbstractCompactionWriter.java:150)
at org.apache.iotdb.db.engine.compaction.writer.CrossSpaceCompactionWriter.checkTimeAndMayFlushChunkToCurrentFile(CrossSpaceCompactionWriter.java:158)
at org.apache.iotdb.db.engine.compaction.writer.CrossSpaceCompactionWriter.write(CrossSpaceCompactionWriter.java:103)
at org.apache.iotdb.db.engine.compaction.performer.impl.ReadPointCompactionPerformer.writeWithReader(ReadPointCompactionPerformer.java:384)
at org.apache.iotdb.db.engine.compaction.cross.rewrite.task.ReadPointPerformerSubTask.call(ReadPointPerformerSubTask.java:89)
at org.apache.iotdb.db.engine.compaction.cross.rewrite.task.ReadPointPerformerSubTask.call(ReadPointPerformerSubTask.java:44)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)

复现流程
用周测场景（写入乱序/顺序，读写混合 顺序/乱序）都可复现

完整的日志见附件

Issue Links

• links to: GitHub Pull Request #6935