[IOTDB-4152] [ InsertTablet cross partition ] overlapped data should be consumed first

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.14.0-SNAPSHOT
• Fix Version/s: 0.14.0
• Component/s: Core/Compaction, mpp-cluster
• Labels: pull-request-available
• Sprint: 2022-8-Cluster
• Assignee: Haonan Hou
• Reporter: 刘珍
• Created: 16/Aug/22 11:50
• Updated: 25/Aug/22 09:21
• Resolved: 22/Aug/22 13:32

Description

NewIoTDB
m_0815_db0b6fd
周测场景，普通序列写入乱序数据，select count(s_4) from root.** align by device 报错
2022-08-16 19:07:30,385 [20220816_110730_48763_0.1.0-47] ERROR o.a.i.d.m.e.driver.Driver:193 - Failed to execute fragment instance 20220816_110730_48763_0.1.0
java.lang.RuntimeException: Error while scanning the file
at org.apache.iotdb.db.mpp.execution.operator.source.AbstractSeriesAggregationScanOperator.calculateNextAggregationResult(AbstractSeriesAggregationScanOperator.java:179)
at org.apache.iotdb.db.mpp.execution.operator.source.AbstractSeriesAggregationScanOperator.next(AbstractSeriesAggregationScanOperator.java:137)
at org.apache.iotdb.db.mpp.execution.operator.process.DeviceViewOperator.next(DeviceViewOperator.java:107)
at org.apache.iotdb.db.mpp.execution.operator.process.DeviceMergeOperator.next(DeviceMergeOperator.java:118)
at org.apache.iotdb.db.mpp.execution.driver.Driver.processInternal(Driver.java:186)
at org.apache.iotdb.db.mpp.execution.driver.Driver.lambda$processFor$1(Driver.java:125)
at org.apache.iotdb.db.mpp.execution.driver.Driver.tryWithLock(Driver.java:271)
at org.apache.iotdb.db.mpp.execution.driver.Driver.processFor(Driver.java:118)
at org.apache.iotdb.db.mpp.execution.schedule.DriverTaskThread.execute(DriverTaskThread.java:62)
at org.apache.iotdb.db.mpp.execution.schedule.AbstractDriverThread.run(AbstractDriverThread.java:64)
Caused by: java.io.IOException: overlapped data should be consumed first
at org.apache.iotdb.db.mpp.execution.operator.source.SeriesScanUtil.isPageOverlapped(SeriesScanUtil.java:580)
at org.apache.iotdb.db.mpp.execution.operator.source.AbstractSeriesAggregationScanOperator.canUseCurrentPageStatistics(AbstractSeriesAggregationScanOperator.java:346)
at org.apache.iotdb.db.mpp.execution.operator.source.AbstractSeriesAggregationScanOperator.readAndCalcFromPage(AbstractSeriesAggregationScanOperator.java:285)
at org.apache.iotdb.db.mpp.execution.operator.source.AbstractSeriesAggregationScanOperator.readAndCalcFromChunk(AbstractSeriesAggregationScanOperator.java:276)
at org.apache.iotdb.db.mpp.execution.operator.source.AbstractSeriesAggregationScanOperator.readAndCalcFromFile(AbstractSeriesAggregationScanOperator.java:237)
at org.apache.iotdb.db.mpp.execution.operator.source.AbstractSeriesAggregationScanOperator.calculateNextAggregationResult(AbstractSeriesAggregationScanOperator.java:172)
... 9 common frames omitted

Issue Links

• Is contained by: IOTDB-4177 [Atmos][WeeklyTest] INSERT Failed when using SESSION_BY_RECORDS
• links to: GitHub Pull Request #7066