[IOTDB-1194] Load multiple tsfile in a directory report "cross time partition" error

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.12.0, 0.11.3
• Labels: pull-request-available
• Assignee: Yuyuan KANG
• Reporter: Yuyuan KANG
• Created: 10/Mar/21 04:37
• Updated: 31/Mar/21 09:06
• Resolved: 31/Mar/21 09:06

Description

I generated several tsfiles. Generally, one device, one measurement. The total time range is from 0 to 100,000s. I set the partition interval to 3600s. So the tsfiles covers time from 0s to 3599s, 3600s to  7199s, ...

 

I tried to use "load <dir>" command to load all tsfiles to IoTDB, but the server reported the following error:

12:28:16.208 [pool-7-IoTDB-RPC-Client-thread-1] WARN org.apache.iotdb.db.service.TSServiceImpl - meet error while processing non-query. 12:28:16.208 [pool-7-IoTDB-RPC-Client-thread-1] WARN org.apache.iotdb.db.service.TSServiceImpl - meet error while processing non-query. org.apache.iotdb.db.exception.query.QueryProcessException: Cannot load file /home/yuyuankang/Downloads/data3/1615345483026-1-0.tsfile because The data of file /home/yuyuankang/Downloads/data3/1615345483026-1-0.tsfile cross partitions at org.apache.iotdb.db.qp.executor.PlanExecutor.loadFile(PlanExecutor.java:754) at org.apache.iotdb.db.qp.executor.PlanExecutor.operateLoadFiles(PlanExecutor.java:695) at org.apache.iotdb.db.qp.executor.PlanExecutor.processNonQuery(PlanExecutor.java:241) at org.apache.iotdb.db.service.TSServiceImpl.executeNonQuery(TSServiceImpl.java:1161) at org.apache.iotdb.db.service.TSServiceImpl.executeNonQueryPlan(TSServiceImpl.java:1795) at org.apache.iotdb.db.service.TSServiceImpl.executeUpdateStatement(TSServiceImpl.java:1148) at org.apache.iotdb.db.service.TSServiceImpl.executeStatement(TSServiceImpl.java:527) at org.apache.iotdb.service.rpc.thrift.TSIService$Processor$executeStatement.getResult(TSIService.java:2253) at org.apache.iotdb.service.rpc.thrift.TSIService$Processor$executeStatement.getResult(TSIService.java:2233) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:38) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:38) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:313) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

 

The attachment is how I generate tsfiles.

 

ps: The time range interval setting in the server and WriteTsFile.java are consistent, 3600 seconds. 

Issue Links

• links to: GitHub Pull Request #2800
• links to: GitHub Pull Request #2895