[IOTDB-1194] Load multiple tsfile in a directory report "cross time partition" error - ASF JIRA

Attach files

Attach Screenshot

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.12.0, 0.11.3
Component/s: None
Labels:
- pull-request-available

Description

I generated several tsfiles. Generally, one device, one measurement. The total time range is from 0 to 100,000s. I set the partition interval to 3600s. So the tsfiles covers time from 0s to 3599s, 3600s to 7199s, ...

I tried to use "load <dir>" command to load all tsfiles to IoTDB, but the server reported the following error:

12:28:16.208 [pool-7-IoTDB-RPC-Client-thread-1] WARN org.apache.iotdb.db.service.TSServiceImpl - meet error while processing non-query. 12:28:16.208 [pool-7-IoTDB-RPC-Client-thread-1] WARN org.apache.iotdb.db.service.TSServiceImpl - meet error while processing non-query. org.apache.iotdb.db.exception.query.QueryProcessException: Cannot load file /home/yuyuankang/Downloads/data3/1615345483026-1-0.tsfile because The data of file /home/yuyuankang/Downloads/data3/1615345483026-1-0.tsfile cross partitions at org.apache.iotdb.db.qp.executor.PlanExecutor.loadFile(PlanExecutor.java:754) at org.apache.iotdb.db.qp.executor.PlanExecutor.operateLoadFiles(PlanExecutor.java:695) at org.apache.iotdb.db.qp.executor.PlanExecutor.processNonQuery(PlanExecutor.java:241) at org.apache.iotdb.db.service.TSServiceImpl.executeNonQuery(TSServiceImpl.java:1161) at org.apache.iotdb.db.service.TSServiceImpl.executeNonQueryPlan(TSServiceImpl.java:1795) at org.apache.iotdb.db.service.TSServiceImpl.executeUpdateStatement(TSServiceImpl.java:1148) at org.apache.iotdb.db.service.TSServiceImpl.executeStatement(TSServiceImpl.java:527) at org.apache.iotdb.service.rpc.thrift.TSIService$Processor$executeStatement.getResult(TSIService.java:2253) at org.apache.iotdb.service.rpc.thrift.TSIService$Processor$executeStatement.getResult(TSIService.java:2233) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:38) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:38) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:313) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

The attachment is how I generate tsfiles.

ps: The time range interval setting in the server and WriteTsFile.java are consistent, 3600 seconds.