[IOTDB-1872] Data increases abnormally after IoTDB restarts

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.12.2
• Fix Version/s: 0.12.3
• Component/s: Core/Server
• Labels: pull-request-available
• Sprint: 2021-10-DragonGate
• Assignee: Liuxuxin
• Reporter: Liuxuxin
• Created: 21/Oct/21 08:22
• Updated: 01/Nov/21 13:42
• Resolved: 01/Nov/21 13:27

Description

1. Description
   If the IoTDB is shutdown when compacting, when IoTDB is restored, there will be an abnormal increase in data.
2. Cause
   When SGP perform recover process, it new a RestorableTsFileIOWriter for each tsfile. However, it doesn't close the writer after using it. So the output stream to the file will be kept in process. When recovering compaction, if the system tries to delete a tsfile, exception will occur because the handler of the file isn't removed. The new compaction process of same file will continue to write on this undeleted file.

Then, the undeleted data will be kept in the target file.

Issue Links

• links to: GitHub Pull Request #4206