[IOTDB-352] [Distributed] Recognize and skip duplicated files in a snapshot

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Labels: distributed
• Assignee: Tian Jiang
• Reporter: Tian Jiang
• Created: 10/Dec/19 02:31
• Updated: 26/Mar/20 02:19
• Resolved: 28/Feb/20 01:45

Description

By the naming of TsFiles in IoTDB, the files with the same data may have different names on different nodes. When such files are sent through snapshots, the receiver is unable to tell whether the file already exists locally or not, so it will blindly load the file as an unsequential one (if it does overlap any existing files), which will waste a lot of system resources.

How can we figure out if we already have one file or not?

Issue Links

• is a child of: IOTDB-68 IoTDB supports distributed version