[FLINK-10954] Hardlink from files of previous local stored state might cross devices

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Information Provided
• Affects Version/s: 1.6.2
• Component/s: Runtime / State Backends
• Labels: auto-deprioritized-critical auto-deprioritized-major auto-unassigned
• Assignee: Unassigned
• Reporter: Yun Tang
• Created: 20/Nov/18 17:14
• Updated: 31/Dec/21 06:21
• Resolved: 31/Dec/21 06:21

Description

Currently, local recovery's base directories is initialized from 'io.tmp.dirs' if parameter 'taskmanager.state.local.root-dirs' is not set. For Yarn environment, the tmp dirs is replaced by its 'LOCAL_DIRS', which might consist of directories from different devices, such as /dump/1/nm-local-dir, /dump/2/nm-local-dir. The local directory for RocksDB is initialized from IOManager's spillingDirectories, which might located in different device from local recovery's folder. However, hard-link between different devices is not allowed, it will throw exception below:

java.nio.file.FileSystemException: target -> souce: Invalid cross-device link

Issue Links

• blocks: FLINK-15507 Activate local recovery for RocksDB backends by default
• is fixed by: FLINK-25468 Local recovery fails if local state storage and RocksDB working directory are not on the same volume