[SPARK-43281] Fix concurrent writer does not update file metrics

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.5.0
• Fix Version/s: 3.4.1, 3.5.0
• Component/s: SQL
• Assignee: XiDuo You
• Reporter: XiDuo You
• Created: 25/Apr/23 12:31
• Updated: 16/May/23 01:42
• Resolved: 16/May/23 01:42

Description

It uses temp file path to get file status after commit task. However, the temp file has already moved to new path during commit task.