[HUDI-5336] Fix log file parsing to consider "." at the beginning

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 0.12.2, 0.13.0
• Component/s: writer-core
• Labels: pull-request-available
• Assignee: sivabalan narayanan
• Reporter: sivabalan narayanan
• Created: 06/Dec/22 22:42
• Updated: 16/Feb/23 06:58
• Resolved: 13/Dec/22 21:55

Description

In some of the cloud stores like GCS, some temporary marker files are created like "

.hoodie/metadata/files/GCS_SYNCABLE_TEMPFILE.files-0000_20221110051755284001.log.9_0-45-1315.2.79df61f2-e409-4bd7-863d-33b8fc179e32"

 

which are not the ones created by Hudi. So, we need to parse or deduce the log files correctly and not just check for if the name contains "log" in in. 

 

Issue Links

• links to: GitHub Pull Request #7393
• links to: GitHub Pull Request #7612