[HUDI-7419] Remove duplicate code for getFileFormat and Refactor filter methods for S3/GCS sources

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Done
• Component/s: deltastreamer
• Story Points: 2
• Assignee: Vinish Reddy
• Reporter: Vinish Reddy
• Created: 19/Feb/24 08:16
• Updated: 27/Feb/24 12:55
• Resolved: 27/Feb/24 12:55

Description

The logic to retrieve the data file format is duplicated across both sources, in S3 source we are handling the new config change properly but we are doing it for GCS, moved it to a common class to reduce the duplicate code blocks. 

Refactored the generateFilter methods to public static methods for S3/GCS sources.