[HUDI-5549] LOGFILE_DATA_BLOCK_FORMAT Should not need to be set to parquet when using SparkRecordManager

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: spark
• Labels: pull-request-available
• Assignee: Frank Wong
• Reporter: Jonathan Vexler
• Created: 13/Jan/23 02:56
• Updated: 05/Apr/23 07:11

Description

HoodieStorageConfig.LOGFILE_DATA_BLOCK_FORMAT needs to be set to "parquet" whenever we use SparkRecordManager.

This should not be required.

Issue Links

• links to: GitHub Pull Request #7714