[HUDI-3245] Convert uppercase letters to lowercase in storage configs

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.10.1
• Component/s: configs, storage-management
• Labels: pull-request-available
• Story Points: 0.5
• Assignee: cdmikechen
• Reporter: cdmikechen

Reviewers

sivabalan narayanan

• Created: 14/Jan/22 09:36
• Updated: 18/Jan/22 19:51
• Resolved: 18/Jan/22 19:51

Description

Spark use CaseInsensitiveMap to get options, so that we can not get some configs in HoodieStorageConfig like hoodie.parquet.writeLegacyFormat.enabled and hoodie.parquet.outputTimestampType

We should convert uppercase letters to lowercase letters, so that it can not affect the related method.

Issue Links

• relates to: HUDI-2526 Make spark.sql.parquet.writeLegacyFormat configurable
• links to: GitHub Pull Request #4602