[HUDI-5296] Support disabling schema on read if not required

• Type: Improvement
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 0.12.2
• Component/s: writer-core
• Labels: pull-request-available
• Assignee: sivabalan narayanan
• Reporter: sivabalan narayanan
• Created: 29/Nov/22 23:47
• Updated: 13/Dec/22 21:54
• Resolved: 13/Dec/22 21:54

Description

If someone has enabled "schema.on.read" by mistake for a given table, as of now, they can't disable it back. we are seeing some corner case bugs that schema on read has bugs around insert_overwrite, reconcile schema etc. So, atleast for those who hasn't done any renaming or dropping a column, it should be feasible to disable schema on read on the write path and make progress. 

 

 

Issue Links

• links to: GitHub Pull Request #7333
• links to: GitHub Pull Request #7421