[HUDI-5639] Ensure for spark streaming, single writer does not need to set any additional configs with 0.13.0

• Type: Improvement
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 0.13.0
• Component/s: writer-core
• Labels: pull-request-available
• Assignee: sivabalan narayanan
• Reporter: sivabalan narayanan
• Created: 28/Jan/23 20:19
• Updated: 29/Jan/23 06:50
• Resolved: 29/Jan/23 06:50

Description

We added multi-writer capability to spark streaming. https://github.com/apache/hudi/pull/7383

 

this introduced a identifier config that each writer should set. For a single writer, we should set some default and not ask user to explicitly set the configs. 

for multi-writer scenarios, its fair to expect users to set different identifiers for diff writers. 

Issue Links

• links to: GitHub Pull Request #7783