[HUDI-6863] Revert "Auto-tune dedup parallelism"

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: 1.1.0
• Labels: pull-request-available
• Assignee: Ethan Guo
• Reporter: Ethan Guo
• Created: 15/Sep/23 05:11
• Updated: 21/Dec/23 15:28

Description

See https://github.com/apache/hudi/pull/6802#issuecomment-1455802492

The auto-tune logic for dedup parallelism dictates the write parallelism so that `hoodie.upsert.shuffle.parallelism` is ignored.

Issue Links

• links to: GitHub Pull Request #9722