[HUDI-6123] Auto adjust lock configs only for single writer

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.13.0
• Fix Version/s: 0.13.1, 0.14.0
• Component/s: writer-core
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: Danny Chen
• Created: 22/Apr/23 09:34
• Updated: 11/Aug/23 01:34
• Resolved: 23/Apr/23 08:38

Description

This is a follow-up fix for #8111.

Currently, the hoodie.auto.adjust.lock.configs opiton is by default false for batch mode ingestion,
and true for spark streaming sink and delta_streamer, while MDT is by default enabled.

For multiple streaming writers with no explicit lock provider set up, InProcessLockProvider should not be used.

Change list:

1. Restrict the option hoodie.auto.adjust.lock.configs to take effect in single writer scope, because for multi-writer, the
   InProcessLockProvider can not work as expected among hosts/processes;
2. The LockManager #lock and #unlock are invoked from the TransactionManager
   which already does the checks for the requirement of an explicit lock, remove the redundant check in LockManager.

Issue Links

• links to: GitHub Pull Request #8542