[HDFS-17041] RBF: Fix putAll impl for mysql and file based state stores

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: rbf
• Labels: pull-request-available
• Target Version/s: 3.4.0
• Hadoop Flags: Reviewed
• Assignee: Viraj Jasani
• Reporter: Viraj Jasani
• Created: 07/Jun/23 17:12
• Updated: 28/Jan/24 02:13
• Resolved: 13/Jun/23 16:56

Description

Only zookeeper based state store allows all records to be inserted even though only few of them already exists and "errorIfExists" is true, however file/fs as well as mysql based putAll fails the whole putAll operation immediately after encountering single record that already exists in the records and "errorIfExists" is provided true (which is the case while inserting records for the first time).

For all implementations, we should allow inserts of the records that do not already exist and report any record as failure that already exists, rather than failing the whole operation and not trying to insert valid records.

Issue Links

• links to: GitHub Pull Request #5723