[CASSANDRA-18692] [Cassandra Analytics] Fix bulk writes with Buffered RowBufferMode

• Type: Bug
• Status: Resolved
• Priority: Normal
• Resolution: Fixed
• Fix Version/s: NA
• Component/s: Analytics Library
• Bug Category: Correctness
• Severity: Normal
• Complexity: Normal
• Discovered By: Adhoc Test
• Platform: All
• Since Version: NA

Source Control Link

https://github.com/apache/cassandra-analytics/commit/82b3c0a79c9322142738a4ec2ff7d4d4c0be2370

Test and Documentation Plan

• Added tests to ensure that the builder is properly configured when the Buffered mode is used.
• Added tests to ensure that the writer's checkBatchSize doesn't take any effect for the Buffered mode

• Assignee: Francisco Guerrero
• Reporter: Francisco Guerrero

Authors

Doug Rohrer, Francisco Guerrero

Reviewers

Dinesh Joshi, Yifan Cai

• Created: 25/Jul/23 17:49
• Updated: 09/Aug/23 17:32
• Resolved: 08/Aug/23 21:42

Description

When setting Buffered RowBufferMode as part of the WriterOption's , org.apache.cassandra.spark.bulkwriter.RecordWriter ignores that configuration and uses the batch size to finalize an SSTable and start using a new one if new rows are available.

Issue Links

• links to: GitHub Pull Request #13