[CASSANDRA-15953] Support fetching all user tables to compare in Cassandra-diff

• Type: Improvement
• Status: Resolved
• Priority: Normal
• Resolution: Fixed
• Fix Version/s: 4.0-beta2, 4.0
• Component/s: Tool/diff
• Labels: pull-request-available
• Change Category: Operability
• Complexity: Normal
• Platform: All

Source Control Link

https://github.com/apache/cassandra-diff/commit/2267933c3ac009808271e1831cf56258c99cf2d3

Test and Documentation Plan

Unit test.

Manual test that runs the spark job with the auto-discover config. 

• Assignee: Yifan Cai
• Reporter: Yifan Cai

Authors

Yifan Cai

Reviewers

Sam Tunnicliffe

• Created: 16/Jul/20 23:15
• Updated: 21/Dec/20 09:31
• Resolved: 27/Jul/20 11:16

Description

The spark diff job may fail to launch with kernel error "E2BIG: Argument list too long", when passing a large list of keyspace table list to compare.

Proposing a mode to fetch all user tables from the clusters to be compared. When the mode is on, the spark job ignores the parameter "keyspace_tables".

Issue Links

• is related to: CASSANDRA-15537 4.0 quality testing: Local Read/Write Path: Upgrade and Diff Test
• links to: GitHub Pull Request #10