[CASSSIDECAR-132] Add restore job progress endpoint and consistency check on restore ranges

• Type: New Feature
• Status: Resolved
• Priority: Normal
• Resolution: Fixed
• Fix Version/s: 1.0
• Component/s: Rest API
• Labels: pull-request-available
• Change Category: Semantic
• Complexity: Normal

Source Control Link

https://github.com/apache/cassandra-sidecar/commit/4fbdb880a4369700aed51ce885a5b349d28c0397

Test and Documentation Plan

ci

• Assignee: Yifan Cai
• Reporter: Yifan Cai

Authors

Yifan Cai

Reviewers

Bernardo Botella, Francisco Guerrero

• Created: 24/May/24 00:20
• Updated: 18/Jul/24 21:49
• Resolved: 18/Jul/24 21:47

Description

In order to support the sidecar-managed restore jobs (sidecar counterpart of Cassandra analytics bulk write via S3), it is required to have the capability to perform consistency check for the individual restore ranges and have a new endpoint for the spark job to query the restore progress.
The consistency check should be responsive to cluster topology changes. For example, if there is a new node joining the cluster, the write replica set of the affected ranges are changed. The joining node should be able to discover the restore ranges that it owns and restore the data.

Issue Links

• links to: GitHub Pull Request #123