[CASSANDRA-19962] CEP-44: Kafka integration for Cassandra CDC using Sidecar

• Type: New Feature
• Status: Resolved
• Priority: Normal
• Resolution: Fixed
• Fix Version/s: NA
• Component/s: Analytics Library, Sidecar
• Change Category: Operability
• Complexity: Challenging
• Platform: All

Source Control Link

https://github.com/apache/cassandra-analytics/commit/e51716ee724cf4950df67eba0393b3f798b7dc00

Test and Documentation Plan

CircleCI

• Assignee: James Berragan
• Reporter: James Berragan

Authors

James Berragan

Reviewers

Dinesh Joshi, Yifan Cai

• Created: 27/Sep/24 20:47
• Updated: 07/Dec/24 00:10
• Resolved: 07/Dec/24 00:10

Description

This is the initial commit for CEP-44 to introduce a standalone CDC module into the Analytics project. This module provides the foundation for CDC in the Apache Cassandra Sidecar.
    
    This module provides:
    - a standalone Cdc class as the entrypoint for initializing CDC.
    - pluggable interfaces for: listing and reading commit log segments for a token range, persisting and reading CDC state, providing the Cassandra table schema, optionally reading values from Cassandra.
    - read and deserialize commit log mutations.
    - reconcile and de-duplicate mutations across replicas.
    - serialize CDC state into a binary object for persistence.
    - a layer for converting Cassandra mutations into a standard consumable format.

Issue Links

• links to: CircleCI
• links to: GitHub Pull Request #87
• links to: GitHub Pull Request #87