[SAMZA-2271] Metadata Store

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: 1.3
• Assignee: Bharath Kumarasubramanian
• Reporter: Bharath Kumarasubramanian
• Created: 16/Jul/19 17:02
• Updated: 19/Feb/20 21:16

Description

In order to operate, Samza stores its managed data in Kafka currently. Metadata store is an abstraction that will help us decouple from Kafka and enable us to have a pluggable store implementation to store our metadata like (checkpoints, job model, configuration etc).

This is an umbrella ticket to capture the feature.

Issue Links

• is a parent of: SAMZA-2294 LocalApplicationRunner support for missing coordinator stream
• is a parent of: SAMZA-2182 Metadata store: disconnect between creation and usage of the underlying storage
• is a parent of: SAMZA-2272 Metadata store: Consolidate metadata store types in ZkJobCoordinator standalone jobs
• is a parent of: SAMZA-2276 Metadata store putAll