[SAMZA-598] Provide a tool to debug state stores

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.9.0
• Fix Version/s: 0.10.0
• Component/s: kv
• Assignee: Yan Fang
• Reporter: Chris Riccomini
• Created: 13/Mar/15 01:40
• Updated: 28/Oct/15 17:24
• Resolved: 28/Oct/15 17:24

Description

There is currently no easy way to debug a Samza job when there are problems with the state store data. It would be nice to provide a tool that will:

1. Connect to a local KV state store, and dump its content.
2. Consume a changelog to and materialize a state store locally.

Optionally, it would be nice to allow users to fetch values for a give key via a REPL. This is a little tricky, though, since the key might be serialized in Protobu, Avro, etc.

Between 1-2, users will be able to inspect local stores of jobs that are running (1), and create a local copy of a state store for jobs that have lost their local state already (2).

Issue Links

• depends upon: SAMZA-442 Upgrade RocksDB to 3.10
• is related to: SAMZA-617 YARN host affinity in Samza