[SAMZA-1773] Side inputs for local stores

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Component/s: kv-store
• Assignee: Bharath Kumarasubramanian
• Reporter: Bharath Kumarasubramanian
• Created: 19/Jul/18 05:41
• Updated: 21/Jan/20 22:00
• Resolved: 19/Mar/19 17:53

Description

We want a way to populate the local store for jobs from a secondary data source (e.g hadoop), but is otherwise read-only. Typical use cases of such stores are scoring data for relevance jobs, etc

 

The rows (keys) in this dataset are independent of each other, and there's no requirement for the entire dataset to be updated atomically. This means that once the store is bootstrapped, it can be updated in change capture mode in the background while processing continues.

Issue Links

• links to: GitHub Pull Request #570
• mentioned in: Page Loading...