[SAMZA-1763] Implement async versions of the table API

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.0
• Assignee: Peng Du
• Reporter: Peng Du
• Created: 26/Jun/18 20:56
• Updated: 30/Dec/20 07:31
• Resolved: 10/Aug/18 18:51

Description

In Samza, Table API provides a consistent and simple way to perform IO with non-stream data sources, eg. key-value stores. It can be used in high-level API in the form of stream-table join and sendTo operators. Low-level API integration is also being worked on. 

The current set of Table APIs only consists of synchronous versions in that all calls are blocking. Unlike local tables, there is a strong need to have async for remote tables to deliver higher throughput which can otherwise be hindered with full sync executions. 

Given there is currently no async support in Samza high-level API, the design in this document is mainly targeted for low-level API. 

Issue Links

• is cloned by: SAMZA-2055 Design and Implement async API for high level
• links to: GitHub Pull Request #593