[SAMZA-914] Design and implement a composable operator APIs for direct programming of DAG in Java

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Labels: fluent-api sql
• Assignee: Yi Pan
• Reporter: Yi Pan
• Created: 24/Mar/16 22:15
• Updated: 04/Jan/17 17:42
• Resolved: 04/Oct/16 23:27

Description

In the process of design/refining the physical operator layer for SAMZA-552, there is a need to design/implement a set of fluent programming APIs s.t. users may be able to directly write Java programs using the physical operators.

The programming APIs would serve as an intermediate layer that serves the following purposes:

1. Users can choose to directly use physical operators (like window/join/filter etc.) in their Java code
2. The SQL parser and engine can use this API to construct the physical operators and the execution DAG.

Issue Links

• is duplicated by: SAMZA-915 Implement operator programming APIs to support linear pipeline
• is duplicated by: SAMZA-916 Implement operator programing APIs to support join
• relates to: SAMZA-1041 Multi-stage feature for Samza

Sub-Tasks

• Implement operator programming APIs to support linear pipeline: Resolved
• Implement operator programing APIs to support join: Resolved
• Refactor classes from samza-operator/api into samza-api.: Resolved
• Refactor public Operator APIs: Resolved
• Provide Operator implementations access to KeyValueStorageEngines: Resolved