[SAMZA-390] High-Level Language for Samza

• Type: New Feature
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: sql
• Labels: design jdk7 project
• Assignee: Yi Pan
• Reporter: Raul Castro Fernandez
• Created: 22/Aug/14 17:20
• Updated: 02/Jul/15 22:30

Description

Discussion about high-level languages to define Samza queries. Queries are defined in this language and transformed to a dataflow graph where the nodes are Samza jobs.

Issue Links

• depends upon: SAMZA-455 Decide on Java 6 support policy

Sub-Tasks

• Identify the set of operators for SQL on Samza: Resolved
• A common representation of relational algebra for streaming SQL: Resolved
• Define the serialization/deserialization format for stream tuple: Resolved
• SQL grammar support for window operator: Resolved
• Translate query plan generated by Calcite to Samza OperatorRouter: Open
• Implement Calcite SchemaFactory on top of Kafka Schema Registry: Open
• Implement a Serde for AvroData: Resolved
• Move samza-sql into samza-sql-core: Resolved
• Implement streaming aggregates with support for both window aggregations and general group-by aggregations with monotonic group-by fields: Open
• Implement project operator: Open
• Define DDL for streaming SQL: Open