[SAMZA-2572] Umbrella Jira for Samza SQL type system improvement

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: sql
• Assignee: Unassigned
• Reporter: Slim Bouguerra
• Created: 03/Aug/20 18:47
• Updated: 03/Aug/20 18:47

Description

This an umbrella Jira to keep track of related improvements and fix that will tackle as part of Samza SQL Type system and SQL translation.

The goal here is to ensure that most of the type checking can be done at Query compile time. In the other hand adding more type checking and schema aware data structure will enable more robust runtime type checking.

Here is the list of items that will be tackled in the short term, and other item(s) is/are welcome.

• Ensure that the Calcite Schema top level column order is the same as the Samza input Rel Message.
• Ensure that the Primary Key Column of remote tables (_key_) is typed and listable as part of the table describe via shell.
• Ensure that the join Condition for case of remote table is checked at compile time aka making sure that the join predicate is in the form of _key_ = c and (any other predicate)
• Ensure that the Remote Table Join table key converter is type safe and can be type checked at compile time (SamzaRelTableKeyConverter). Today this is exposed as an Object and it is hard to check at runtime or compile time.

 

Sub-Tasks

• Ensure Samza SQL rel message column order: Open