[SAMZA-2557] Use the SQL Dot Operator to access nested fields/rows

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: sql
• Assignee: Unassigned
• Reporter: Slim Bouguerra
• Created: 02/Jul/20 00:14
• Updated: 22/Jul/20 15:52

Description

After https://issues.apache.org/jira/browse/SAMZA-2507 We can use Calcite Dot and Row operators to access nested row using a dot based path within a given column.

Although with this new feature multiple things has to change within the translation layer.

First We need to restructure the Query Translation Layer to allow multiple operators between Remote Table Scan and Joins operator.

Second we have to Add a new Row Format to leverage the flat nature of the rows.

Third we need to replace legacy udfs that relies on SamzaRelRecord as base row.