[PHOENIX-7008] CDC DDL Compiler

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Implemented
• Assignee: Hari Krishna Dara
• Reporter: Viraj Jasani
• Created: 31/Jul/23 07:51
• Updated: 02/Feb/24 07:36
• Resolved: 30/Sep/23 03:55

Description

The purpose of this sub-task is to provide DDL query capability for CDC (Change Data Capture) feature.

The CREATE CDC table query can look something like:

Create CDC <CDC Table Name> on <Data Table Name> (PHOENIX_ROW_TIMESTAMP()  | <Data Table Column>) INCLUDE (pre | post | latest | all) TTL = <Age in seconds> INDEX = <GLOBAL | LOCAL> SALT_BUCKETS=<salt bucket count> 

 

The changes include:

• Create new table type CDC in SYSTEM.CATALOG
• Provide CDC table to data table link in SYSTEM.CATALOG
• Query parser/grammer changes
• PTable link type: CDC_TABLE (from CDC table to data table)
• MetaDataClient and ConnectionQueryServicesImpl (CQSI) changes to ensure no physical table gets created for CDC, it is rather treated as virtual table
• Create Uncovered global index on data table using either PHOENIX_ROW_TIMESTAMP() or a data table column (as provided in the query)
• Store INCLUDE image values (pre/post/latest/all) as CDC virtual table property in SYSTEM.CATALOG
• ALTER CDC query should be able to update any CDC attributes

 

ALTER and DROP CDC queries are provided by PHOENIX-7054.

Issue Links

• depends upon: PHOENIX-7054 Shallow grammar support for ALTER and DROP CDC
• links to: GitHub Pull Request #1662
• links to: GitHub Pull Request #1681
• links to: GitHub Pull Request #1694
• links to: GitHub Pull Request #1703
• links to: GitHub Pull Request #1802
• links to: GitHub Pull Request #1812