[FLINK-31275] Flink supports reporting and storage of source/sink tables relationship

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.18.0
• Component/s: Table SQL / Planner
• Assignee: Fang Yong
• Reporter: Fang Yong
• Created: 01/Mar/23 07:57
• Updated: 01/Feb/24 02:07

Description

FLIP-314 has been accepted https://cwiki.apache.org/confluence/display/FLINK/FLIP-314%3A+Support+Customized+Job+Lineage+Listener

Issue Links

• is related to: FLINK-6757 Investigate Apache Atlas integration
• relates to: FLINK-32402 FLIP-294: Support Customized Catalog Modification Listener
• mentioned in: Page Loading...

Sub-Tasks

• Introduce lineage graph relevant interfaces: Closed
• Implement table lineage graph: Closed
• Introduce job status changed listener for lineage: Closed
• Implement Lineage Interface in Kafka Connector: Open
• Implement Lineage Interface in Jdbc Connector: Open
• Implement Lineage Interface in Cassandra Connector: Open
• Implement Lineage Graph for streaming API use cases: Closed
• Implement lineage interface for hive connector: Open
• Add namespace convention doc for Flink lineage: Open
• Improve Lineage Info Collection for flink app: Resolved
• Add helper classes for Lineage integration in connectors: Open