[HUDI-1664] Avro schema inference for Flink SQL table

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Implemented
• Fix Version/s: 0.8.0
• Component/s: flink
• Labels: pull-request-available
• Assignee: Danny Chen
• Reporter: Danny Chen
• Created: 05/Mar/21 02:13
• Updated: 11/Mar/21 11:46
• Resolved: 11/Mar/21 11:46

Description

A Flink SQL table has DDL that defines the table schema, we can use that to infer the Avro schema and there is no need to declare a Avro schema explicitly anymore.

But we still keep the config option for explicit Avro schema in case there is corner cases that the inferred schema is not correct (especially for the nullability).

Issue Links

• is duplicated by: HUDI-1663 Streaming read for Flink MOR table
• links to: GitHub Pull Request #2658