[FLINK-27100] Support parquet format in FileStore

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: table-store-0.3.0
• Component/s: Table Store
• Assignee: Yubin Li
• Reporter: Yubin Li
• Created: 06/Apr/22 16:38
• Updated: 05/Sep/22 13:11
• Resolved: 05/Sep/22 13:11

Description

Apache Parquet is a very popular columnar file format, used in many data analysis engines like Hive/Impala/Spark/Flink. we could use simple command lines like parquet-tools to view metadata and data easily instead of using complex java code.

now flink-table-store only support ORC, but there are massive business data stored as Parquet format, developers/analysisers are very familliar with it, and Parquet has better support for impala engine.

 maybe it's a good addition to make Parquet usable. 

Sub-Tasks

• Support bulk based format provided by Flink: Closed
• Support built-in parquet format: Closed
• Fix table store connector throws ClassNotFoundException: org.apache.flink.table.store.shaded.org.apache.flink.connector.file.table.RowDataPartitionComputer: Closed