[FLINK-17325] Integrate orc to file system connector

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.11.0
• Component/s: Connectors / FileSystem, Connectors / ORC
• Labels: pull-request-available
• Assignee: Jingsong Lee
• Reporter: Jingsong Lee
• Created: 22/Apr/20 10:05
• Updated: 30/Apr/20 08:11
• Resolved: 30/Apr/20 08:11

Description

Integrate orc to file system connector, so in the sql world, users can create file system table with orc format by DDL, do some reading, writing and streaming writing. And the RowData is the sql data format. The works are:

1. Introduce OrcRowDataInputFormat with partition support.
2. Introduce RowDataVectorizer.
3. Introduce OrcFileSystemFormatFactory.

Issue Links

• is blocked by: FLINK-10114 Support Orc for StreamingFileSink
• links to: GitHub Pull Request #11942