[BEAM-10160] Add Apache Iceberg IO connector

• Type: New Feature
• Status: Open
• Priority: P3
• Resolution: Unresolved
• Component/s: io-ideas
• Assignee: Unassigned
• Reporter: Ismaël Mejía
• Created: 30/May/20 14:54
• Updated: 13/Jun/22 14:22

Description

Apache Iceberg is an open table format layer on top of different filesystems.

Beam could support it in the form of an IO connector ideally integrating with Beam's own system for SQL support.

Inspiration can be taken from the ongoing effort to support Iceberg on Flink:
https://github.com/apache/iceberg/issues/788
https://docs.google.com/document/d/1idTjQCubhOCea8LkKJ_5aMTV4V_Wf1n0aYhabGsLQZc/edit

Issue Links

• links to: GitHub Pull Request #13585