[BEAM-2857] Create FileIO in Python

• Type: New Feature
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.14.0
• Component/s: sdk-py-core
• Labels: gsoc gsoc2019 mentor
• Assignee: Pablo Estrada
• Reporter: Eugene Kirpichov
• Created: 06/Sep/17 21:30
• Updated: 15/Jan/21 17:58
• Resolved: 04/Sep/19 19:47

Description

Beam Java has a FileIO with operations: match()/matchAll(), readMatches(), which together cover the majority of needs for general-purpose file ingestion. Beam Python should have something similar.

An early design document for this: https://s.apache.org/fileio-beam-python

Issue Links

• links to: GitHub Pull Request #8394