[BEAM-12730] Add custom delimiters to Python TextIO reads

• Type: New Feature
• Status: Triage Needed
• Priority: P2
• Resolution: Done
• Fix Version/s: 2.35.0
• Component/s: io-py-common, io-py-files
• Assignee: Dmitrii Kuzin
• Reporter: Daniel Oliveira
• Created: 07/Aug/21 00:17
• Updated: 13/Apr/23 11:07
• Resolved: 03/Nov/21 07:26

Description

A common request by users is to be able to separate a text files read by TextIO with delimiters other than newline. The Java SDK already supports this feature.

The current delimiter code is located here and defaults to newlines. This function could easily be modified to also handle custom delimiters. Changing this would also necessitate changing the API for the various TextIO.Read methods and adding documentation.

This seems like a good starter bug for making more in-depth contributions to Beam Python.

Issue Links

• is related to: BEAM-2802 TextIO should allow specifying a custom delimiter
• links to: GitHub Pull Request #15667
• links to: GitHub Pull Request #15715
• links to: GitHub Pull Request #15775
• links to: GitHub Pull Request #15864