[BEAM-2986] Support reading avro GenericRecords with BigQueryIO

• Type: New Feature
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.2.0
• Component/s: io-java-gcp
• Assignee: Steve Niemitz
• Reporter: Steve Niemitz
• Created: 25/Sep/17 15:12
• Updated: 24/Jul/20 20:21
• Resolved: 29/Sep/17 17:59

Description

It would be nice to expose the avro records from BigQuery exports directly, rather than converting/serializing them to TableRow objects.

The interface could be similar to AvroIO.parseGenericRecords, allowing a user to pass in a custom parseFn to the reader.

There's a thread on the dev@ mailing this w/ discussion:
https://lists.apache.org/thread.html/a045726a0c8d7412f3556ee3aac881920afb040180f42112b393c68e@%3Cdev.beam.apache.org%3E

Issue Links

• links to: GitHub Pull Request #3894