[BEAM-11884] Deterministic coding enforcement causes BigQueryBatchFieldLoads/GroupFilesByTableDestinations to fail

• Type: Bug
• Status: Resolved
• Priority: P1
• Resolution: Fixed
• Fix Version/s: 2.29.0
• Component/s: io-py-gcp
• Labels: pull-request-available
• Assignee: Chun Yang
• Reporter: Chun Yang
• Due: 05/Mar/21
• Created: 27/Feb/21 08:17
• Updated: 31/Mar/21 18:25
• Resolved: 12/Mar/21 01:13

Description

TypeError: Unable to deterministically encode '<TableReference
 datasetId: 'my-dataset-id'
 projectId: 'my-project-id'
 tableId: 'my-table-id'>' of type '<class 'apache_beam.io.gcp.internal.clients.bigquery.bigquery_v2_messages.TableReference'>', please provide a type hint for the input of 'WriteToBigQuery/BigQueryBatchFileLoads/GroupFilesByTableDestinations' [while running 'WriteToBigQuery/BigQueryBatchFileLoads/IdentityWorkaround']

Issue Links

• is caused by: BEAM-11719 Enforce deterministic coding for GroupByKey and Stateful DoFns
• is related to: BEAM-12079 Deterministic coding enforcement causes _StreamToBigQuery/CommitInsertIds/GroupByKey to fail
• links to: GitHub Pull Request #14112