[BEAM-14182] Bigquery import/export should transfer dataflow labels to load job

• Type: Improvement
• Status: Open
• Priority: P2
• Resolution: Unresolved
• Component/s: io-java-gcp

Language

java

• Assignee: Unassigned
• Reporter: Lara Schmidt
• Created: 25/Mar/22 21:09
• Updated: 05/Jun/22 00:17

Description

We add labels to the load / export job but right now it's just a beam-related label and no others. If the user has labels with the dataflow job it would be good to forward these to the load job so that the resources can be looked up properly.

I noticed this in java. I imagine it's an issue in python/go but would be good to check.

Relevant code links:
[1] https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIOMetadata.java#L59
[2] https://github.com/apache/beam/blob/11aad9160d3a12e19d593d5819bca9505ded9a3b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryServicesImpl.java#L232