[BEAM-8952] Bigqueryio read from query temp dataset and GCP IAM issue

• Type: Bug
• Status: Resolved
• Priority: P3
• Resolution: Fixed
• Affects Version/s: 2.16.0
• Fix Version/s: Missing
• Component/s: io-java-gcp
• Assignee: Unassigned
• Reporter: Pierig Le Saux
• Created: 11/Dec/19 15:43
• Updated: 13/Jan/22 21:52
• Resolved: 15/May/21 17:59

Description

The need to give project level bigquery permissions for the creation and deletion of a temporary dataset is in my opinion a security concern.
We should be able to pass an existing temp_dataset for this purpose, where we have previously applied proper IAM permissions, thus not needing to give project level permissions to a dataflow job.