[BEAM-12003] Verify and document the temp_dataset option for new Python BigQuery source

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: Missing
• Component/s: io-py-gcp
• Assignee: Pablo Estrada
• Reporter: Chamikara Madhusanka Jayalath
• Created: 17/Mar/21 02:40
• Updated: 13/Jan/22 21:49
• Resolved: 28/Apr/21 21:01

Description

Python native BigQuery source allows users to specify a temporary dataset: https://github.com/apache/beam/blob/release-2.27.0/sdks/python/apache_beam/io/gcp/bigquery.py#L569

 

Looking at new ReadFromBigQuery, this option is not documented: https://github.com/apache/beam/blob/f482cef20ec9055f2ae1d10f68f380ad77bc8d8e/sdks/python/apache_beam/io/gcp/bigquery.py#L1801

 

But looking at the implementation I think this is available anyways: https://github.com/apache/beam/blob/f482cef20ec9055f2ae1d10f68f380ad77bc8d8e/sdks/python/apache_beam/io/gcp/bigquery.py#L665

 

Pablo, could you verify and document this ?