[HOP-3190] Beam BigQuery Input action projectId error when executing beam direct pipeline

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Resolved
• Affects Version/s: 0.99
• Fix Version/s: 0.99
• Component/s: Actions, Beam
• Environment: Windows 10 environment ; ; GOOGLE_APPLICATION_CREDENTIALS=service_account_json_key was set as a windows system variable. ; ; service_account_json_key location was also set under tools->options->Google Cloud
• Assignee: Unassigned
• Reporter: Yancarlo Perez
• Created: 12/Aug/21 15:31
• Updated: 20/Aug/21 17:13
• Resolved: 20/Aug/21 17:13

Description

When executing a pipeline that contains the Beam BigQuery input step, we are getting a beam sdk error specified below (attached to this ticket is the full stack trace):

 Caused by: org.apache.beam.sdk.util.UserCodeException: java.lang.NullPointerException: Required parameter projectId must be specified.

 

However the BigQuery input step is able to retrieve the fields using the Get Fields option from the action:

 

But when you try to execute the pipeline the stack trace error occurs.

I am using a google service account with BigQuery that has read privilege to the dataset.

service_account_json_key is located on the attached project under google_access directory