[BEAM-6076] NEXMark flakiness: NPE thrown from BigQuery client library once in a while

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.9.0
• Component/s: testing
• Assignee: Lukasz Gajowy
• Reporter: Lukasz Gajowy
• Created: 16/Nov/18 10:26
• Updated: 16/May/20 14:04
• Resolved: 14/Dec/18 15:02

Description

It seems that once in a while the library that is used to connect to BigQuery throws exceptions like this: 

Exception in thread "main"
java.lang.NullPointerException
at com.google.cloud.bigquery.StandardTableDefinition$StreamingBuffer.fromPb(StandardTableDefinition.java:116)
at com.google.cloud.bigquery.StandardTableDefinition.fromPb(StandardTableDefinition.java:225)
at com.google.cloud.bigquery.TableDefinition.fromPb(TableDefinition.java:155)
at com.google.cloud.bigquery.TableInfo$BuilderImpl.<init>(TableInfo.java:183)
at com.google.cloud.bigquery.Table.fromPb(Table.java:593)
at com.google.cloud.bigquery.BigQueryImpl.getTable(BigQueryImpl.java:410)
at org.apache.beam.sdk.testutils.publishing.BigQueryClient.createTableIfNotExists(BigQueryClient.java:74)
at org.apache.beam.sdk.nexmark.Main.savePerfsToBigQuery(Main.java:184)
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:148)
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:98)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:423)

Similar error found in the network:  https://github.com/googleapis/google-cloud-java/issues/1689

Example logs: 
https://builds.apache.org/view/A-D/view/Beam/job/beam_PostCommit_Java_Nexmark_Spark/1085/console

Issue Links

• links to: GitHub Pull Request #7066