[BEAM-12356] BigQueryWriteClient in DatasetServiceImpl is not closed, which causes "ManagedChannel allocation site" exceptions

• Type: Bug
• Status: Open
• Priority: P2
• Resolution: Unresolved
• Affects Version/s: 2.29.0, 2.32.0, 2.33.0
• Fix Version/s: 2.34.0
• Component/s: io-java-gcp
• Assignee: Reuven Lax
• Reporter: Minbo Bae
• Created: 18/May/21 04:07
• Updated: 04/Jun/22 20:47

Description

BigQueryWriteClient in DatasetServiceImpl (added at https://github.com/apache/beam/pull/14309) is not closed.  This causes the error logs  in gRPC orphan channel clean up. See "bigquery_grpc.log" in attachments which is extracted from GCP Dataflow. I don't think this issue affect pipeline runs except the error logs, but could you take a look at that?

A similar issue is reported for CloudBigtableIO at https://github.com/googleapis/java-bigtable-hbase/issues/2658

 

Issue Links

• is duplicated by: BEAM-12365 BigQueryWriteClient is not closed
• is duplicated by: BEAM-12451 BigQueryIO leaks gRPC channels
• is duplicated by: BEAM-12521 Java SDK Bigquery IO : RuntimeException: ManagedChannel allocation site
• links to: GitHub Pull Request #14949
• links to: GitHub Pull Request #15009
• links to: GitHub Pull Request #15480
• links to: GitHub Pull Request #15621
• links to: GitHub Pull Request #17382
• links to: GitHub Pull Request #17454
• links to: GitHub Pull Request #17520