Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-12356

BigQueryWriteClient in DatasetServiceImpl is not closed, which causes "ManagedChannel allocation site" exceptions

Details

    • Bug
    • Status: Open
    • P2
    • Resolution: Unresolved
    • 2.29.0, 2.32.0, 2.33.0
    • 2.34.0
    • io-java-gcp
    • None

    Description

      BigQueryWriteClient in DatasetServiceImpl (added at https://github.com/apache/beam/pull/14309) is not closed.  This causes the error logs  in gRPC orphan channel clean up. See "bigquery_grpc.log" in attachments which is extracted from GCP Dataflow. I don't think this issue affect pipeline runs except the error logs, but could you take a look at that?

      A similar issue is reported for CloudBigtableIO at https://github.com/googleapis/java-bigtable-hbase/issues/2658

       

      Attachments

        1. bigquery_grpc.log
          4 kB
          Minbo Bae

        Issue Links

          Activity

            People

              reuvenlax Reuven Lax
              baeminbo Minbo Bae
              Votes:
              8 Vote for this issue
              Watchers:
              32 Start watching this issue

              Dates

                Created:
                Updated:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 11h
                  11h