Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-13602

Metrics reporting failed bigtable io

Details

    • Bug
    • Status: Triage Needed
    • P2
    • Resolution: Fixed
    • None
    • Missing
    • io-py-gcp
    • None

    Description

      Details see comment in https://github.com/apache/beam/pull/15562.

      We are seeing errors which possibly originate from this code:def write_mutate_metrics(self, rows): for status in rows: grpc_status_string = ( ServiceCallMetric.bigtable_error_code_to_grpc_status_string( status.code)) self.service_call_metric.call(grpc_status_string)Error message:
      File "/usr/local/lib/python3.6/site-packages/apache_beam/io/gcp/bigtableio.py", line 123, in write_mutate_metrics status.code)) AttributeError: 'NoneType' object has no attribute 'code' [while running 'Write event Bigtable row/ParDo(_BigTableWriteFn)-ptransform-58134']Would you have any idea about this issue?We are runningPython 3.6
      Beam 2.35
      GCP DataflowRunner
      In addition, the choice of parameter name (rows) is confusing. Perhaps something like responses or response_list ?
      https://cloud.google.com/bigtable/docs/writing-data#batch
      https://googleapis.dev/python/bigtable/1.3.0/_modules/google/cloud/bigtable/table.html#Table.mutate_rows

      Attachments

        Issue Links

          Activity

            People

              ningk Ning
              ningk Ning
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 3h
                  3h