Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-7917

Python datastore v1new fails on retry

    XMLWordPrintableJSON

    Details

      Description

      Traceback (most recent call last):
      File "apache_beam/runners/common.py", line 782, in apache_beam.runners.common.DoFnRunner.process
      File "apache_beam/runners/common.py", line 454, in apache_beam.runners.common.SimpleInvoker.invoke_process
      File "/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/datastore/v1new/datastoreio.py", line 334, in process
      self._flush_batch()
      File "/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/datastore/v1new/datastoreio.py", line 349, in _flush_batch
      throttle_delay=util.WRITE_BATCH_TARGET_LATENCY_MS // 1000)
      File "/usr/local/lib/python3.7/site-packages/apache_beam/utils/retry.py", line 197, in wrapper
      return fun(*args, **kwargs)
      File "/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/datastore/v1new/helper.py", line 99, in write_mutations
      batch.commit()
      File "/usr/local/lib/python3.7/site-packages/google/cloud/datastore/batch.py", line 271, in commit
      raise ValueError("Batch must be in progress to commit()")
      ValueError: Batch must be in progress to commit()

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                sadovnychyi Dmytro Sadovnychyi
                Reporter:
                sadovnychyi Dmytro Sadovnychyi
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 3h 50m
                  3h 50m