Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-9494

Remove workaround for BQ transform for Dataflow

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • P3
    • Resolution: Unresolved
    • None
    • None
    • io-py-gcp
    • None

    Description

      Dataflow incorrectly uses the Flatten input PCollection coder when it performs an optimization instead of the output PCollection coder which can lead to issues if these coders differ.

       

      The workaround was introduced in https://github.com/apache/beam/pull/11103

      Attachments

        Activity

          People

            Unassigned Unassigned
            lcwik Luke Cwik
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 2h 40m
                2h 40m