Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-11332

Snowflake cross-language wrapper fails for Dataflow

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: P2
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: cross-language
    • Labels:
      None

      Description

      Error is : KeyError: 'beam:transform:write_files:v1'

      See following thread for details.

      https://lists.apache.org/thread.html/r0602f6533895485797c463b04cad9709661dd92fd38d4e8a9acc4fe2%40%3Cuser.beam.apache.org%3E

       

      Probably moving Dataflow to directly consume Beam protos will resolve this.

        Attachments

        1. image-2021-01-30-18-17-23-265.png
          333 kB
          Pawel Urbanowicz
        2. image-2021-01-30-18-18-16-042.png
          333 kB
          Pawel Urbanowicz

          Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. BEAM-11360 Enable portable job submission for Dataflow multi-language pipelines (Python SDK)

          • P1 - Critical bug: data loss, total loss of function, or loss of testing signal due to test failures or flakiness
          • Resolved

            Activity

              People

              • Assignee:
                chamikara Chamikara Madhusanka Jayalath
                Reporter:
                chamikara Chamikara Madhusanka Jayalath
              • Votes:
                1 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated: