Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-11332

Snowflake cross-language wrapper fails for Dataflow

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • P3
    • Resolution: Unresolved
    • None
    • None
    • cross-language
    • None

    Description

      Error is : KeyError: 'beam:transform:write_files:v1'

      See following thread for details.

      https://lists.apache.org/thread.html/r0602f6533895485797c463b04cad9709661dd92fd38d4e8a9acc4fe2%40%3Cuser.beam.apache.org%3E

       

      Probably moving Dataflow to directly consume Beam protos will resolve this.

      Attachments

        1. image-2021-01-30-18-18-16-042.png
          333 kB
          Pawel Urbanowicz
        2. image-2021-01-30-18-17-23-265.png
          333 kB
          Pawel Urbanowicz

        Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. BEAM-11360 Enable portable job submission for Dataflow multi-language pipelines (Python SDK)

          • P1 - Critical bug: data loss, total loss of function, or loss of testing signal due to test failures or flakiness
          • Resolved

          Activity

            People

              Unassigned Unassigned
              chamikara Chamikara Madhusanka Jayalath
              Votes:
              1 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated: