Uploaded image for project: 'Apache Hop'
  1. Apache Hop
  2. HOP-3557

Parquet File output transform not writing data to GCS when running on Beam Dataflow

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Normal
    • Resolution: Unresolved
    • 1.0.0, 1.1.0
    • None
    • Transforms

    Description

      When executing a pipeline with the Beam Dataflow pipeline engine and using the Parquet File output transform it creates the file in GCS but with no contents.

      If you run the same attached pipeline using the local engine it creates the file with the correct data.

      Attachments

        1. parquet_output.hpl
          3 kB
          Yancarlo Perez

        Activity

          People

            Unassigned Unassigned
            yancarlo.perez Yancarlo Perez
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: