Uploaded image for project: 'Apache Hop (incubating)'
  1. Apache Hop (incubating)
  2. HOP-1863

Beam: Error converting Hop data to string lines

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Beam

    Description

      When execution a pipeline via local runner:

      ```
      2020/05/22 08:24:47 - Hop - Launching pipeline [transform_event_data_to_json]...
      2020/05/22 08:24:47 - Hop - Started the pipeline execution.
      2020/05/22 08:24:47 - General - Created Apache Beam pipeline with name 'transform_event_data_to_json'
      2020/05/22 08:24:47 - General - Handled transform (INPUT) : Beam Input
      2020/05/22 08:24:47 - General - Handled transform (OUTPUT) : Beam Output, gets data from Beam Input
      2020/05/22 08:24:47 - transform_event_data_to_json - Executing this pipeline using the Beam Pipeline Engine with run configuration 'Hop Beam Examples Local Runner'
      Exception in thread "Thread-33" java.lang.RuntimeException: Error starting the Beam pipeline
      at org.apache.hop.beam.engines.BeamPipelineEngine.lambda$startThreads$0(BeamPipelineEngine.java:295)
      at java.lang.Thread.run(Thread.java:748)
      Caused by: org.apache.beam.sdk.Pipeline$PipelineExecutionException: java.lang.RuntimeException: Error converting Hop data to string lines
      at org.apache.beam.runners.direct.DirectRunner$DirectPipelineResult.waitUntilFinish(DirectRunner.java:348)
      at org.apache.beam.runners.direct.DirectRunner$DirectPipelineResult.waitUntilFinish(DirectRunner.java:318)
      at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:213)
      at org.apache.hop.beam.engines.BeamPipelineEngine.executePipeline(BeamPipelineEngine.java:243)
      at org.apache.hop.beam.engines.BeamPipelineEngine.lambda$startThreads$0(BeamPipelineEngine.java:293)
      ... 1 more
      Caused by: java.lang.RuntimeException: Error converting Hop data to string lines
      at org.apache.hop.beam.core.fn.HopToStringFn.processElement(HopToStringFn.java:110)
      Caused by: java.lang.ClassCastException: java.util.Date cannot be cast to java.sql.Timestamp
      at org.apache.hop.core.row.value.ValueMetaTimestamp.getTimestamp(ValueMetaTimestamp.java:126)
      at org.apache.hop.core.row.value.ValueMetaTimestamp.getString(ValueMetaTimestamp.java:115)
      at org.apache.hop.core.row.RowMeta.getString(RowMeta.java:327)
      at org.apache.hop.beam.core.fn.HopToStringFn.processElement(HopToStringFn.java:85)
      at org.apache.hop.beam.core.fn.HopToStringFn$DoFnInvoker.invokeProcessElement(Unknown Source)
      at org.apache.beam.repackaged.direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:224)
      at org.apache.beam.repackaged.direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:185)
      at org.apache.beam.repackaged.direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:78)
      at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:240)
      at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:54)
      at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:160)
      at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:124)
      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      at java.lang.Thread.run(Thread.java:748)
      ```

      Attachments

        Activity

          People

            Unassigned Unassigned
            mxm Maximilian Michels
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: