[HOP-1863] Beam: Error converting Hop data to string lines

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Cannot Reproduce
• Fix Version/s: 1.1.0
• Component/s: Beam
• Labels: pre-apache
• Assignee: Unassigned
• Reporter: Maximilian Michels
• Created: 04/Oct/20 12:19
• Updated: 20/Dec/21 17:32
• Resolved: 20/Dec/21 17:32

Description

When execution a pipeline via local runner:

```
2020/05/22 08:24:47 - Hop - Launching pipeline [transform_event_data_to_json]...
2020/05/22 08:24:47 - Hop - Started the pipeline execution.
2020/05/22 08:24:47 - General - Created Apache Beam pipeline with name 'transform_event_data_to_json'
2020/05/22 08:24:47 - General - Handled transform (INPUT) : Beam Input
2020/05/22 08:24:47 - General - Handled transform (OUTPUT) : Beam Output, gets data from Beam Input
2020/05/22 08:24:47 - transform_event_data_to_json - Executing this pipeline using the Beam Pipeline Engine with run configuration 'Hop Beam Examples Local Runner'
Exception in thread "Thread-33" java.lang.RuntimeException: Error starting the Beam pipeline
at org.apache.hop.beam.engines.BeamPipelineEngine.lambda$startThreads$0(BeamPipelineEngine.java:295)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.beam.sdk.Pipeline$PipelineExecutionException: java.lang.RuntimeException: Error converting Hop data to string lines
at org.apache.beam.runners.direct.DirectRunner$DirectPipelineResult.waitUntilFinish(DirectRunner.java:348)
at org.apache.beam.runners.direct.DirectRunner$DirectPipelineResult.waitUntilFinish(DirectRunner.java:318)
at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:213)
at org.apache.hop.beam.engines.BeamPipelineEngine.executePipeline(BeamPipelineEngine.java:243)
at org.apache.hop.beam.engines.BeamPipelineEngine.lambda$startThreads$0(BeamPipelineEngine.java:293)
... 1 more
Caused by: java.lang.RuntimeException: Error converting Hop data to string lines
at org.apache.hop.beam.core.fn.HopToStringFn.processElement(HopToStringFn.java:110)
Caused by: java.lang.ClassCastException: java.util.Date cannot be cast to java.sql.Timestamp
at org.apache.hop.core.row.value.ValueMetaTimestamp.getTimestamp(ValueMetaTimestamp.java:126)
at org.apache.hop.core.row.value.ValueMetaTimestamp.getString(ValueMetaTimestamp.java:115)
at org.apache.hop.core.row.RowMeta.getString(RowMeta.java:327)
at org.apache.hop.beam.core.fn.HopToStringFn.processElement(HopToStringFn.java:85)
at org.apache.hop.beam.core.fn.HopToStringFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:224)
at org.apache.beam.repackaged.direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:78)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:240)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:54)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:160)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:124)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
```