[STREAMPIPES-418] Datalake sink should use event schema to detect type of property

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.69.0
• Component/s: Pipeline Elements
• Assignee: Philipp Zehnder
• Reporter: Philipp Zehnder
• Created: 26/Aug/21 05:17
• Updated: 26/Nov/22 14:29
• Resolved: 26/Aug/21 05:50

Description

Currently the data lake sink uses the type of the event values for the type definition of the column values. 

This should be changed to the type of the property defined in the event schema.

In the current implementation we had problems when the properties were not consistent (e.g. 1.3 and 1). Then a type exception was thrown by the database.