[BEAM-13286] RowJson fails to serialize DATETIMEs produced by ZetaSQL

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.36.0
• Component/s: dsl-sql
• Assignee: Brian Hulette
• Reporter: Brian Hulette
• Created: 18/Nov/21 17:46
• Updated: 19/Nov/21 16:29
• Resolved: 19/Nov/21 16:29

Description

ZetaSqlBeamTranslationUtils creates joda.time.Instant instances for DATETIME fields. While RowJson explicitly casts to DateTime when deserializing. This causes a ClassCastException for certain Beam SQL TableProviders (specifically any that use JsonPayloadSerializerProvider).

		Caused by: java.lang.ClassCastException: org.joda.time.Instant cannot be cast to org.joda.time.DateTime
			at org.apache.beam.sdk.util.RowJson$RowJsonSerializer.writeValue(RowJson.java:530)
			at org.apache.beam.sdk.util.RowJson$RowJsonSerializer.writeRow(RowJson.java:495)
			at org.apache.beam.sdk.util.RowJson$RowJsonSerializer.serialize(RowJson.java:478)
			at org.apache.beam.sdk.util.RowJson$RowJsonSerializer.serialize(RowJson.java:453)
			at com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._serialize(DefaultSerializerProvider.java:480)
			... 37 more

Issue Links

• links to: GitHub Pull Request #16015