[FLINK-35696] JSON_VALUE/QUERY functions incorrectly map floating numbers

• Type: Bug
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.19.1
• Fix Version/s: 1.20.0
• Component/s: Table SQL / Runtime
• Assignee: Dawid Wysakowicz
• Reporter: Dawid Wysakowicz
• Created: 4 days ago 13:18
• Updated: Yesterday 10:48

Description

SELECT JSON_VALUE('{"bigNumber":123456789.987654321}', '$.bigNumber')

produces

"1.2345678998765433E8"

which can not be mapped back. It gets rounded.

The reason is we use double for floats in SqlJsonUtils. We should rather configure jackson to use BigDecimals. In order to do that we need to properly shade jayway though.

I suggest we:

1. Add com.jayway.jsonpath:son-path to flink-shaded
2. We use the shaded library and pass a configured mapper which maps floats to BigDecimal

Sub-Tasks

• Publish shaded jsonpath: Closed