[FLINK-35696] JSON_VALUE/QUERY functions incorrectly map floating numbers

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.20.0, 1.19.1
• Fix Version/s: 2.0.0
• Component/s: Table SQL / Runtime
• Labels: pull-request-available
• Assignee: Dawid Wysakowicz
• Reporter: Dawid Wysakowicz
• Created: 25/Jun/24 13:18
• Updated: 5 hours ago
• Resolved: 5 hours ago

Description

SELECT JSON_VALUE('{"bigNumber":123456789.987654321}', '$.bigNumber')

produces

"1.2345678998765433E8"

which can not be mapped back. It gets rounded.

The reason is we use double for floats in SqlJsonUtils. We should rather configure jackson to use BigDecimals. In order to do that we need to properly shade jayway though.

I suggest we:

1. Add com.jayway.jsonpath:son-path to flink-shaded
2. We use the shaded library and pass a configured mapper which maps floats to BigDecimal

Issue Links

• links to: GitHub Pull Request #25026

Sub-Tasks

• Publish shaded jsonpath: Closed
• Upgrade flink-shaded to 19.0: Closed