[ARROW-1817] Configure JsonFileReader to read NaN for floats

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.8.0
• Component/s: Java
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/17812
• Assignee: Bryan Cutler
• Reporter: Bryan Cutler
• Created: 15/Nov/17 19:08
• Updated: 11/Jan/23 07:17
• Resolved: 01/Dec/17 21:17

Description

There is a Spark unit test that includes reading JSON floating point values that are NaN's (validity bit is set). The Jackson parser in Arrow version 0.4 allowed for these by default, but looks like the updated version requires the conf ALLOW_NON_NUMERIC_NUMBERS to allow this.

https://fasterxml.github.io/jackson-core/javadoc/2.2.0/com/fasterxml/jackson/core/JsonParser.Feature.html#ALLOW_NON_NUMERIC_NUMBERS

Issue Links

• links to: GitHub Pull Request #1375