Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-1817

Configure JsonFileReader to read NaN for floats

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.8.0
    • Component/s: Java

      Description

      There is a Spark unit test that includes reading JSON floating point values that are NaN's (validity bit is set). The Jackson parser in Arrow version 0.4 allowed for these by default, but looks like the updated version requires the conf ALLOW_NON_NUMERIC_NUMBERS to allow this.

      https://fasterxml.github.io/jackson-core/javadoc/2.2.0/com/fasterxml/jackson/core/JsonParser.Feature.html#ALLOW_NON_NUMERIC_NUMBERS

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                bryanc Bryan Cutler
                Reporter:
                bryanc Bryan Cutler
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: