Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-10725 Support JSON format tables
  3. IMPALA-11709

Bump Arrow version to 9.0.0-p2 for decimal support

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • Impala 4.2.0
    • None
    • None
    • ghx-label-5

    Description

      The current Arrow version in native-toolchain is 4.0.0 which doesn't support reading decimal from JSON yet. The JSON decimal support is added since arrow-6.0.0.

      Now the latest Arrow release is 10.0.0. However, it mandates C++ 17, which leads to compile errors with Impala (e.g. std::string_view undefined). So the highest version we can try is 9.0.0.

      We also need these two fixes:

      eec94ff40 ARROW-17847: [C++] Support unquoted decimal in JSON parser (#14242)
      289e0c92d ARROW-17995: [C++] Fix json decimals not being rescaled based on the explicit schema (#14380)

      So the version is 9.0.0-p2.

      Attachments

        Issue Links

          Activity

            People

              stigahuang Quanlong Huang
              stigahuang Quanlong Huang
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: