Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-8120 Umbrella JIRA tracking Parquet improvements
  3. HIVE-12069

Hive cannot read Parquet decimals backed by INT32 or INT64

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 1.2.1
    • None
    • None
    • None

    Description

      According to the DECIMAL section of parquet-format spec, low precision Parquet decimals can be written as INT32 or INT64 for better storage and query efficiency. However, currently Hive only recognizes decimals backed by binaries (either BINARY or FIXED_LEN_BYTE_ARRAY).

      We can improve this by providing a more general PrimitiveConverter here.

      Attachments

        Issue Links

          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-21987 Hive is unable to read Parquet int32 annotated with decimal

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              lian cheng Cheng Lian
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: