Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-1658

Add a compatibility option for reading parquet timestamps written by Hive

    XMLWordPrintableJSON

Details

    • Task
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • Impala 2.0
    • Impala 2.2
    • None
    • None

    Description

      Hive converts timestamp to and from UTC when reading and writing to parquet files. This is inconsistent with other file formats and not what Impala does. To provide compatibility with Hive we should add a flag or query option that adjusts for the Hive behavior.

      Attachments

        Issue Links

          blocks

          New Feature - A new feature of the product, which has yet to be developed. IMPALA-3447 Make convert_legacy_hive_parquet_utc_timestamps automatic

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-3316 convert_legacy_hive_parquet_utc_timestamps=true makes reading parquet tables 30x slower

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              caseyc casey
              caseyc casey
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: