Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-9385

Orc scanner does UTC->local conversion if use_local_tz_for_unix_timestamp_conversions=1

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • Impala 3.4.0
    • Backend
    • ghx-label-12

    Description

      https://github.com/apache/impala/blob/cad156181b29b7897fb2366bd621f2349c090e20/be/src/exec/orc-column-readers.cc#L195

      Orc scanner uses TimestampValue::FromUnixTimeNanos() to convert sec + nano representation to Impala's TimestampValue (day + nano). That function is affected by flag use_local_tz_for_unix_timestamp_conversions, while that global option should not affect Orc (Parquet has its own related flag convert_legacy_hive_parquet_utc_timestamps, I hope we won't need such hacks for Orc).

      Attachments

        Activity

          People

            csringhofer Csaba Ringhofer
            csringhofer Csaba Ringhofer
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: