Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-9385

Orc scanner does UTC->local conversion if use_local_tz_for_unix_timestamp_conversions=1

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: Impala 3.4.0
    • Component/s: Backend
    • Labels:
    • Epic Color:
      ghx-label-12

      Description

      https://github.com/apache/impala/blob/cad156181b29b7897fb2366bd621f2349c090e20/be/src/exec/orc-column-readers.cc#L195

      Orc scanner uses TimestampValue::FromUnixTimeNanos() to convert sec + nano representation to Impala's TimestampValue (day + nano). That function is affected by flag use_local_tz_for_unix_timestamp_conversions, while that global option should not affect Orc (Parquet has its own related flag convert_legacy_hive_parquet_utc_timestamps, I hope we won't need such hacks for Orc).

        Attachments

          Activity

            People

            • Assignee:
              csringhofer Csaba Ringhofer
              Reporter:
              csringhofer Csaba Ringhofer
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: