Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-7557

Optimize local time functions for the UTC case

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Backend
    • Epic Color:
      ghx-label-3

      Description

      Currently two flags decide whether to do UTZ->local timezone conversions

      • convert_legacy_hive_parquet_utc_timestamps
      • use_local_tz_for_unix_timestamp_conversions
        Enabling these global flags make Impala more compatible with Hive, but can highly degrade performance. Since IMPALA-7362, it is possible to override the local timezone with a query option. Setting timezone to UTC practically disables the flags above, but their overhead does not disappear completely. It would be relatively easy to create shortcuts for the UTC case to avoid this overhead.

      This could make it easier to choose the right values for the flags: both could be set to true, and users who want to avoid the performance impact could switch to UTC.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              csringhofer Csaba Ringhofer
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: