Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3892

qgen: make correctness triaging either by running impala with -convert_legacy_hive_parquet_utc_timestamps=true

    XMLWordPrintableJSON

    Details

    • Type: Task
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: Impala 2.7.0
    • Fix Version/s: Impala 2.7.0
    • Component/s: Infrastructure
    • Labels:
      None

      Description

      Being relatively new, I was triaging query generator correctness discrepancies and came across a problem in which some timestamp columns had different hours in Impala vs. Postgres. Taras helpfully pointed out this was a known issue, fixed via -convert_legacy_hive_parquet_utc_timestamps=true.

      While we can debate about how to properly load the data or other strategies, let's reduce false positive correctness issues and run Impala in the query generator with -convert_legacy_hive_parquet_utc_timestamps=true all the time.

        Attachments

          Activity

            People

            • Assignee:
              mikeb Michael Brown
              Reporter:
              mikeb Michael Brown
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: