Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3447

Make convert_legacy_hive_parquet_utc_timestamps automatic

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: Impala 2.5.0
    • Fix Version/s: None
    • Component/s: Backend
    • Labels:
      None

      Description

      Follow up of the problem documented in IMPALA-1658:
      Now the admin has the chance to solve the incompatibility with the convert_legacy_hive_parquet_utc_timestamps switch.
      But he still needs to realize, understand the problem and plan the solution carefully.

      This JIRA requests Impala to automagically solve the problem without the user even knowing. Or at least warn the user about the potential problem. E.g. flag the schema if the timestamp is local timezone. Upon finding unflagged schemas, warn, or automatically convert.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                szama_impala_6295 Marcell Szabo
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: