[IMPALA-3447] Make convert_legacy_hive_parquet_utc_timestamps automatic

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: Impala 2.5.0
• Component/s: Backend
• Assignee: Unassigned
• Reporter: Marcell Szabo
• Created: 28/Apr/16 13:33
• Updated: 29/Apr/16 02:03
• Resolved: 29/Apr/16 02:03

Description

Follow up of the problem documented in IMPALA-1658:
Now the admin has the chance to solve the incompatibility with the convert_legacy_hive_parquet_utc_timestamps switch.
But he still needs to realize, understand the problem and plan the solution carefully.

This JIRA requests Impala to automagically solve the problem without the user even knowing. Or at least warn the user about the potential problem. E.g. flag the schema if the timestamp is local timezone. Upon finding unflagged schemas, warn, or automatically convert.

Issue Links

• is blocked by: IMPALA-1658 Add a compatibility option for reading parquet timestamps written by Hive