[PARQUET-352] Add tags to "created by" metadata in the file footer

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.9.0, 1.8.2
• Component/s: parquet-mr
• Assignee: Ryan Blue
• Reporter: Ryan Blue
• Created: 30/Jul/15 16:55
• Updated: 23/Jun/24 03:27
• Resolved: 08/Dec/15 18:16

Description

Hive has been writing timestamp (without time zone) data incorrectly by converting a timestamp with no time zone to UTC. There is no way to know that Hive definitely wrote the files, so it is difficult to add a recovery mechanism in the object model. Adding a tag for the object model to the "created by" metadata will allow us to detect situations like this in the future.

Issue Links

• blocks: PARQUET-392 Release Parquet-mr 1.9.0
• is duplicated by: PARQUET-899 Add metadata field describing the application that wrote the file
• links to: PR #289