[HIVE-126] Don't fetch information on Partitions from HDFS instead of MetaStore

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.3.0
• Component/s: Metastore
• Hadoop Flags: Reviewed

Release Note

HIVE-126. Don't fetch information on Partitions from HDFS instead of MetaStore. (Johan Oskarsson via zshao).

• Assignee: Johan Oskarsson
• Reporter: Johan Oskarsson
• Created: 05/Dec/08 16:57
• Updated: 17/Dec/11 00:09
• Resolved: 15/Jan/09 08:15

Description

When investigating HIVE-91 an issue came up where the information on what partitions a table contains is loaded by listing the directories in the table directory on HDFS. This is then used to overrule what is in the MetaStore if any difference is found.

• Would it not be preferable if MetaStore is the one authority on what the table contains?
• It will also be a major hassle (or impossible?) to retrieve this information from HDFS with external tables that have non standard partition names (HIVE-91), such as: table/2008/01/08/portugal where "2008/01/08" is one partition value and "portugal" is another.

Issue Links

• blocks: HIVE-91 Allow external tables with different partition directory structure