[HIVE-6897] Allow overwrite/append to external Hive table (with partitions) via HCatStorer

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.12.0
• Component/s: HCatalog, HiveServer2
• Assignee: Unassigned
• Reporter: Dip Kharod
• Created: 11/Apr/14 20:11
• Updated: 14/Apr/16 16:38

Description

I'm using HCatStorer to write to external Hive table with partition from Pig and have the following different use cases:
1) Need to overwrite (aka, refresh) data into table: Currently I end up doing this outside (drop partition and delete HDFS folder) of Pig which is very painful and error-prone
2) Need to append (aka, add new file) data to the Hive external table/partition: Again, I end up doing this outside of Pig by copying file in appropriate folder
It would be very productive for the developers to have both options in HCatStorer.

Issue Links

• is related to: HIVE-6476 Support Append with Dynamic Partitioning
• is related to: HCATALOG-551 Provide ability to overwrite partitions when using HCatStorer