[SPARK-15334] HiveClient facade not compatible with Hive 0.12

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Assignee: Xiang Zhong
• Reporter: Sean Zhong
• Created: 15/May/16 22:16
• Updated: 18/May/16 09:06
• Resolved: 18/May/16 08:04

Description

Compatibility issues:
1. org.apache.spark.sql.hive.client.HiveClientImpl use AddPartitionDesc(db, table, ignoreIfExists) to create partitions, while Hive 0.12 doesn't have this constructor for AddPartitionDesc.
2. HiveClientImpl uses PartitionDropOptions when dropping partition, however, PartitionDropOptions doesn't exist in Hive 0.12.
3. Hive 0.12 doesn't support adding permanent functions. It is not valid to call "org.apache.hadoop.hive.ql.metadata.Hive.createFunction", "org.apache.hadoop.hive.ql.metadata.Hive.alterFunction", and "org.apache.hadoop.hive.ql.metadata.Hive.alterFunction"
4. org.apache.spark.sql.hive.client.HiveClient doesn't have enough test coverage.

Issue Links

• links to: [Github] Pull Request #13127 (clockfly)
• links to: [Github] Pull Request #13166 (liancheng)