[FALCON-96] Hive client to talk to the metastore

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.3
• Fix Version/s: 0.4
• Assignee: Venkatesh Seetharam
• Reporter: Venkatesh Seetharam
• Created: 22/Aug/13 17:10
• Updated: 11/Sep/13 03:41
• Resolved: 11/Sep/13 03:40

Description

There are 2 choices: RPC using thrift and HTTP using webhcat. HTTP of course is preferable but there are a few issues with it:

• Uses cli to talk to the server implying needing Hcat install and client. This is a PITA for integration-tests.
• Also, there is no java wrapper around the RESTful APIs which returns Map and such. Need to roll our own.
• Runs as a separate daemon (which should eventually fold into metastore or HiveServer2). However this is short-term and a minor annoyance.

Thoughts?

Issue Links

• blocks: FALCON-94 Retention to handle hive table eviction
• blocks: FALCON-102 Add integration tests for feed entity parser with table defined
• blocks: FALCON-103 Upgrade oozie to 4.0.x
• is blocked by: FALCON-87 Hive table integration with feed entity