[BIGTOP-1270] BigPetStore: Productionize the Hive portion

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: backlog
• Component/s: blueprints
• Assignee: Unassigned
• Reporter: jay vyas
• Created: 16/Apr/14 10:13
• Updated: 18/Jul/14 02:49
• Resolved: 30/May/14 15:20

Description

The hive portion of the BigPetStore blueprint app builds a "view" over the cleaned data that Mahout can then use to do product recommendations.

The hive code in bigpetstore only runs locally - lets add the necessary configuration hooks and/or (if we have to) externalize the hive script itself from java so that its easy to run directly on a cluster.

And lets actually run it on some kind of a cluster at scale. The contract for the hive portion is an output file with three numbers like this:

100 30021 1
100 212341 1
...

Signifying that customer=100 likes both of the products "30021" and "212341".

Issue Links

• is blocked by: BIGTOP-1379 Remove eclipse build dependency and deploy CI for bigtpetstore
• is blocked by: BIGTOP-1269 BigPetStore: Create build w/ gradle
• is related to: BIGTOP-1272 BigPetStore: Productionize the Mahout recommender
• is related to: HIVE-7115 Support a mechanism for running hive locally that doesnt require having a hadoop executable.