[BIGTOP-669] Add DataFu to Bigtop distribution

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.4.0
• Fix Version/s: 0.4.0, 0.5.0
• Component/s: general
• Assignee: Roman Shaposhnik
• Reporter: Roman Shaposhnik
• Created: 05/Jul/12 17:07
• Updated: 21/Jun/13 23:55
• Resolved: 09/Jul/12 22:10

Description

DataFu is a collection of user-defined functions for working with large-scale data in Hadoop and Pig. This library was born out of the need for a stable, well-tested library of UDFs for data mining and statistics. It is used at LinkedIn in many of our off-line workflows for data derived products like "People You May Know" and "Skills".

DataFu is available under the Apache License v2 from their GitHub project page: https://github.com/linkedin/datafu

The latest release of DataFu is: 0.0.4

Note: this will also open up a possibility for Bigtop to start collecting custom UDF implementations for other projects like Hive, etc. For now, I simply propose and extra package called pig-udf-datafu