[FLUME-126] Sample Code Conribution: Flume HBase Statistics Sink

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Assignee: Unassigned
• Reporter: Disabled imported user
• Created: 09/Aug/10 15:25
• Updated: 03/Jul/11 00:07
• Resolved: 03/Jul/11 00:07

Description

Here is some sample source code I wrote at this month's hackathon - the HBaseIncrementerSink listens for Twitter feeds and for each bigram in such a feed, it updates a compound HBase key date/bigram, it also updates a summary count of events by date. The HBaseStatsServer provides a simple server that lets a webapp query the resulting HBase information, returning JSON data for the event counts and bigram counts for all time (it could be expanded to accept a time range query). This worked with a version of Flume that included Pat Hunt's inclusion of HBase suppport.

This could be a start on other more general/other Flume sink support for HBase.

Issue Links

• relates to: FLUME-6 Add HBase Sink