[FLUME-1183] Implement an HBase Sink which supports table level access

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.2.0
• Fix Version/s: 1.2.0
• Component/s: Sinks+Sources
• Assignee: Hari Shreedharan
• Reporter: Hari Shreedharan
• Created: 06/May/12 08:56
• Updated: 22/May/12 08:38
• Resolved: 15/May/12 19:09

Description

This is what I intend to do:

• Insert the row key from event headers. Pick the column family and column from configuration, not from headers.
• Allow configuration to specify default for row key. If no row key exists in header, then take the default value from the configuration. I don't want to dump everything into the table with the same row key.
• I don't intend to support multiple tables, column families or columns in the same sink. We can use multiplexing channel selector to use different sinks for different tables/columns.

I know the existence of another jira for porting the HBase sink from OG, but didn't see any activity for a while on that.

Issue Links

• blocks: FLUME-1203 Hbase Sink needs to check for partial failures.
• blocks: FLUME-1204 Add more unit tests for hbase sink
• is duplicated by: FLUME-888 Port Hbase Sink from OG