[FLUME-1715] OpenTSDB Sink

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Sinks+Sources
• Assignee: Jayant Shekhar
• Reporter: Mike Percy
• Created: 15/Nov/12 19:58
• Updated: 13/Jan/15 23:29

Description

(Cloned from JIRA issue tracking OpenTSDB sink impl against Flume 0.9)

It would be useful to have an OpenTSDB sink for Flume 1.x. Since the protocol is a text-based TCP protocol, basically a netcat-type protocol, I don't see any concern about licensing issues (OpenTSDB is LGPL licensed).

A couple of ideas on an implementation:

• Have one mode that works "out of the box" where we assume that events sent to this sink are already fully formatted as OpenTSDB "put" queries. Then, this sink only really has to handle error conditions sent back from OpenTSDB, not serialization
• Have another mode where the user can do some serialization of arbitrary events as OpenTSDB queries. The rest of the logic remains the same as above.

More info: http://opentsdb.net/metrics.html

Not sure where the docs are on wire protocol error handling logic. I am pretty sure it uses a "no news is good news" policy, whereby it returns nothing on success, and sends some message back on error.

Issue Links

• is a clone of: FLUME-726 OpenTSDB Sink