[BIGTOP-2072] Add OpenZipkin integration to Bigtop

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.1.0
• Assignee: Unassigned
• Reporter: Andrew Kyle Purtell
• Created: 25/Sep/15 01:48
• Updated: 25/Sep/15 10:26

Description

Twitter recently relaunched Zipkin as Open Zipkin (https://github.com/openzipkin). Zipkin is a Dapper-inspired distributed tracing framework with some strong integration points with the Hadoop ecosystem and much of Bigtop, including:

• Support (in HTrace) for sending spans from Hadoop, HBase, and Phoenix to a Zipkin span receiver
• HBase storage back end for Zipkin: https://github.com/openzipkin/zipkin-hbase
• Hadoop job that aggregates Zipkin spans for the UI: https://github.com/openzipkin/zipkin-dependencies-hadoop
• Integrated Kafka receiver: https://github.com/openzipkin/zipkin
• Flume sink that supports sending Zipkin spans to the Zipkin collector: https://github.com/openzipkin/flume-zipkin-collector-sink

As far as I know everything is licensed with the ASL v2.

Core Zipkin artifacts are available in Maven central: http://search.maven.org/#search%7Cga%7C1%7Czipkin

This issue is to investigate the feasibility of aligning HTrace, Hadoop, HBase, etc. with Zipkin in the Bigtop context to provide integrated distributed tracing.