Uploaded image for project: 'HTrace'
  1. HTrace
  2. HTRACE-235

htrace-zipkin - add Kafka transport support

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 4.1
    • 4.1
    • zipkin
    • None
    • 4.1

    Description

      Currently htrace-zipkin writes to the Scribe Thrift endpoint. However, Scribe is pretty much dead (although this is just Thrift interface so doesn't really need Scribe).

      A Kafka receiver would likely be useful not only for htrace-zipkin, so I think it could live outside. The htrace-native would be harder to get working with Kafka as there no supported Kafka native client (perhaps this could be experimented with https://github.com/edenhill/librdkafka).

      Writing to Kafka would also be possible by having a service that translates from Scribe Thrift to Kafka messages, however it would be nice to get the Kafka producer semantics on the client side (e.g. sync, async, batch size, etc.). This will come at the cost of having the Kafka producer as a dependency (larger jar), though as well as have a more complex receiver (multiple threads from the Kafka producer).

      Attachments

        1. HTRACE-235.patch
          41 kB
          Cosmin Lehene
        2. HTRACE-235.5.patch
          55 kB
          Cosmin Lehene
        3. HTRACE-235.4.patch
          51 kB
          Cosmin Lehene
        4. HTRACE-235.2.patch
          51 kB
          Cosmin Lehene
        5. HTRACE-235.1.patch
          46 kB
          Cosmin Lehene

        Activity

          People

            clehene Cosmin Lehene
            clehene Cosmin Lehene
            Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: