Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-1269

Trace collection support

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Sinks+Sources

    Description

      In large-scale production environment across cross datacenters, there may be few clusters (for example, HDFS storage) collecting data from apps in multiple datacenters. For security reasons, most of the time flow goes through load-balancer and Ops/Admin requires visibility of RPC latency across WAN.

      Avro IPC supports trace collection [1], it would be good if we make it as configurable inside flume and stores metrics for further analysis.

      [1] Avro IPC trace collection

      Attachments

        Issue Links

          relates to

          Sub-task - The sub-task of the issue FLUME-748 Create metric collection infrastructure

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Activity

            People

              Unassigned Unassigned
              mubarakseyed Mubarak Seyed
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: