Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-3050

add counters for error conditions and expose to monitor URL

    XMLWordPrintableJSON

    Details

      Description

      currently error counters are not present when getting stats. for example:

       > curl http://my-flume-host:44444/metrics
      {"SINK.k1":{"ConnectionCreatedCount":"1","ConnectionClosedCount":"0","Type":"SINK","BatchCompleteCount":"0","BatchEmptyCount":"4","EventDrainAttemptCount":"10","StartTime":"1485348138992","EventDrainSuccessCount":"10","BatchUnderflowCount":"1","StopTime":"0","ConnectionFailedCount":"0"},"CHANNEL.c1":{"ChannelCapacity":"1000000","ChannelFillPercentage":"0.0","Type":"CHANNEL","ChannelSize":"0","EventTakeSuccessCount":"10","EventTakeAttemptCount":"15","StartTime":"1485348138990","EventPutAttemptCount":"10","EventPutSuccessCount":"10","StopTime":"0"},"SOURCE.r1":{"EventReceivedCount":"10","AppendBatchAcceptedCount":"0","Type":"SOURCE","AppendReceivedCount":"0","EventAcceptedCount":"10","StartTime":"1485348138993","AppendAcceptedCount":"0","OpenConnectionCount":"0","AppendBatchReceivedCount":"0","StopTime":"0"}}
      

      return only "good" stats for source, channel and sink.
      to get error you need to look into the log file. this makes it hard to integrate flume into automatic monitoring systems, NMS etc.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                emajor Endre Major
                Reporter:
                yuvalif Yuval Lifshitz
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: