Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-9660

KAFKA-1 build a kafka-exporter by java

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.10.2.0, 1.1.0, 2.0.0
    • Fix Version/s: None
    • Component/s: admin, metrics
    • Labels:
    • Environment:
      java8+
    • Flags:
      Important

      Description

      KIP-575
      kafka is an excellent MQ running on JVM,  but no exporters JVMly. for a better future of  Kafka-Ecosystems
      the Apache needs a formal exporter like https://github.com/apache/kafka-exporter.
      i wrote one for working, and hope to give to Apache. there are a lot of metric in JMX, it can be configed in the exporter-config.
       
      if you are interested in it , join me!
      if you are interested in it , join me!
      if you are interested in it , join me!
       
      for some metric list here:
      kafka_AddPartitionsToTxn_50thPercentile
      kafka_AddPartitionsToTxn_95thPercentile
      kafka_AddPartitionsToTxn_999thPercentile
      kafka_AddPartitionsToTxn_99thPercentile
      kafka_AddPartitionsToTxn_Count
      kafka_AddPartitionsToTxn_Max
      kafka_AddPartitionsToTxn_Mean
      kafka_AddPartitionsToTxn_MeanRate
      kafka_AddPartitionsToTxn_Min
      kafka_AddPartitionsToTxn_OneMinuteRate
      kafka_AddPartitionsToTxn_StdDev
      kafka_BrokerTopicMetrics_BytesInPerSec_Count
      kafka_BrokerTopicMetrics_BytesInPerSec_MeanRate
      kafka_BrokerTopicMetrics_BytesInPerSec_OneMinuteRate
      kafka_BrokerTopicMetrics_BytesOutPerSec_Count
      kafka_BrokerTopicMetrics_BytesOutPerSec_MeanRate
      kafka_BrokerTopicMetrics_BytesOutPerSec_OneMinuteRate
      kafka_BrokerTopicMetrics_BytesRejectedPerSec_Count
      kafka_BrokerTopicMetrics_BytesRejectedPerSec_MeanRate
      kafka_BrokerTopicMetrics_BytesRejectedPerSec_OneMinuteRate
      kafka_BrokerTopicMetrics_FailedFetchRequestsPerSec_Count
      kafka_BrokerTopicMetrics_FailedFetchRequestsPerSec_MeanRate
      kafka_BrokerTopicMetrics_FailedFetchRequestsPerSec_OneMinuteRate
      kafka_BrokerTopicMetrics_FailedProduceRequestsPerSec_Count
      kafka_BrokerTopicMetrics_FailedProduceRequestsPerSec_MeanRate
      kafka_BrokerTopicMetrics_FailedProduceRequestsPerSec_OneMinuteRate
      kafka_BrokerTopicMetrics_MessagesInPerSec_Count
      kafka_BrokerTopicMetrics_MessagesInPerSec_MeanRate
      kafka_BrokerTopicMetrics_MessagesInPerSec_OneMinuteRate
      kafka_BrokerTopicMetrics_ProduceMessageConversionsPerSec_Count
      kafka_BrokerTopicMetrics_ProduceMessageConversionsPerSec_MeanRate
      kafka_BrokerTopicMetrics_ProduceMessageConversionsPerSec_OneMinuteRate
      kafka_BrokerTopicMetrics_ReplicationBytesInPerSec_Count
      kafka_BrokerTopicMetrics_ReplicationBytesInPerSec_MeanRate
      kafka_BrokerTopicMetrics_ReplicationBytesInPerSec_OneMinuteRate
      kafka_BrokerTopicMetrics_ReplicationBytesOutPerSec_Count
      kafka_BrokerTopicMetrics_ReplicationBytesOutPerSec_MeanRate
      kafka_BrokerTopicMetrics_ReplicationBytesOutPerSec_OneMinuteRate
      kafka_BrokerTopicMetrics_TotalFetchRequestsPerSec_Count
      kafka_BrokerTopicMetrics_TotalFetchRequestsPerSec_MeanRate
      kafka_BrokerTopicMetrics_TotalFetchRequestsPerSec_OneMinuteRate
      kafka_BrokerTopicMetrics_TotalProduceRequestsPerSec_Count
      kafka_BrokerTopicMetrics_TotalProduceRequestsPerSec_MeanRate
      kafka_BrokerTopicMetrics_TotalProduceRequestsPerSec_OneMinuteRate
      kafka_BytesInPerSec_Count
      kafka_BytesInPerSec_FifteenMinuteRate
      kafka_BytesInPerSec_FiveMinuteRate
      kafka_BytesInPerSec_MeanRate
      kafka_BytesInPerSec_OneMinuteRate
      kafka_BytesOutPerSec_Count
      kafka_BytesOutPerSec_FifteenMinuteRate
      kafka_BytesOutPerSec_FiveMinuteRate
      kafka_BytesOutPerSec_MeanRate
      kafka_BytesOutPerSec_OneMinuteRate
      kafka_BytesRejectedPerSec_Count
      kafka_BytesRejectedPerSec_FifteenMinuteRate
      kafka_BytesRejectedPerSec_FiveMinuteRate
      kafka_BytesRejectedPerSec_MeanRate
      kafka_BytesRejectedPerSec_OneMinuteRate
      kafka_CreatePartitions_50thPercentile
      kafka_CreatePartitions_95thPercentile
      kafka_CreatePartitions_999thPercentile
      kafka_CreatePartitions_99thPercentile
      kafka_CreatePartitions_Count
      kafka_CreatePartitions_Max
      kafka_CreatePartitions_Mean
      kafka_CreatePartitions_MeanRate
      kafka_CreatePartitions_Min
      kafka_CreatePartitions_OneMinuteRate
      kafka_CreatePartitions_StdDev
      kafka_CreateTopics_50thPercentile
      kafka_CreateTopics_95thPercentile
      kafka_CreateTopics_999thPercentile
      kafka_CreateTopics_99thPercentile
      kafka_CreateTopics_Count
      kafka_CreateTopics_Max
      kafka_CreateTopics_Mean
      kafka_CreateTopics_MeanRate
      kafka_CreateTopics_Min
      kafka_CreateTopics_OneMinuteRate
      kafka_CreateTopics_StdDev
      kafka_DeleteGroups_50thPercentile
      kafka_DeleteGroups_95thPercentile
      kafka_DeleteGroups_999thPercentile
      kafka_DeleteGroups_99thPercentile
      kafka_DeleteGroups_Count
      kafka_DeleteGroups_Max
      kafka_DeleteGroups_Mean
      kafka_DeleteGroups_Min
      kafka_DeleteGroups_StdDev
      kafka_DeleteTopics_50thPercentile
      kafka_DeleteTopics_95thPercentile
      kafka_DeleteTopics_999thPercentile
      kafka_DeleteTopics_99thPercentile
      kafka_DeleteTopics_Count
      kafka_DeleteTopics_Max
      kafka_DeleteTopics_Mean
      kafka_DeleteTopics_MeanRate
      kafka_DeleteTopics_Min
      kafka_DeleteTopics_OneMinuteRate
      kafka_DeleteTopics_StdDev
      kafka_DescribeGroups_50thPercentile
      kafka_DescribeGroups_95thPercentile
      kafka_DescribeGroups_999thPercentile
      kafka_DescribeGroups_99thPercentile
      kafka_DescribeGroups_Count
      kafka_DescribeGroups_Max
      kafka_DescribeGroups_Mean
      kafka_DescribeGroups_MeanRate
      kafka_DescribeGroups_Min
      kafka_DescribeGroups_OneMinuteRate
      kafka_DescribeGroups_StdDev
      kafka_FailedFetchRequestsPerSec_Count
      kafka_FailedFetchRequestsPerSec_FifteenMinuteRate
      kafka_FailedFetchRequestsPerSec_FiveMinuteRate
      kafka_FailedFetchRequestsPerSec_MeanRate
      kafka_FailedFetchRequestsPerSec_OneMinuteRate
      kafka_FailedProduceRequestsPerSec_Count
      kafka_FailedProduceRequestsPerSec_FifteenMinuteRate
      kafka_FailedProduceRequestsPerSec_FiveMinuteRate
      kafka_FailedProduceRequestsPerSec_MeanRate
      kafka_FailedProduceRequestsPerSec_OneMinuteRate
      kafka_FetchConsumer_50thPercentile
      kafka_FetchConsumer_95thPercentile
      kafka_FetchConsumer_999thPercentile
      kafka_FetchConsumer_99thPercentile
      kafka_FetchConsumer_Count
      kafka_FetchConsumer_Max
      kafka_FetchConsumer_Mean
      kafka_FetchConsumer_MeanRate
      kafka_FetchConsumer_Min
      kafka_FetchConsumer_OneMinuteRate
      kafka_FetchConsumer_StdDev
      kafka_FetchFollower_50thPercentile
      kafka_FetchFollower_95thPercentile
      kafka_FetchFollower_999thPercentile
      kafka_FetchFollower_99thPercentile
      kafka_FetchFollower_Count
      kafka_FetchFollower_Max
      kafka_FetchFollower_Mean
      kafka_FetchFollower_MeanRate
      kafka_FetchFollower_Min
      kafka_FetchFollower_OneMinuteRate
      kafka_FetchFollower_StdDev
      kafka_FetchMessageConversionsPerSec_Count
      kafka_FetchMessageConversionsPerSec_FifteenMinuteRate
      kafka_FetchMessageConversionsPerSec_FiveMinuteRate
      kafka_FetchMessageConversionsPerSec_MeanRate
      kafka_FetchMessageConversionsPerSec_OneMinuteRate
      kafka_Fetch_50thPercentile
      kafka_Fetch_95thPercentile
      kafka_Fetch_999thPercentile
      kafka_Fetch_99thPercentile
      kafka_Fetch_Count
      kafka_Fetch_Max
      kafka_Fetch_Mean
      kafka_Fetch_MeanRate
      kafka_Fetch_Min
      kafka_Fetch_OneMinuteRate
      kafka_Fetch_StdDev
      kafka_FindCoordinator_50thPercentile
      kafka_FindCoordinator_95thPercentile
      kafka_FindCoordinator_999thPercentile
      kafka_FindCoordinator_99thPercentile
      kafka_FindCoordinator_Count
      kafka_FindCoordinator_Max
      kafka_FindCoordinator_Mean
      kafka_FindCoordinator_MeanRate
      kafka_FindCoordinator_Min
      kafka_FindCoordinator_OneMinuteRate
      kafka_FindCoordinator_StdDev
      kafka_G1_Old_Generation_CollectionCount
      kafka_G1_Old_Generation_CollectionTime
      kafka_G1_Young_Generation_CollectionCount
      kafka_G1_Young_Generation_CollectionTime
      kafka_GarbageCollector_G1_Old_Generation_CollectionCount
      kafka_GarbageCollector_G1_Old_Generation_CollectionTime
      kafka_GarbageCollector_G1_Young_Generation_CollectionCount
      kafka_GarbageCollector_G1_Young_Generation_CollectionTime
      kafka_Heartbeat_50thPercentile
      kafka_Heartbeat_95thPercentile
      kafka_Heartbeat_999thPercentile
      kafka_Heartbeat_99thPercentile
      kafka_Heartbeat_Count
      kafka_Heartbeat_Max
      kafka_Heartbeat_Mean
      kafka_Heartbeat_MeanRate
      kafka_Heartbeat_Min
      kafka_Heartbeat_OneMinuteRate
      kafka_Heartbeat_StdDev
      kafka_JoinGroup_50thPercentile
      kafka_JoinGroup_95thPercentile
      kafka_JoinGroup_999thPercentile
      kafka_JoinGroup_99thPercentile
      kafka_JoinGroup_Count
      kafka_JoinGroup_Max
      kafka_JoinGroup_Mean
      kafka_JoinGroup_MeanRate
      kafka_JoinGroup_Min
      kafka_JoinGroup_OneMinuteRate
      kafka_JoinGroup_StdDev
      kafka_KafkaRequestHandlerPool_RequestHandlerAvgIdlePercent_Count
      kafka_KafkaRequestHandlerPool_RequestHandlerAvgIdlePercent_MeanRate
      kafka_KafkaRequestHandlerPool_RequestHandlerAvgIdlePercent_OneMinuteRate
      kafka_LeaderAndIsr_50thPercentile
      kafka_LeaderAndIsr_95thPercentile
      kafka_LeaderAndIsr_999thPercentile
      kafka_LeaderAndIsr_99thPercentile
      kafka_LeaderAndIsr_Count
      kafka_LeaderAndIsr_Max
      kafka_LeaderAndIsr_Mean
      kafka_LeaderAndIsr_MeanRate
      kafka_LeaderAndIsr_Min
      kafka_LeaderAndIsr_OneMinuteRate
      kafka_LeaderAndIsr_StdDev
      kafka_LeaveGroup_50thPercentile
      kafka_LeaveGroup_95thPercentile
      kafka_LeaveGroup_999thPercentile
      kafka_LeaveGroup_99thPercentile
      kafka_LeaveGroup_Count
      kafka_LeaveGroup_Max
      kafka_LeaveGroup_Mean
      kafka_LeaveGroup_MeanRate
      kafka_LeaveGroup_Min
      kafka_LeaveGroup_OneMinuteRate
      kafka_LeaveGroup_StdDev
      kafka_ListGroups_50thPercentile
      kafka_ListGroups_95thPercentile
      kafka_ListGroups_999thPercentile
      kafka_ListGroups_99thPercentile
      kafka_ListGroups_Count
      kafka_ListGroups_Max
      kafka_ListGroups_Mean
      kafka_ListGroups_MeanRate
      kafka_ListGroups_Min
      kafka_ListGroups_OneMinuteRate
      kafka_ListGroups_StdDev
      kafka_ListOffsets_50thPercentile
      kafka_ListOffsets_95thPercentile
      kafka_ListOffsets_999thPercentile
      kafka_ListOffsets_99thPercentile
      kafka_ListOffsets_Count
      kafka_ListOffsets_Max
      kafka_ListOffsets_Mean
      kafka_ListOffsets_MeanRate
      kafka_ListOffsets_Min
      kafka_ListOffsets_OneMinuteRate
      kafka_ListOffsets_StdDev
      kafka_MessagesInPerSec_Count
      kafka_MessagesInPerSec_FifteenMinuteRate
      kafka_MessagesInPerSec_FiveMinuteRate
      kafka_MessagesInPerSec_MeanRate
      kafka_MessagesInPerSec_OneMinuteRate
      kafka_Metadata_50thPercentile
      kafka_Metadata_95thPercentile
      kafka_Metadata_999thPercentile
      kafka_Metadata_99thPercentile
      kafka_Metadata_Count
      kafka_Metadata_Max
      kafka_Metadata_Mean
      kafka_Metadata_MeanRate
      kafka_Metadata_Min
      kafka_Metadata_OneMinuteRate
      kafka_Metadata_StdDev
      kafka_OffsetCommit_50thPercentile
      kafka_OffsetCommit_95thPercentile
      kafka_OffsetCommit_999thPercentile
      kafka_OffsetCommit_99thPercentile
      kafka_OffsetCommit_Count
      kafka_OffsetCommit_Max
      kafka_OffsetCommit_Mean
      kafka_OffsetCommit_MeanRate
      kafka_OffsetCommit_Min
      kafka_OffsetCommit_OneMinuteRate
      kafka_OffsetCommit_StdDev
      kafka_OffsetFetch_50thPercentile
      kafka_OffsetFetch_95thPercentile
      kafka_OffsetFetch_999thPercentile
      kafka_OffsetFetch_99thPercentile
      kafka_OffsetFetch_Count
      kafka_OffsetFetch_Max
      kafka_OffsetFetch_Mean
      kafka_OffsetFetch_MeanRate
      kafka_OffsetFetch_Min
      kafka_OffsetFetch_OneMinuteRate
      kafka_OffsetFetch_StdDev
      kafka_ProduceMessageConversionsPerSec_Count
      kafka_ProduceMessageConversionsPerSec_FifteenMinuteRate
      kafka_ProduceMessageConversionsPerSec_FiveMinuteRate
      kafka_ProduceMessageConversionsPerSec_MeanRate
      kafka_ProduceMessageConversionsPerSec_OneMinuteRate
      kafka_Produce_50thPercentile
      kafka_Produce_95thPercentile
      kafka_Produce_999thPercentile
      kafka_Produce_99thPercentile
      kafka_Produce_Count
      kafka_Produce_Max
      kafka_Produce_Mean
      kafka_Produce_MeanRate
      kafka_Produce_Min
      kafka_Produce_OneMinuteRate
      kafka_Produce_StdDev
      kafka_ReplicationBytesInPerSec_Count
      kafka_ReplicationBytesInPerSec_FifteenMinuteRate
      kafka_ReplicationBytesInPerSec_FiveMinuteRate
      kafka_ReplicationBytesInPerSec_MeanRate
      kafka_ReplicationBytesInPerSec_OneMinuteRate
      kafka_ReplicationBytesOutPerSec_Count
      kafka_ReplicationBytesOutPerSec_FifteenMinuteRate
      kafka_ReplicationBytesOutPerSec_FiveMinuteRate
      kafka_ReplicationBytesOutPerSec_MeanRate
      kafka_ReplicationBytesOutPerSec_OneMinuteRate
      kafka_RequestChannel_RequestQueueSize_Value
      kafka_RequestChannel_ResponseQueueSize_Value
      kafka_RequestMetrics_RequestsPerSec_Count
      kafka_RequestMetrics_RequestsPerSec_MeanRate
      kafka_RequestMetrics_RequestsPerSec_OneMinuteRate
      kafka_SocketServer_MemoryPoolAvailable_Value
      kafka_SocketServer_MemoryPoolUsed_Value
      kafka_SocketServer_NetworkProcessorAvgIdlePercent_Value
      kafka_SyncGroup_50thPercentile
      kafka_SyncGroup_95thPercentile
      kafka_SyncGroup_999thPercentile
      kafka_SyncGroup_99thPercentile
      kafka_SyncGroup_Count
      kafka_SyncGroup_Max
      kafka_SyncGroup_Mean
      kafka_SyncGroup_MeanRate
      kafka_SyncGroup_Min
      kafka_SyncGroup_OneMinuteRate
      kafka_SyncGroup_StdDev
      kafka_ThreadCount
      kafka_Threading_CurrentThreadCpuTime
      kafka_Threading_CurrentThreadUserTime
      kafka_Threading_DaemonThreadCount
      kafka_Threading_PeakThreadCount
      kafka_Threading_ThreadCount
      kafka_Threading_TotalStartedThreadCount
      kafka_TotalFetchRequestsPerSec_Count
      kafka_TotalFetchRequestsPerSec_FifteenMinuteRate
      kafka_TotalFetchRequestsPerSec_FiveMinuteRate
      kafka_TotalFetchRequestsPerSec_MeanRate
      kafka_TotalFetchRequestsPerSec_OneMinuteRate
      kafka_TotalProduceRequestsPerSec_Count
      kafka_TotalProduceRequestsPerSec_FifteenMinuteRate
      kafka_TotalProduceRequestsPerSec_FiveMinuteRate
      kafka_TotalProduceRequestsPerSec_MeanRate
      kafka_TotalProduceRequestsPerSec_OneMinuteRate
      kafka_UpdateMetadata_50thPercentile
      kafka_UpdateMetadata_95thPercentile
      kafka_UpdateMetadata_999thPercentile
      kafka_UpdateMetadata_99thPercentile
      kafka_UpdateMetadata_Count
      kafka_UpdateMetadata_Max
      kafka_UpdateMetadata_Mean
      kafka_UpdateMetadata_MeanRate
      kafka_UpdateMetadata_Min
      kafka_UpdateMetadata_OneMinuteRate
      kafka_UpdateMetadata_StdDev
      kafka_consumer_lag

        Attachments

          Activity

            People

            • Assignee:
              sujayopensource Sujay Hegde
              Reporter:
              youlixishi francis lee
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated: