Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-2648

Kafka spout can't show acks/fails and complete latency when auto commit is enabled

    XMLWordPrintableJSON

Details

    Description

      The storm-kafka-client spout currently emits tuples with no message ids if auto commit is enabled. This causes the ack/fail/complete latency counters in Storm UI to be 0. In some cases this is desirable because the user may not care, and doesn't want the overhead of Storm tracking tuples. avermeerbergen expressed a desire to be able to use auto commit without these counters being disabled, presumably to monitor topology performance.

      We should add a toggle that allows users to enable/disable tuple anchoring in the auto commit case.

      Attachments

        Issue Links

          Activity

            People

              srdo Stig Rohde Døssing
              srdo Stig Rohde Døssing
              Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 3.5h
                  3.5h