Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-6856

Support MQTT consumer groups

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 1.11.0
    • 1.12.0, 1.11.4
    • None
    • None

    Description

      Multiple MQTT brokers including HiveMQ and EMQX support MQTT consumer groups, which provide a way of horizontally scaling and load balancing MQTT consumers. This feature is built on the MQTTv5 protocol but all the logic is handled server side, so any MQTT client can take advantage of these features: https://docs.emqx.io/tutorial/v3/en/advanced/share_subscribe.html.

      Right now ConsumeMQTT cannot take advantage of this horizontal scaling because client ID is required and does not support expression language. Making the client id optional and defaulting to a uuid along with adding a group id field that sets the consumer to join the consumer group would open up the ability to take advantage of these broker features.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              2514millerj Justin Miller
              Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 50m
                  50m