Uploaded image for project: 'Camel'
  1. Camel
  2. CAMEL-11224

aws-sqs producer does not support new FIFO queues

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.21.0
    • Component/s: camel-aws
    • Labels:
      None
    • Estimated Complexity:
      Unknown

      Description

      At the moment aws-sqs producer does not support the new FIFO queue mechanism from AWS (FIFO-queues ref). There is a new parameter, MessageGroupId, that is required for FIFO queues (it is not available on Standard queues).

      The message group ID is the tag that specifies that a message belongs to a specific message group. Messages that belong to the same message group are always processed one by one, in a strict order relative to the message group (however, messages that belong to different message groups might be processed out of order). Source: http://docs.aws.amazon.com/AWSSimpleQueueService/latest/SQSDeveloperGuide/FIFO-queue-recommendations.html#using-messagegroupid-property.

      This improvement consists on adding support for MessageGroupId on the producer side of aws-sqs. It should be applicable on FIFO queues only. It could be customizable via URI options. A default strategy should be provided. This default strategy will generate a unique message group ID for each message to favor throughput and latency over ordering of messages.

        Attachments

          Activity

            People

            • Assignee:
              davsclaus Claus Ibsen
              Reporter:
              ecorengia Emilio Corengia
            • Votes:
              2 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: