Uploaded image for project: 'ActiveMQ Classic'
  1. ActiveMQ Classic
  2. AMQ-855

Add support for prefetchSize = 0

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 4.0, 4.0.1, 4.0.2
    • 4.1.0
    • Broker
    • None
    • any

    • Patch Available

    Description

      This feature would enable to support following test case:

      2 servers are processing 3 submitted jobs with following processing times 10 min, 1 min, 1 min. This sequence should finish in 10 minutes as one service will pick up the 10 minutes job, meanwhile the other one should manage the two 1 minute jobs. Since I cannot set prefetchSize=0, one of the 1 minute jobs is sitting in prefetch buffer and the jobs are processed in 11 minutes instead of 10.

      This is simplification of the real scenario where I have about 30 consumers submitting jobs to 20 consumers through AMQ 4.0.1. I have following problems:

      • Messages are sitting in prefetch buffer are not available to processors, which results in a lot of idle time.
      • Order of processing is random. For some reason Job # 20 is processed after Job # 1500. Since senders are synchronously blocked this can result in time-outs.
      • Some requests are real-time, i.e. there is a user waiting, so the system cannot wait, so AMQ-850 does not fix this issue.

      Attachments

        1. ActiveMQMessageConsumer.java.patch3
          0.7 kB
          Vadim Pesochinskiy
        2. ActiveMQMessageConsumer.patch
          4 kB
          Vadim Pesochinskiy
        3. ActiveMQMessageConsumer.patch2
          5 kB
          Vadim Pesochinskiy
        4. PrefetchSubscription.java.patch2
          2 kB
          Vadim Pesochinskiy
        5. PrefetchSubscription.java.patch3
          1 kB
          Vadim Pesochinskiy
        6. PrefetchSubscription.patch
          8 kB
          Vadim Pesochinskiy
        7. region.QueueSubscription.java.patch
          1 kB
          Vadim Pesochinskiy
        8. ZeroPrefetchConsumerTest.java.patch
          3 kB
          Vadim Pesochinskiy
        9. ZeroPrefetchConsumerTest.java.patch3
          4 kB
          Vadim Pesochinskiy

        Issue Links

          Activity

            People

              chirino Hiram R. Chirino
              vpesochi Vadim Pesochinskiy
              Votes:
              2 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: