Uploaded image for project: 'Camel'
  1. Camel
  2. CAMEL-14514

Improving Google Pub/Sub performance

    XMLWordPrintableJSON

    Details

    • Estimated Complexity:
      Unknown

      Description

      I want to explore if it's possible to improve the performance of the Google Pub/Sub component.

      I did some experimenting with replacing the com.google.apis:google-api-services-pubsub library with com.google.cloud:google-cloud-pubsub and replacing the synchronous pull with the asynchronous one. I've also created a cache for the message producers.

      This combination lead to a significant improvement. More than 50 times faster in a simple test with a producer in a splitter with parallel processing and a consumer with concurrent consumers.

      I'd like to invite the community to see if these changes are in right direction and help out to take it further.

      PR: https://github.com/apache/camel/pull/3551

       

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                alvinkwekel@gmail.com Alvin Kwekel
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m