Uploaded image for project: 'Camel'
  1. Camel
  2. CAMEL-14514

Improving Google Pub/Sub performance

    XMLWordPrintableJSON

Details

    • Unknown

    Description

      I want to explore if it's possible to improve the performance of the Google Pub/Sub component.

      I did some experimenting with replacing the com.google.apis:google-api-services-pubsub library with com.google.cloud:google-cloud-pubsub and replacing the synchronous pull with the asynchronous one. I've also created a cache for the message producers.

      This combination lead to a significant improvement. More than 50 times faster in a simple test with a producer in a splitter with parallel processing and a consumer with concurrent consumers.

      I'd like to invite the community to see if these changes are in right direction and help out to take it further.

      PR: https://github.com/apache/camel/pull/3551

       

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              alvinkwekel@gmail.com Alvin Kwekel
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m