Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-3463

Change default consumer receive buffer size to 64K

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.10.0.0
    • Component/s: consumer
    • Labels:
      None

      Description

      In KAFKA-3135, users have reported a strange pause when consuming data using the new consumer. This can be easily reproduced with the console consumer, but the root cause has so far proven elusive. Interestingly, the pause can also be reproduced with the old consumer if you change the socket buffer size to 32K to match the new consumer's default. Similarly, by increasing the new consumer's connection receive buffer size to 64K to match the old consumer's default, the problem seems to be mitigated (I am unable to reproduce it locally with this setting, though others have reported that its impact is merely reduced). Since there doesn't appear to be a good reason to have lowered the default for the new consumer, we may as well revert to the old consumer's default of 64K and accept the mitigation until an actual fix is found.

        Attachments

          Activity

            People

            • Assignee:
              hachikuji Jason Gustafson
              Reporter:
              hachikuji Jason Gustafson
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: