Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-4361

Streams does not respect user configs for "default" params

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.10.1.0
    • 0.10.1.1, 0.10.2.0
    • streams
    • None

    Description

      For the config params in CONSUMER_DEFAULT_OVERRIDES (https://github.com/apache/kafka/blob/0.10.1/streams/src/main/java/org/apache/kafka/streams/StreamsConfig.java#L274) such as consumer.max.poll.records and consumer.auto.offset.reset, those parameters are not used and instead overridden by the defaults. It may not work for some producer config values as well.

      If your application sets those params in the StreamsConfig, they are not used in the underlying Kafka Consumers (and possibly Producers)

      Attachments

        Issue Links

          Activity

            githubbot ASF GitHub Bot added a comment -

            GitHub user dguy opened a pull request:

            https://github.com/apache/kafka/pull/2084

            KAFKA-4361: Streams does not respect user configs for "default" params

            Enable user provided consumer and producer configs to override the streams default configs.

            You can merge this pull request into a Git repository by running:

            $ git pull https://github.com/dguy/kafka kafka-4361

            Alternatively you can review and apply these changes as the patch at:

            https://github.com/apache/kafka/pull/2084.patch

            To close this pull request, make a commit to your master/trunk branch
            with (at least) the following in the commit message:

            This closes #2084


            commit 47f428940fa05d3c733832cf0e228d3a93a102e3
            Author: Damian Guy <damian.guy@gmail.com>
            Date: 2016-11-01T10:18:55Z

            override StreamsConfig consumer and producer defaults


            githubbot ASF GitHub Bot added a comment - GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/2084 KAFKA-4361 : Streams does not respect user configs for "default" params Enable user provided consumer and producer configs to override the streams default configs. You can merge this pull request into a Git repository by running: $ git pull https://github.com/dguy/kafka kafka-4361 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/2084.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2084 commit 47f428940fa05d3c733832cf0e228d3a93a102e3 Author: Damian Guy <damian.guy@gmail.com> Date: 2016-11-01T10:18:55Z override StreamsConfig consumer and producer defaults
            guozhang Guozhang Wang added a comment -

            Issue resolved by pull request 2084
            https://github.com/apache/kafka/pull/2084

            guozhang Guozhang Wang added a comment - Issue resolved by pull request 2084 https://github.com/apache/kafka/pull/2084
            githubbot ASF GitHub Bot added a comment -

            Github user asfgit closed the pull request at:

            https://github.com/apache/kafka/pull/2084

            githubbot ASF GitHub Bot added a comment - Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2084

            People

              damianguy Damian Guy
              theduderog Roger Hoover
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: