Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-7458

Avoid enforced processing during bootstrap phase

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: streams
    • Labels:
      None

      Description

      In KAFKA-3514, we introduced a new config for allowing users to delay enforcing processing without all input topic partitions to have data. This config's default value is 0, which means that as long as the first fetch does not contains some records for all the partitions it will fall into enforced processing immediately, which is a high risk especially under bootstrap case.

      We should consider leveraging on pause / resume to make sure that upon starting, some partition indeed does not have any data before we fall into enforced processing

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                guozhang Guozhang Wang
                Reporter:
                guozhang Guozhang Wang
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated: