Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-3008

Connect should parallelize task start/stop

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 0.9.0.0
    • 0.10.2.0
    • connect
    • None

    Description

      The Herder implementations currently iterate over all connectors/tasks and sequentially start/stop them. We should parallelize this. This is less critical for StandaloneHerder, but pretty important for DistributedHerder since it will generally be managing more tasks and any delay starting/stopping a single task will impact every other task on the node (and can ultimately result in incorrect behavior in the case of a single offset commit in one connector taking too long preventing all of the rest from committing offsets).

      Attachments

        Issue Links

          Activity

            People

              kkonstantine Konstantine Karantasis
              ewencp Ewen Cheslack-Postava
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: