Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-5451

Kafka Connect should scan classpath asynchronously

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.11.0.0
    • Fix Version/s: 1.2.0
    • Component/s: KafkaConnect
    • Labels:

      Description

      When Kafka Connect workers start up, they scan the classpath and module paths for connectors, transformations, and converters. This takes anywhere from 15-30sec or longer depending upon how many JARs are included. Currently, this scanning is done synchronously during startup of the Kafka Connect workers, even though the workers may not need the result of the scan.

      The scanning logic should be asynchronous and should only block any components that require the result of the scan. This will improve startup time of the workers.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                rhauch Randall Hauch
                Reporter:
                rhauch Randall Hauch
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - 24h
                  24h
                  Remaining:
                  Remaining Estimate - 24h
                  24h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified