Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-15478

Update connect to use ForwardingAdmin

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      Connect uses AdminClients to create topics; while this simplifies the implementation of Connect it has the following problems 

      • It assumes that whoever runs Connect must have admin access to both source and destination clusters. This assumption is not necessarily valid all the time.
      • It creates conflict in use-cases where centralised systems or tools manage Kafka resources. 

      It would be easier if customers could provide how they want to manage Kafka topics through admin client or using their centralised system or tools. 

       

      We already have ForwardingAdmin in MM2 so we can extend connect to do something similiar

       KIP-981 https://cwiki.apache.org/confluence/display/KAFKA/KIP-981%3A+Manage+Connect+topics+with+custom+implementation+of+Admin

      Attachments

        Activity

          People

            Unassigned Unassigned
            omnia_h_ibrahim Omnia Ibrahim
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: