Uploaded image for project: 'Atlas'
  1. Atlas
  2. ATLAS-2696

Typedef extensions for Kafka in Atlas

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • 1.0.0
    • None
    • None

    Description

      Kafka topic typedef in Atlas can be improved to include many useful operational (config related) and contextual metadata properties:

      • config inputs such as max throughput per sec, average message size, messages per day, retention time
      • Sizing outputs such as number and size of partitions, replication factor
      • Contact information on the data producer
      • Array of avro schemas that are associated with the topic (based on Avro schema extensions outlined in ATLAS-2694)

      Attachments

        1. ATLAS-2696.patch
          7 kB
          Madhan Neethiraj
        2. kafka_topic_typedef.json
          4 kB
          Barbara Eckman

        Activity

          People

            barbara Barbara Eckman
            srikvenk Srikanth Venkat
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: