[ATLAS-2696] Typedef extensions for Kafka in Atlas

• Type: Improvement
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 1.0.0
• Assignee: Barbara Eckman
• Reporter: Srikanth Venkat
• Created: 16/May/18 22:53
• Updated: 26/May/18 06:25
• Resolved: 26/May/18 06:25

Description

Kafka topic typedef in Atlas can be improved to include many useful operational (config related) and contextual metadata properties:

• config inputs such as max throughput per sec, average message size, messages per day, retention time
• Sizing outputs such as number and size of partitions, replication factor
• Contact information on the data producer
• Array of avro schemas that are associated with the topic (based on Avro schema extensions outlined in ATLAS-2694)