[ATLAS-3432] Add Machine Learning Governance integration

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 3.0.0
• Component/s: atlas-core
• Assignee: Na Li
• Reporter: Na Li
• Created: 01/Oct/19 18:27
• Updated: 19/Oct/20 07:18
• Resolved: 24/Oct/19 21:28

Description

Managing machine learning models and its deployments are getting more important over time. Adding their metadata into Atlas is the key step.

This update adds new entity types for ML governance, and implements the Hook defined for ML governance.

• Atlas entities for machine learning metadata are defined.
• The Hook API is defined for customer governance service to call to store ML metadata.
• An implementation of the Hook API is provide that converts machine learning metadata to lineage notifications and send them to Atlas.

Issue Links

• is a parent of: ATLAS-3435 Handle all fields of User entity from ML Governance Hook input
• is a parent of: ATLAS-3440 Get ML metadata from ML service using HTTP client
• is a parent of: ATLAS-3465 Define the ML Hook API that an Atlas addon will implement
• is a parent of: ATLAS-3466 Implement ML Hook API for Atlas
• is related to: ATLAS-3464 Define Entities stored in Atlas for ML Governance