[ATLAS-1748] Automated Metadata Discovery

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 1.0.0
• Component/s: atlas-intg
• Assignee: Unassigned
• Reporter: Mandy Chessell
• Created: 24/Apr/17 11:58
• Updated: 20/Jul/18 13:33
• Resolved: 20/Jul/18 13:33

Description

This JIRA proposes a framework for managing automated metadata discovery analytics. The framework is called when Atlas receives a notification about new or (significantly) updated data. It selects a discovery pipeline and runs it. The discovery pipeline is a list of pluggable discovery components that are called in sequence. The later components in the pipeline can access the results of the previous components. The results of the pipeline are added to the Apache Atlas metadata entry for the data source.

Issue Links

• depends upon: ATLAS-1843 Area 6 of the open metadata model
• mentioned in: Page Loading...
• mentioned in: Page Loading...