[ATLAS-1831] Virtualiser to dynamically configure an information virtualization layer

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.0.0
• Component/s: atlas-intg
• Labels: VirtualDataConnector
• Assignee: Yao Li
• Reporter: Mandy Chessell
• Due: 30/Jun/17
• Created: 25/May/17 21:33
• Updated: 23/Aug/18 14:34
• Resolved: 23/Aug/18 14:34

Description

Code review is available in https://reviews.apache.org/r/66174/

This component listens for events from the Information View OMAS event publisher built by ATLAS-1711 (https://issues.apache.org/jira/browse/ATLAS-1711) to detect changes to relational data assets and configures an information virtualization tool (Gaian in the first instance) to create/maintain a view that maps to the physical data asset. It also populates Information View metadata (using the Information View OMAS API) for each of the views it creates.

RANGER-1485 (https://issues.apache.org/jira/browse/RANGER-1485) will also configure Gaian with enforcement logic to apply data protection rules to the data when queries are made to the views.

Issue Links

• depends upon: RANGER-1485 Ranger support for Virtual Data Connector Project (ATLAS)
• depends upon: ATLAS-1711 Information View OMAS
• depends upon: ATLAS-1689 Virtual Data Connector Project