[AIRFLOW-6598] DAG task queries a neo4j compatiable graph database

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.10.10
• Component/s: hooks, operators
• Assignee: Unassigned
• Reporter: Timothy Findlay
• Created: 20/Jan/20 04:36
• Updated: 08/Feb/20 03:13

Description

Story

As a developer
When I create a DAG task
I want to query a neo4j compatiable graph database
So that I can use the results

Assumptions

• DAG Task can specify output type
• Processing the results of the query is up to the developer

In Scope

• Ability to export results to CSV
• Support for DML queries.
• Resulting row count validation
• Target space validation
• Support for handling empty query responses
• Bolt and Bolt+routing protocol
• Correct failure handling (Connection, Query failure)

Out of Scope

• No other output format (other than CSV) supported. eg. Parquet, Avro, JSON
• Ability to use the bulk export API
• Ability to use the bulk import API

Issue Links

• supercedes: AIRFLOW-5920 Add support to execute OpenCypher query against Neo4j

Sub-Tasks

• Make a hook for neo4j: Open
• Make an operator to use the neo4j hook: Open
• Define Neo4j database connection type: Open