[AIRFLOW-3486] cannot load lineage backend atlas following the instructions in lineage.rst

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.10.1
• Flags: Patch
• Assignee: Unassigned
• Reporter: Nik Bates-Haus
• Created: 09/Dec/18 17:46
• Updated: 18/Dec/19 14:07

Description

lineage.rst says to configure lineage as:

[lineage]
backend = airflow.lineage.backend.atlas

[atlas]
username = my_username
password = my_password
host = host
port = 21000

but this fails, because airflow.lineage.backend.atlas is a module, not a class, and therefore cannot be loaded by import_string.

Specifying  airflow.lineage.backend.atlas.AtlasBackend instead loads the backend, but is unable to send to it because it tries to use the class, rather than an instance of the class, as the backend.

I have a fix in the attached patch, including:

• Documentation fix
• Fix for _get_backend()
• Test to ensure that the backend can be loaded and used