Uploaded image for project: 'Apache Airflow'
  1. Apache Airflow
  2. AIRFLOW-3486

cannot load lineage backend atlas following the instructions in lineage.rst

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.10.1
    • None
    • None
    • None
    • Patch

    Description

      lineage.rst says to configure lineage as:

      [lineage]
      backend = airflow.lineage.backend.atlas
      
      [atlas]
      username = my_username
      password = my_password
      host = host
      port = 21000
      

      but this fails, because airflow.lineage.backend.atlas is a module, not a class, and therefore cannot be loaded by import_string.

      Specifying  airflow.lineage.backend.atlas.AtlasBackend instead loads the backend, but is unable to send to it because it tries to use the class, rather than an instance of the class, as the backend.

      I have a fix in the attached patch, including:

      • Documentation fix
      • Fix for _get_backend()
      • Test to ensure that the backend can be loaded and used

      Attachments

        1. lineage-backend-atlas.patch
          2 kB
          Nik Bates-Haus

        Activity

          People

            Unassigned Unassigned
            nbateshaus Nik Bates-Haus
            Votes:
            3 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated: