Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-8598 Impala/Atlas integration
  3. IMPALA-8576

Pass lineage object instead of string to query hook

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Backend, Frontend
    • None
    • ghx-label-4

    Description

      The QueryEventHook interface currently takes a String for the onQueryComplete hook.  This string is the JSON representation of the lineage graph written to the legacy lineage file.

      It would be better to pass the serialized byte[] of the lineage thrift object itself, so that we can decouple ourselves from any lineage file format(s).

      Additionally, hook implementations should use their own version of Thrift to deserialize the object so that they are not tied to Impala's Thrift version.

      Attachments

        Issue Links

          is caused by

          Sub-task - The sub-task of the issue IMPALA-8473 Refactor lineage publication mechanism to allow for different consumers

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Activity

            People

              fangyurao Fang-Yu Rao
              radford-nguyen radford nguyen
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: