Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-8598 Impala/Atlas integration
  3. IMPALA-8572

Move query hook execution to before query unregistration

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • Impala 3.4.0
    • Backend
    • None
    • ghx-label-5

    Description

      The backend currently executes query event hooks during ImpalaServer::UnregisterQuery, which may actually only happen a long time after the query has actually executed. We depend on either the client closing the query/session, the client's connection dropping, or an idle session timing out.

      e.g. the following sequence is possible.

      1. User executes query from Hue.
      2. User goes home for weekend, leaving Hue tab open in browser
      3. If we're lucky, the session timeout expires after some amount of idle time.
      4. The query gets unregistered, hooks get executed

      It would generally be desirable to move the lineage logger earlier in the query lifecycle, so it occurs as soon as all of the required data is available.

      Attachments

        Issue Links

          Activity

            People

              bharathv Bharath Vissapragada
              radford-nguyen radford nguyen
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: