Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-4283

Ensure Kudu-specific DML audit & lineage behavior

    Details

    • Type: Task
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: Kudu_Impala
    • Fix Version/s: Impala 2.8.0
    • Component/s: Catalog
    • Labels:
    • Docs Text:
      Audit is supported for all operations on Kudu tables. Lineage is not supported for UPDATE and DELETE statements.
    • Target Version:

      Description

      Kudu integration adds new DELETE, UPDATE, UPSERT statements DML. This will result in changes in both audits and lineage metadata.

      • Lineage logging will be disabled for Kudu tables.
      • For auditing, update/delete/upsert will show up "insert" type operations in the audit log.

        Activity

        Hide
        vikas_impala_bebe vikas singh added a comment -

        Hi Dimitris Tsirogiannis,

        Can you also please provide some examples of these statements so that Nav team can test these? I am specifically looking for ones where joins are involved.

        Thanks,
        Vikas

        Show
        vikas_impala_bebe vikas singh added a comment - Hi Dimitris Tsirogiannis , Can you also please provide some examples of these statements so that Nav team can test these? I am specifically looking for ones where joins are involved. Thanks, Vikas
        Hide
        mjacobs Matthew Jacobs added a comment -

        Hi vikas singh, Chang and I discussed that we would disable lineage support for this release. We will just support audit logging.

        Show
        mjacobs Matthew Jacobs added a comment - Hi vikas singh , Chang and I discussed that we would disable lineage support for this release. We will just support audit logging.
        Hide
        dtsirogiannis Dimitris Tsirogiannis added a comment -

        Change-Id: Idc4ca1cd63bcfa4370c240a5c4a4126ed6704f4d
        Reviewed-on: http://gerrit.cloudera.org:8080/5151
        Reviewed-by: Dimitris Tsirogiannis <dtsirogiannis@cloudera.com>
        Tested-by: Internal Jenkins

        Show
        dtsirogiannis Dimitris Tsirogiannis added a comment - Change-Id: Idc4ca1cd63bcfa4370c240a5c4a4126ed6704f4d Reviewed-on: http://gerrit.cloudera.org:8080/5151 Reviewed-by: Dimitris Tsirogiannis <dtsirogiannis@cloudera.com> Tested-by: Internal Jenkins

          People

          • Assignee:
            dtsirogiannis Dimitris Tsirogiannis
            Reporter:
            mjacobs Matthew Jacobs
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development