Hive
  1. Hive
  2. HIVE-1131

Add column lineage information to the pre execution hooks

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.6.0
    • Component/s: Query Processor
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      This changes the signature of PostExecute.java

      Description

      We need a mechanism to pass the lineage information of the various columns of a table to a pre execution hook so that applications can use that for:

      • auditing
      • dependency checking

      and many other applications.

      The proposal is to expose this through a bunch of classes to the pre execution hook interface to the clients and put in the necessary transformation logic in the optimizer to generate this information.

      1. HIVE-1131.patch
        92 kB
        Ashish Thusoo
      2. HIVE-1131_2.patch
        87 kB
        Ashish Thusoo
      3. HIVE-1131_3.patch
        87 kB
        Ashish Thusoo
      4. HIVE-1131_4.patch
        2.13 MB
        Ashish Thusoo
      5. HIVE-1131_5.patch
        2.20 MB
        Ashish Thusoo
      6. HIVE-1131_6.patch
        2.17 MB
        Ashish Thusoo
      7. HIVE-1131_7.patch
        2.18 MB
        Ashish Thusoo
      8. HIVE-1131_8.patch
        2.18 MB
        Ashish Thusoo
      9. hive.1131.9.patch
        2.16 MB
        Namit Jain

        Issue Links

          Activity

            People

            • Assignee:
              Ashish Thusoo
              Reporter:
              Ashish Thusoo
            • Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development