Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-1131

Add column lineage information to the pre execution hooks

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.6.0
    • Component/s: Query Processor
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      This changes the signature of PostExecute.java

      Description

      We need a mechanism to pass the lineage information of the various columns of a table to a pre execution hook so that applications can use that for:

      • auditing
      • dependency checking

      and many other applications.

      The proposal is to expose this through a bunch of classes to the pre execution hook interface to the clients and put in the necessary transformation logic in the optimizer to generate this information.

        Attachments

        1. HIVE-1131.patch
          92 kB
          Ashish Thusoo
        2. HIVE-1131_2.patch
          87 kB
          Ashish Thusoo
        3. HIVE-1131_3.patch
          87 kB
          Ashish Thusoo
        4. HIVE-1131_4.patch
          2.13 MB
          Ashish Thusoo
        5. HIVE-1131_5.patch
          2.20 MB
          Ashish Thusoo
        6. HIVE-1131_6.patch
          2.17 MB
          Ashish Thusoo
        7. HIVE-1131_7.patch
          2.18 MB
          Ashish Thusoo
        8. HIVE-1131_8.patch
          2.18 MB
          Ashish Thusoo
        9. hive.1131.9.patch
          2.16 MB
          Namit Jain

          Issue Links

            Activity

              People

              • Assignee:
                athusoo Ashish Thusoo
                Reporter:
                athusoo Ashish Thusoo
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: