Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-1131

Add column lineage information to the pre execution hooks

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.6.0
    • Query Processor
    • None
    • Incompatible change, Reviewed
    • This changes the signature of PostExecute.java

    Description

      We need a mechanism to pass the lineage information of the various columns of a table to a pre execution hook so that applications can use that for:

      • auditing
      • dependency checking

      and many other applications.

      The proposal is to expose this through a bunch of classes to the pre execution hook interface to the clients and put in the necessary transformation logic in the optimizer to generate this information.

      Attachments

        1. hive.1131.9.patch
          2.16 MB
          Namit Jain
        2. HIVE-1131_8.patch
          2.18 MB
          Ashish Thusoo
        3. HIVE-1131_7.patch
          2.18 MB
          Ashish Thusoo
        4. HIVE-1131_6.patch
          2.17 MB
          Ashish Thusoo
        5. HIVE-1131_5.patch
          2.20 MB
          Ashish Thusoo
        6. HIVE-1131_4.patch
          2.13 MB
          Ashish Thusoo
        7. HIVE-1131_3.patch
          87 kB
          Ashish Thusoo
        8. HIVE-1131_2.patch
          87 kB
          Ashish Thusoo
        9. HIVE-1131.patch
          92 kB
          Ashish Thusoo

        Issue Links

          Activity

            People

              athusoo Ashish Thusoo
              athusoo Ashish Thusoo
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: