[HIVE-1131] Add column lineage information to the pre execution hooks - ASF JIRA

XML

Word

Printable

JSON

Details

Type: New Feature
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.6.0
Component/s: Query Processor
Labels:
None

Hadoop Flags:

Incompatible change, Reviewed
Release Note:
This changes the signature of PostExecute.java

Description

We need a mechanism to pass the lineage information of the various columns of a table to a pre execution hook so that applications can use that for:

auditing
dependency checking

and many other applications.

The proposal is to expose this through a bunch of classes to the pre execution hook interface to the clients and put in the necessary transformation logic in the optimizer to generate this information.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HIVE-1131.patch
04/Feb/10 18:05
92 kB
Ashish Thusoo
HIVE-1131_2.patch
25/Mar/10 08:58
87 kB
Ashish Thusoo
HIVE-1131_3.patch
25/Mar/10 09:38
87 kB
Ashish Thusoo
HIVE-1131_4.patch
25/Mar/10 19:02
2.13 MB
Ashish Thusoo
HIVE-1131_5.patch
31/Mar/10 22:38
2.20 MB
Ashish Thusoo
HIVE-1131_6.patch
02/Apr/10 07:07
2.17 MB
Ashish Thusoo
HIVE-1131_7.patch
02/Apr/10 23:23
2.18 MB
Ashish Thusoo
HIVE-1131_8.patch
06/Apr/10 01:48
2.18 MB
Ashish Thusoo
hive.1131.9.patch
06/Apr/10 20:25
2.16 MB
Namit Jain

Issue Links

is related to

HIVE-11139 Emit more lineage information

Closed

Activity

People

Assignee:: Ashish Thusoo

Reporter:: Ashish Thusoo

Votes:: 0 Vote for this issue

Watchers:: 10 Start watching this issue

Dates

Created:: 04/Feb/10 00:45

Updated:: 29/Jun/15 16:05

Resolved:: 06/Apr/10 23:04