[HIVE-14706] Lineage information not set properly

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.1.0, 2.1.1
• Fix Version/s: 2.2.0
• Assignee: Pengcheng Xiong
• Reporter: Vimal Sharma
• Created: 06/Sep/16 12:55
• Updated: 26/Jul/17 03:29
• Resolved: 13/Jan/17 19:24

Description

I am trying to fetch column level lineage after a CTAS query in a Post Execution hook in Hive. Below are the queries:

create table t1(id int, name string);
create table t2 as select * from t1;

The lineage information is retrieved using the following sample piece of code:

lInfo = hookContext.getLinfo()
for(Map.Entry<LineageInfo.DependencyKey, LineageInfo.Dependency> e : lInfo.entrySet()) {
    System.out.println("Col Lineage Key : " + e.getKey());
    System.out.println("Col Lineage Value: " + e.getValue());
}

The Dependency field(i.e Col Lineage Value) is coming in as null.

Issue Links

• relates to: HIVE-13112 Expose Lineage information in case of CTAS