[ATLAS-641] Lineage for a view created from a view seems to be confusing(from user's perspective).

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.1, 0.8.2, 1.0.0
• Fix Version/s: 0.8.3, 1.1.0, 2.0.0
• Assignee: Madhan Neethiraj
• Reporter: Ayub Pathan
• Created: 06/Apr/16 12:57
• Updated: 26/Sep/19 00:38
• Resolved: 23/Jun/18 04:35

Description

Lineage for a table created from the view seems to be confusing(from user's perspective).

Steps to reproduce:

0: jdbc:hive2://localhost:10000/default>
0: jdbc:hive2://localhost:10000/default> create table src (x int, y int, s string);
No rows affected (0.384 seconds)
0: jdbc:hive2://localhost:10000/default> create view view1 as select * from src;
No rows affected (0.225 seconds)
0: jdbc:hive2://localhost:10000/default> create table view_table as select * from view1;
INFO  : Number of reduce tasks is set to 0 since there's no reduce operator
INFO  : number of splits:1
INFO  : Submitting tokens for job: job_local1883260823_0021
INFO  : The url to track the job: http://localhost:8080/
INFO  : Job running in-process (local Hadoop)
INFO  : 2016-04-06 18:15:02,538 Stage-1 map = 100%,  reduce = 0%
INFO  : Ended Job = job_local1883260823_0021
INFO  : Stage-4 is selected by condition resolver.
INFO  : Stage-3 is filtered out by condition resolver.
INFO  : Stage-5 is filtered out by condition resolver.
INFO  : Moving data to: hdfs://localhost:9000/user/hive/warehouse/.hive-staging_hive_2016-04-06_18-14-59_156_3909183228338665119-12/-ext-10001 from hdfs://localhost:9000/user/hive/warehouse/.hive-staging_hive_2016-04-06_18-14-59_156_3909183228338665119-12/-ext-10003
INFO  : Moving data to: hdfs://localhost:9000/user/hive/warehouse/view_table from hdfs://localhost:9000/user/hive/warehouse/.hive-staging_hive_2016-04-06_18-14-59_156_3909183228338665119-12/-ext-10001
INFO  : Table default.view_table stats: [numFiles=1, numRows=0, totalSize=0, rawDataSize=0]
No rows affected (3.8 seconds)
0: jdbc:hive2://localhost:10000/default> alter view view1 as select * from t2;
No rows affected (0.602 seconds)
0: jdbc:hive2://localhost:10000/default>

Check the lineage of the resultant table(view_table).

Link showing confusing lineage: https://monosnap.com/file/qaYZcJRQnNX5BsyM12hkryv70RZK1I

Issue Links

• is related to: ATLAS-492 Hive Hook Improvements
• links to: Patch in review board