[ATLAS-1045] HiveHook fails to post metadata for "Create view" with "Relative path in absolute URI: NULL::character%20varying" exception

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Duplicate
• Affects Version/s: 0.7-incubating, trunk
• Assignee: Qiang Zhang
• Reporter: Ayub Pathan
• Created: 23/Jul/16 17:45
• Updated: 01/Jun/17 04:40
• Resolved: 01/Jun/17 04:40

Description

Impact: No metadata for "create view" on atlas.

Steps to repro:

* create table sample (abc String);
* create view sample_view_1 (url COMMENT 'URL of Referring page') AS  SELECT * from sample;

Hiveserver2.log snapshot

2016-07-23 17:28:24,371 INFO  [HiveServer2-Background-Pool: Thread-9870]: hooks.ATSHook (ATSHook.java:<init>(90)) - Created ATS Hook
2016-07-23 17:28:24,371 INFO  [HiveServer2-Background-Pool: Thread-9870]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - <PERFLOG method=PostHook.org.apache.hadoop.hive.ql.hooks.ATSHook from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,371 INFO  [HiveServer2-Background-Pool: Thread-9870]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - </PERFLOG method=PostHook.org.apache.hadoop.hive.ql.hooks.ATSHook start=1469294904371 end=1469294904371 duration=0 from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,372 INFO  [HiveServer2-Background-Pool: Thread-9870]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - <PERFLOG method=PostHook.org.apache.atlas.hive.hook.HiveHook from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,372 INFO  [HiveServer2-Background-Pool: Thread-9870]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - </PERFLOG method=PostHook.org.apache.atlas.hive.hook.HiveHook start=1469294904372 end=1469294904372 duration=0 from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,372 INFO  [HiveServer2-Background-Pool: Thread-9870]: ql.Driver (Driver.java:execute(1635)) - Resetting the caller context to HIVE_SSN_ID:8cc6511f-5454-431b-aa2f-d7a1c11159a7
2016-07-23 17:28:24,373 INFO  [HiveServer2-Background-Pool: Thread-9870]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - </PERFLOG method=Driver.execute start=1469294904326 end=1469294904373 duration=47 from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,373 INFO  [HiveServer2-Background-Pool: Thread-9870]: ql.Driver (SessionState.java:printInfo(939)) - OK
2016-07-23 17:28:24,373 INFO  [HiveServer2-Background-Pool: Thread-9870]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - <PERFLOG method=releaseLocks from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,373 INFO  [HiveServer2-Background-Pool: Thread-9870]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - </PERFLOG method=releaseLocks start=1469294904373 end=1469294904373 duration=0 from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,373 INFO  [HiveServer2-Background-Pool: Thread-9870]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - </PERFLOG method=Driver.run start=1469294904233 end=1469294904373 duration=140 from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,373 INFO  [Atlas Logger 1]: hook.HiveHook (HiveHook.java:fireAndForget(202)) - Entered Atlas hook for hook type POST_EXEC_HOOK operation CREATEVIEW
2016-07-23 17:28:24,374 INFO  [Atlas Logger 1]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(822)) - 6: get_database: default
2016-07-23 17:28:24,374 INFO  [Atlas Logger 1]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(391)) - ugi=hive/[e-mail]	ip=unknown-ip-addr	cmd=get_database: default
2016-07-23 17:28:24,380 INFO  [Atlas Logger 1]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(822)) - 6: get_database: default
2016-07-23 17:28:24,380 INFO  [Atlas Logger 1]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(391)) - ugi=hive/[e-mail]	ip=unknown-ip-addr	cmd=get_database: default
2016-07-23 17:28:24,385 INFO  [Atlas Logger 1]: bridge.HiveMetaStoreBridge (HiveMetaStoreBridge.java:createOrUpdateDBInstance(161)) - Importing objects from databaseName : default
2016-07-23 17:28:24,385 INFO  [Atlas Logger 1]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(822)) - 6: get_table : db=default tbl=sample
2016-07-23 17:28:24,385 INFO  [Atlas Logger 1]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(391)) - ugi=hive/[e-mail]	ip=unknown-ip-addr	cmd=get_table : db=default tbl=sample
2016-07-23 17:28:24,387 INFO  [HiveServer2-HttpHandler-Pool: Thread-62]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to 8cc6511f-5454-431b-aa2f-d7a1c11159a7 for thread HiveServer2-HttpHandler-Pool: Thread-62
2016-07-23 17:28:24,387 INFO  [HiveServer2-HttpHandler-Pool: Thread-62]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-HttpHandler-Pool: Thread-62
2016-07-23 17:28:24,392 INFO  [HiveServer2-HttpHandler-Pool: Thread-62]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to 8cc6511f-5454-431b-aa2f-d7a1c11159a7 for thread HiveServer2-HttpHandler-Pool: Thread-62
2016-07-23 17:28:24,392 INFO  [HiveServer2-HttpHandler-Pool: Thread-62]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-HttpHandler-Pool: Thread-62
2016-07-23 17:28:24,396 INFO  [HiveServer2-HttpHandler-Pool: Thread-62]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to 8cc6511f-5454-431b-aa2f-d7a1c11159a7 for thread HiveServer2-HttpHandler-Pool: Thread-62
2016-07-23 17:28:24,416 INFO  [HiveServer2-HttpHandler-Pool: Thread-62]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - <PERFLOG method=releaseLocks from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,416 INFO  [HiveServer2-HttpHandler-Pool: Thread-62]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - </PERFLOG method=releaseLocks start=1469294904416 end=1469294904416 duration=0 from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,416 INFO  [HiveServer2-HttpHandler-Pool: Thread-62]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-HttpHandler-Pool: Thread-62
2016-07-23 17:28:24,424 INFO  [Atlas Logger 1]: bridge.HiveMetaStoreBridge (HiveMetaStoreBridge.java:createOrUpdateTableInstance(411)) - Importing objects from default.sample
2016-07-23 17:28:24,424 INFO  [Atlas Logger 1]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(822)) - 6: get_database: default
2016-07-23 17:28:24,424 INFO  [Atlas Logger 1]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(391)) - ugi=hive/[e-mail]	ip=unknown-ip-addr	cmd=get_database: default
2016-07-23 17:28:24,439 INFO  [Atlas Logger 1]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(822)) - 6: get_database: default
2016-07-23 17:28:24,440 INFO  [Atlas Logger 1]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(391)) - ugi=hive/[e-mail]	ip=unknown-ip-addr	cmd=get_database: default
2016-07-23 17:28:24,445 INFO  [Atlas Logger 1]: bridge.HiveMetaStoreBridge (HiveMetaStoreBridge.java:createOrUpdateDBInstance(161)) - Importing objects from databaseName : default
2016-07-23 17:28:24,446 INFO  [Atlas Logger 1]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(822)) - 6: get_table : db=default tbl=sample_view_1
2016-07-23 17:28:24,446 INFO  [Atlas Logger 1]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(391)) - ugi=hive/[e-mail]	ip=unknown-ip-addr	cmd=get_table : db=default tbl=sample_view_1
2016-07-23 17:28:24,463 ERROR [Atlas Logger 1]: metastore.RetryingHMSHandler (RetryingHMSHandler.java:invokeInternal(195)) - java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: NULL::character%20varying
	at org.apache.hadoop.fs.Path.initialize(Path.java:205)
	at org.apache.hadoop.fs.Path.<init>(Path.java:171)
	at org.apache.hadoop.hive.ql.metadata.Table.getPath(Table.java:242)
	at org.apache.hadoop.hive.ql.metadata.Table.getDataLocation(Table.java:251)
	at org.apache.hadoop.hive.ql..authorization.StorageBasedAuthorizationProvider.authorize(StorageBasedAuthorizationProvider.java:178)
	at org.apache.hadoop.hive.ql..authorization.AuthorizationPreEventListener.authorizeReadTable(AuthorizationPreEventListener.java:188)
	at org.apache.hadoop.hive.ql..authorization.AuthorizationPreEventListener.onEvent(AuthorizationPreEventListener.java:149)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.firePreEvent(HiveMetaStore.java:2113)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1877)
	at sun.reflect.GeneratedMethodAccessor66.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:139)
	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:97)
	at com.sun.proxy.$Proxy13.get_table(Unknown Source)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1234)
	at org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.getTable(SessionHiveMetaStoreClient.java:131)
	at sun.reflect.GeneratedMethodAccessor67.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:159)
	at com.sun.proxy.$Proxy14.getTable(Unknown Source)
	at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1157)
	at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1131)
	at org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:513)
	at org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:535)
	at org.apache.atlas.hive.hook.HiveHook.processHiveEntity(HiveHook.java:623)
	at org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:603)
	at org.apache.atlas.hive.hook.HiveHook.fireAndForget(HiveHook.java:227)
	at org.apache.atlas.hive.hook.HiveHook.access$200(HiveHook.java:82)
	at org.apache.atlas.hive.hook.HiveHook$2.run(HiveHook.java:186)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.URISyntaxException: Relative path in absolute URI: NULL::character%20varying
	at java.net.URI.checkPath(URI.java:1823)
	at java.net.URI.<init>(URI.java:745)
	at org.apache.hadoop.fs.Path.initialize(Path.java:202)
	... 35 more

2016-07-23 17:28:24,464 ERROR [Atlas Logger 1]: hook.HiveHook (HiveHook.java:run(188)) - Atlas hook failed due to error
org.apache.hadoop.hive.ql.metadata.HiveException: Unable to fetch table sample_view_1. java.net.URISyntaxException: Relative path in absolute URI: NULL::character%20varying
	at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1165)
	at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1131)
	at org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:513)
	at org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:535)
	at org.apache.atlas.hive.hook.HiveHook.processHiveEntity(HiveHook.java:623)
	at org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:603)
	at org.apache.atlas.hive.hook.HiveHook.fireAndForget(HiveHook.java:227)
	at org.apache.atlas.hive.hook.HiveHook.access$200(HiveHook.java:82)
	at org.apache.atlas.hive.hook.HiveHook$2.run(HiveHook.java:186)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: NULL::character%20varying
	at org.apache.hadoop.fs.Path.initialize(Path.java:205)
	at org.apache.hadoop.fs.Path.<init>(Path.java:171)
	at org.apache.hadoop.hive.ql.metadata.Table.getPath(Table.java:242)
	at org.apache.hadoop.hive.ql.metadata.Table.getDataLocation(Table.java:251)
	at org.apache.hadoop.hive.ql..authorization.StorageBasedAuthorizationProvider.authorize(StorageBasedAuthorizationProvider.java:178)
	at org.apache.hadoop.hive.ql..authorization.AuthorizationPreEventListener.authorizeReadTable(AuthorizationPreEventListener.java:188)
	at org.apache.hadoop.hive.ql..authorization.AuthorizationPreEventListener.onEvent(AuthorizationPreEventListener.java:149)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.firePreEvent(HiveMetaStore.java:2113)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1877)
	at sun.reflect.GeneratedMethodAccessor66.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:139)
	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:97)
	at com.sun.proxy.$Proxy13.get_table(Unknown Source)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1234)
	at org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.getTable(SessionHiveMetaStoreClient.java:131)
	at sun.reflect.GeneratedMethodAccessor67.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:159)
	at com.sun.proxy.$Proxy14.getTable(Unknown Source)
	at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1157)
	... 13 more
Caused by: java.net.URISyntaxException: Relative path in absolute URI: NULL::character%20varying
	at java.net.URI.checkPath(URI.java:1823)
	at java.net.URI.<init>(URI.java:745)
	at org.apache.hadoop.fs.Path.initialize(Path.java:202)
	... 35 more

Issue Links

• duplicates: HIVE-14322 Postgres db issues after Datanucleus 4.x upgrade