[ATLAS-4470] Creating Hive_Process entity is getting failed due to null startTime

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Component/s: atlas-core
• Assignee: Radhika Kundam
• Reporter: Radhika Kundam
• Created: 02/Nov/21 20:06
• Updated: 09/Nov/21 20:59
• Resolved: 09/Nov/21 20:59

Description

tIn few scenarios of creation Hive_process entity is failed with below error and this is expected because startTime is mandatory attribute for hive_process entity. This issue is mainly because Hive is not sending startTime in few scenarios and since this issue is inconsistent and not sure of the pattern when Hive is sending empty startTime.

While processing Hive context Atlas initially assign currentTimeStamp to startTime and then further it proceeds to get startTime from Hive Context and if that value is empty the mentioned issue is occurring. So to avoid that we can have extra check at Atlas to consider StartTime from Hive Context only if it's not empty.
2021-10-13 14:40:00,503 ERROR - [NotificationHookConsumer thread-0:] ~ graph rollback due to exception AtlasBaseException:Invalid instance creation/updation parameters passed : hive_process.startTime: mandatory attribute value missing in type hive_process (GraphTransactionInterceptor:169)2021-10-13 14:40:00,504 WARN  - [NotificationHookConsumer thread-0:] ~ Error handling message (NotificationHookConsumer:752)org.apache.atlas.exception.AtlasBaseException: Invalid instance creation/updation parameters passed : hive_process.startTime: mandatory attribute value missing in type hive_process        at org.apache.atlas.repository.store.graph.v2.AtlasEntityGraphDiscoveryV2.validateAndNormalize(AtlasEntityGraphDiscoveryV2.java:97)        at org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2.preCreateOrUpdate(AtlasEntityStoreV2.java:899)        at org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2.createOrUpdate(AtlasEntityStoreV2.java:744)        at org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2.createOrUpdate(AtlasEntityStoreV2.java:275)        at org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2$$FastClassBySpringCGLIB$$6861dca9.invoke(<generated>)        at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)        at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:736)        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)        at org.apache.atlas.GraphTransactionInterceptor.invoke(GraphTransactionInterceptor.java:82)        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)        at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:671)        at org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2$$EnhancerBySpringCGLIB$$ff9731b1.createOrUpdate(<generated>)        at org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.createOrUpdate(NotificationHookConsumer.java:822)        at org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.handleMessage(NotificationHookConsumer.java:671)        at org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.doWork(NotificationHookConsumer.java:524)        at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:82)        at

Issue Links

• links to: Code Review
• links to: PreCommit (Latest)