[ATLAS-4591] [Hive import v2] While importing with hive import V2, seeing exceptions in the log for successful imports

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: atlas-core
• Assignee: Unassigned
• Reporter: Dharshana M Krishnamoorthy
• Created: 27/Apr/22 08:08
• Updated: 29/Apr/22 10:41

Description

Seeing this error in import log

2022-04-27 07:34:02,760 INFO  - [main:] ~ method=GET path=api/atlas/v2/entity/uniqueAttribute/type/hive_db/header contentType=application/json; charset=UTF-8 accept=application/json status=404 (AtlasBaseClient:407)
2022-04-27 07:34:02,762 WARN  - [main:] ~ Failed to get DB guid from Atlas with qualified name db_ecwvo@cm (HiveMetaStoreBridgeV2:740)
org.apache.atlas.AtlasServiceException: Metadata service API org.apache.atlas.AtlasBaseClient$API@69de5bed failed with status 404 (Not Found) Response Body ({"errorCode":"ATLAS-404-00-009","errorMessage":"Instance hive_db with unique attribute {qualifiedName=db_ecwvo@cm} does not exist"})
        at org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:447)
        at org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:366)
        at org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:352)
        at org.apache.atlas.AtlasBaseClient.callAPI(AtlasBaseClient.java:256)
        at org.apache.atlas.AtlasClientV2.getEntityHeaderByAttribute(AtlasClientV2.java:413)
        at org.apache.atlas.hive.bridge.HiveMetaStoreBridgeV2.getDBGuidFromAtlas(HiveMetaStoreBridgeV2.java:738)
        at org.apache.atlas.hive.bridge.HiveMetaStoreBridgeV2.getGuid(HiveMetaStoreBridgeV2.java:1019)
        at org.apache.atlas.hive.bridge.HiveMetaStoreBridgeV2.toDbEntity(HiveMetaStoreBridgeV2.java:718)
        at org.apache.atlas.hive.bridge.HiveMetaStoreBridgeV2.toDbEntity(HiveMetaStoreBridgeV2.java:705)
        at org.apache.atlas.hive.bridge.HiveMetaStoreBridgeV2.writeDatabase(HiveMetaStoreBridgeV2.java:645)
        at org.apache.atlas.hive.bridge.HiveMetaStoreBridgeV2.importHiveDatabases(HiveMetaStoreBridgeV2.java:314)
        at org.apache.atlas.hive.bridge.HiveMetaStoreBridgeV2.exportDataToZipAndRunAtlasImport(HiveMetaStoreBridgeV2.java:190)
        at org.apache.atlas.hive.bridge.HiveMetaStoreBridge.main(HiveMetaStoreBridge.java:180)
2022-04-27 07:34:02,813 INFO  - [main:] ~ Importing Hive Tables (HiveMetaStoreBridgeV2:405) 

Steps followed:

1. Disabled Hive hook
2. Created a database
3. Called the import v2 api by passing -o to import-hive.sh 
4. The above step will create the zip and also import the data 

Though the import is successful, seeing the above mentioned error in the logs.

This is not seen when -o is not passed to the import script (Not seeing issue in old import script)