Uploaded image for project: 'Atlas'
  1. Atlas
  2. ATLAS-4591

[Hive import v2] While importing with hive import V2, seeing exceptions in the log for successful imports

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • atlas-core
    • None

    Description

      Seeing this error in import log

      2022-04-27 07:34:02,760 INFO  - [main:] ~ method=GET path=api/atlas/v2/entity/uniqueAttribute/type/hive_db/header contentType=application/json; charset=UTF-8 accept=application/json status=404 (AtlasBaseClient:407)
      2022-04-27 07:34:02,762 WARN  - [main:] ~ Failed to get DB guid from Atlas with qualified name db_ecwvo@cm (HiveMetaStoreBridgeV2:740)
      org.apache.atlas.AtlasServiceException: Metadata service API org.apache.atlas.AtlasBaseClient$API@69de5bed failed with status 404 (Not Found) Response Body ({"errorCode":"ATLAS-404-00-009","errorMessage":"Instance hive_db with unique attribute {qualifiedName=db_ecwvo@cm} does not exist"})
              at org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:447)
              at org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:366)
              at org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:352)
              at org.apache.atlas.AtlasBaseClient.callAPI(AtlasBaseClient.java:256)
              at org.apache.atlas.AtlasClientV2.getEntityHeaderByAttribute(AtlasClientV2.java:413)
              at org.apache.atlas.hive.bridge.HiveMetaStoreBridgeV2.getDBGuidFromAtlas(HiveMetaStoreBridgeV2.java:738)
              at org.apache.atlas.hive.bridge.HiveMetaStoreBridgeV2.getGuid(HiveMetaStoreBridgeV2.java:1019)
              at org.apache.atlas.hive.bridge.HiveMetaStoreBridgeV2.toDbEntity(HiveMetaStoreBridgeV2.java:718)
              at org.apache.atlas.hive.bridge.HiveMetaStoreBridgeV2.toDbEntity(HiveMetaStoreBridgeV2.java:705)
              at org.apache.atlas.hive.bridge.HiveMetaStoreBridgeV2.writeDatabase(HiveMetaStoreBridgeV2.java:645)
              at org.apache.atlas.hive.bridge.HiveMetaStoreBridgeV2.importHiveDatabases(HiveMetaStoreBridgeV2.java:314)
              at org.apache.atlas.hive.bridge.HiveMetaStoreBridgeV2.exportDataToZipAndRunAtlasImport(HiveMetaStoreBridgeV2.java:190)
              at org.apache.atlas.hive.bridge.HiveMetaStoreBridge.main(HiveMetaStoreBridge.java:180)
      2022-04-27 07:34:02,813 INFO  - [main:] ~ Importing Hive Tables (HiveMetaStoreBridgeV2:405) 

      Steps followed:

      1. Disabled Hive hook
      2. Created a database
      3. Called the import v2 api by passing -o to import-hive.sh 
      4. The above step will create the zip and also import the data 

      Though the import is successful, seeing the above mentioned error in the logs.

      This is not seen when -o is not passed to the import script (Not seeing issue in old import script)

      Attachments

        Activity

          People

            Unassigned Unassigned
            dharshmk Dharshana M Krishnamoorthy
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: