Uploaded image for project: 'Atlas'
  1. Atlas
  2. ATLAS-1560

import hive metadata into atlas

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.7.1-incubating
    • None
    • atlas-core
    • None

    Description

      My operations
      1 I create hive db and hive_table
      2 I exec the <atlas package>/bin/import-hive.sh

      Result:
      1 the hive db "default" can import into Atlas.
      2 the hive db "default"`table can not import into Atlas
      3 the other db can`t import into Atlas.

      the databases:
      ----------------+

      database_name

      ----------------+

      default
      sap

      ----------------+

      the default`table :
      -----------+

      tab_name

      -----------+

      employee
      test

      -----------+

      the table employee`description:
      -----------------------------+

      col_name data_type comment

      -----------------------------+

      id bigint  
      name string  
      age int  
      city string  

      -----------------------------+

      the import-hive.sh`log:

      2017-02-16 02:49:06,899 DEBUG - [main:] ~ Updating entity id d79122c6-8547-4687-9bf1-0140ea59662c with {
      "jsonClass":"org.apache.atlas.typesystem.json.InstanceSerialization$_Reference",
      "id":

      { "jsonClass":"org.apache.atlas.typesystem.json.InstanceSerialization$_Id", "id":"d79122c6-8547-4687-9bf1-0140ea59662c", "version":0, "typeName":"hive_db", "state":"ACTIVE" }

      ,
      "typeName":"hive_db",
      "values":{
      "name":"default",
      "location":"hdfs://ocp-s17:8020/user/hive/warehouse",
      "description":"Default Hive database",
      "ownerType":2,
      "qualifiedName":"default@primary",
      "owner":"public",
      "clusterName":"primary",
      "parameters":{

      }
      },
      "traitNames":[

      ],
      "traits":{

      }
      } (AtlasClient:812)
      2017-02-16 02:49:06,899 DEBUG - [main:] ~ Using resource http://localhost:21000/api/atlas/entities/d79122c6-8547-4687-9bf1-0140ea59662c for 0 times (AtlasClient:789)
      2017-02-16 02:49:08,866 DEBUG - [main:] ~ API http://localhost:21000/api/atlas/entities/d79122c6-8547-4687-9bf1-0140ea59662c returned status 200 (AtlasClient:1230)
      2017-02-16 02:49:09,051 INFO - [main:] ~ Importing tables [] for db default (HiveMetaStoreBridge:254)
      2017-02-16 02:49:09,051 INFO - [main:] ~ Successfully imported all 0 tables from default (HiveMetaStoreBridge:261)
      Hive Data Model imported successfully!!!

      Attachments

        Activity

          People

            Unassigned Unassigned
            roxia roxia
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: