Uploaded image for project: 'Atlas'
  1. Atlas
  2. ATLAS-1642

Incorrect edges created when creating external hive table with partition keys

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Duplicate
    • 0.8-incubating
    • None
    • atlas-core
    • None

    Description

      1. Create external hive table with partition keys in beeline:-

      create EXTERNAL table sampleTable1(id int, name string) comment 'table comment' partitioned by(dt string) location '/user/hive/data/someTestPath';

      2. Check the hive table 'sampleTable1' entity in atlas UI:
      a. Partition key column 'dt' is duplicated in columns property and status is deleted.

      On investigating the vertex and edges of the table:
      1. Table vertex has incorrect edge values for:
      hive_table.columns - has partitionkey edge here (which shouldn't be stored here)

      2. There is 3 outgoing edges from table to partition key column instead of one.

      3. The status of partition key column is 'DELETED'

      This results in failure of IT: HiveHookIT.testAlterTablePartitionColumnType()

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              sarath Sarath Subramanian
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: