Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.0.0, trunk
    • trunk, 2.1.0
    • atlas-core
    • None

    Description

      Background

      During migration import (and regular Import) types coming in are processed in the following way:

      • New types are determined.
      • Modification to existing types are determined.

      Steps to Duplicate

      Pre-requisites:

      • Create type definition with new structDef.
      • Modify hive_table (existing) such a new attribute references the structDef.

      Steps

      • Initiate migration import.

      Expected outcome

      • New types should be part of the types definition (using REST APIs and property pages).
      • Data should get migrated.

      Actual outcome

      • Type definition import fails.

      Additional information

      Stack trace:

      org.apache.atlas.exception.AtlasBaseException: Given typename hive_table_profile_data was invalid    
      at org.apache.atlas.repository.store.graph.AtlasTypeDefGraphStore.tryUpdateByName(AtlasTypeDefGraphStore.java:1025)    
      at org.apache.atlas.repository.store.graph.AtlasTypeDefGraphStore.updateEntityDefByName(AtlasTypeDefGraphStore.java:285)    
      at org.apache.atlas.repository.store.graph.AtlasTypeDefGraphStore$$FastClassBySprin
      

      Attachments

        Activity

          amestry Ashutosh Mestry added a comment - PC build:  https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/1533/

          +1 for the patch. Thanks Ashutosh Mestry

          sarath Sarath Subramanian added a comment - +1 for the patch. Thanks Ashutosh Mestry

          Commit 98163440590852fa9d142c23e596e8975a322349 in atlas's branch refs/heads/master from Ashutosh Mestry
          [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=9816344 ]

          ATLAS-3515: Migration import now creates new types and then updates existing types.

          jira-bot ASF subversion and git services added a comment - Commit 98163440590852fa9d142c23e596e8975a322349 in atlas's branch refs/heads/master from Ashutosh Mestry [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=9816344 ] ATLAS-3515 : Migration import now creates new types and then updates existing types.

          Commit 77dbea47bf42daceefea6bd03b81116aefa2f755 in atlas's branch refs/heads/branch-2.0 from Ashutosh Mestry
          [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=77dbea4 ]

          ATLAS-3515: Migration import now creates new types and then updates existing types.

          jira-bot ASF subversion and git services added a comment - Commit 77dbea47bf42daceefea6bd03b81116aefa2f755 in atlas's branch refs/heads/branch-2.0 from Ashutosh Mestry [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=77dbea4 ] ATLAS-3515 : Migration import now creates new types and then updates existing types.

          People

            amestry Ashutosh Mestry
            amestry Ashutosh Mestry
            Votes:
            0 Vote for this issue
            Watchers:
            Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack