Uploaded image for project: 'Atlas'
  1. Atlas
  2. ATLAS-3918

Regression : Renaming table has exceptions in Atlas application logs

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.1.0
    • Fix Version/s: 3.0.0
    • Component/s: hive-integration
    • Labels:
      None

      Description

      Reproduce steps :

      > create table t1(id int);

      > alter table t1 rename to t2;

      Exception :

      2020-07-15 08:41:25,265 WARN  - [NotificationHookConsumer thread-0:] ~ Max retries exceeded for message {"version":{"version":"1.0.0","versionParts":[1]},"msgCompressionKind":"NONE","msgSplitIdx":1,"msgSplitCount":1,"msgCreationTime":1594802485264,"message":{"type":"ENTITY_PARTIAL_UPDATE_V2","user":"hrt_qa","entityId":{"typeName":"hive_table","uniqueAttributes":{"qualifiedName":"default.t1@cm"}},"entity":{"entity":{"typeName":"hive_table","attributes":{"owner":"hrt_qa","tableType":"MANAGED_TABLE","temporary":false,"lastAccessTime":1594802469000,"aliases":["t1"],"createTime":1594802469000,"qualifiedName":"default.t2@cm","name":"t2","comment":null,"parameters":{"last_modified_time":"1594802481","rawDataSize":"0","numRows":"0","transient_lastDdlTime":"1594802481","bucketing_version":"2","last_modified_by":"hrt_qa","numFilesErasureCoded":"0","totalSize":"0","transactional_properties":"default","COLUMN_STATS_ACCURATE":"{\"BASIC_STATS\":\"true\",\"COLUMN_STATS\":{\"id\":\"true\"}}","numFiles":"0","transactional":"true"},"retention":0},"guid":"-21782793831367970","isIncomplete":false,"provenanceType":0,"version":0,"proxy":false}}}} (NotificationHookConsumer$HookConsumer:793) 

      because , in the message sent to ATLAS_HOOK , in the "attributes" dict , right qualifiedName is given, but in "uniqueAttributes" it still has the old qualifiedName.

      "uniqueAttributes":{"qualifiedName":"default.t1@cm"}},"entity":{"entity":{"typeName":"hive_table","attributes":{"owner":"hrt_qa","tableType":"MANAGED_TABLE","temporary":false,"lastAccessTime":1594802469000,"aliases":["t1"],"createTime":1594802469000,"qualifiedName":"default.t2@cm"

      **But the entities are updated in Atlas as expected.

        Attachments

          Activity

            People

            • Assignee:
              chaitali chaitali borole
              Reporter:
              chaitali chaitali borole

              Dates

              • Created:
                Updated:

                Issue deployment