[ATLAS-4099] adls_gen2_directory, Hive Hook : An extra "/" is seen in adls_gen2_directory created by Hook

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1.0
• Fix Version/s: 3.0.0, 2.2.0
• Component/s: atlas-core
• Assignee: Sidharth Kumar Mishra
• Reporter: Sidharth Kumar Mishra
• Created: 12/Jan/21 21:40
• Updated: 14/Jan/21 06:51
• Resolved: 14/Jan/21 06:51

Description

For the query :

create external table ext_table(id int) location 'abfs://[e-mail]/test51' 

adls_gen2_directory created by Hook has QualifiedName : 

abfs://container@storageaccount/test51/@cm

whereas , adls_gen2_directory created by Extractor has QualifiedName:

abfs://container@storageaccount/test51@cm

There is an extra "/" after storage account name which causes issue. Because of this , duplicate entities are created.

Issue Links

• links to: Code Review
• links to: Precommit (Latest)