[ATLAS-2276] Path value for hdfs_path type entity is set to lower case from hive-bridge.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8-incubating, trunk
• Fix Version/s: 0.8.2, 1.0.0
• Assignee: Nixon Rodrigues
• Reporter: Nixon Rodrigues
• Created: 23/Nov/17 10:10
• Updated: 09/Nov/18 16:58
• Resolved: 28/Nov/17 20:04

Description

Steps to reproduce:-

• Create hive table with external file location

  create external table hive_atlas_bug_test1 ( column1 int )
   LOCATION ‘/store/Hive_Atlas_Bug_Test1'
  

• Check the hdfs_path type entity created on hive, the path is set with lowercase.

While hive objects are case insensitive and hdfs paths are case sensitive.
When hive table is created, the Atlas-hook's hive-bridge creates hdfs_path entities and sends entity to Atlas server, the path value is stored in lowercase in Metadata store.

This will cause issues when other subsystems attempt to link lineage to atlas entities using the proper case sensitive hdfs paths

Issue Links

• relates to: ATLAS-2961 Atlas Hive hook doesn't recognize configuration 'hdfs_path.convert_to_lowercase'
• links to: Review Request