Uploaded image for project: 'Atlas'
  1. Atlas
  2. ATLAS-2276

Path value for hdfs_path type entity is set to lower case from hive-bridge.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.8-incubating, trunk
    • 0.8.2, 1.0.0
    • None
    • None

    Description

      Steps to reproduce:-

      • Create hive table with external file location
        create external table hive_atlas_bug_test1 ( column1 int )
         LOCATION ‘/store/Hive_Atlas_Bug_Test1'
        
      • Check the hdfs_path type entity created on hive, the path is set with lowercase.

      While hive objects are case insensitive and hdfs paths are case sensitive.
      When hive table is created, the Atlas-hook's hive-bridge creates hdfs_path entities and sends entity to Atlas server, the path value is stored in lowercase in Metadata store.

      This will cause issues when other subsystems attempt to link lineage to atlas entities using the proper case sensitive hdfs paths

      Attachments

        1. upload.png
          102 kB
          Nixon Rodrigues
        2. ATLAS-2276.patch
          4 kB
          Nixon Rodrigues

        Issue Links

          Activity

            People

              nixon Nixon Rodrigues
              nixon Nixon Rodrigues
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: