Uploaded image for project: 'Ranger'
  1. Ranger
  2. RANGER-4914

Ranger TagSync does not support ofs path parsing for Ozone-Atlas currently

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0, 2.6.0
    • Ranger
    • None

    Description

      When trying to create hive table on top of ozone ofs path, tagsync throws below error  

      2024-08-06 13:33:00,805 ERROR org.apache.ranger.tagsync.source.atlas.AtlasResourceMapperUtil: Could not get serviceResource for atlas entity:91faefd3-0592-400e-b452-0c9a437555db: java.lang.Exception: volume-name not found in attribute 'qualifiedName': ofs://ozone1722927741/vol1/bucket1/employee_db/meh1_hive_ozone_table_171@cm at org.apache.ranger.tagsync.source.atlas.AtlasResourceMapper.throwExceptionWithMessage(AtlasResourceMapper.java:120) at org.apache.ranger.tagsync.source.atlas.AtlasOzoneResourceMapper.buildResource(AtlasOzoneResourceMapper.java:113) at org.apache.ranger.tagsync.source.atlas.AtlasResourceMapperUtil.getRangerServiceResource(AtlasResourceMapperUtil.java:64) at org.apache.ranger.tagsync.source.atlas.AtlasNotificationMapper.buildServiceTags(AtlasNotificationMapper.java:259) at org.apache.ranger.tagsync.source.atlas.AtlasNotificationMapper.buildServiceTags(AtlasNotificationMapper.java:198) at org.apache.ranger.tagsync.source.atlas.AtlasNotificationMapper.processAtlasEntities(AtlasNotificationMapper.java:105) at org.apache.ranger.tagsync.source.atlas.AtlasTagSource$ConsumerRunnable.buildAndUploadServiceTags(AtlasTagSource.java:255) at org.apache.ranger.tagsync.source.atlas.AtlasTagSource$ConsumerRunnable.run(AtlasTagSource.java:230) at java.lang.Thread.run(Thread.java:748)

      Sample command which causes issues: 

      $ CREATE EXTERNAL TABLE t1 (id int, name string) row format delimited fields terminated by ' ' stored as textfile location 'ofs://ozone1/volume1/bucket1/table_oz_demo1';

       

      Attachments

        Issue Links

          Activity

            People

              fateh288 Fateh Singh
              fateh288 Fateh Singh
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 40m
                  40m