Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-21663

Hive Metastore Translation Layer

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.0.0
    • Component/s: Standalone Metastore
    • Labels:
      None
    • Target Version/s:

      Description

      This task is for the implementation of the default provider for translation, that is extensible if needed for a custom translator. Please refer the spec for additional details on the translation.

        Attachments

        1. HIVE-21663.3.patch
          1.28 MB
          Naveen Gangam
        2. HIVE-21663.4.patch
          1.60 MB
          Naveen Gangam
        3. HIVE-21663.5.patch
          1.60 MB
          Naveen Gangam
        4. HIVE-21663.6.patch
          1.60 MB
          Naveen Gangam
        5. HIVE-21663.7.patch
          1.60 MB
          Naveen Gangam
        6. HIVE-21663.8.patch
          1.60 MB
          Naveen Gangam
        1.
        HMS Translation layer - Thrift API changes Sub-task Resolved Naveen Gangam  
        2.
        HMS Translation: Pending items from code review Sub-task Resolved Naveen Gangam  
        3.
        Make hive side changes to enforce table access type on queries. Sub-task Open Unassigned  
        4.
        HMS Translation: External tables with no capabilities returns duplicate entries/ Sub-task Resolved Naveen Gangam  
        5.
        HMS Translation: Refactor tests to work with ACID tables. Sub-task Resolved Naveen Gangam  
        6.
        Testcases are randomly failing with ArrayIndexOutOfBoundException Sub-task Resolved Naresh P R  
        7.
        Hive Metastore Translation: Add API call to tell client why table has limited access Sub-task Resolved Naveen Gangam  
        8.
        Hive Metastore Translation: Bucketed table ReadOnly capability Sub-task Open Naveen Gangam  
        9.
        HMS Translation: Hive need to block create a type of table if the client does not have write capability Sub-task Resolved Naveen Gangam  
        10.
        HMS Translation: Translate getDatabase() API to alter warehouse location Sub-task Resolved Naveen Gangam  
        11.
        Hive.get() resets the capabilities from HiveConf instead of set capabilities Sub-task Resolved Naveen Gangam  
        12.
        Use GetDatabaseResponse to allow for future extension Sub-task Open Naveen Gangam  
        13.
        HMS Translation layer - Disallow non-ACID MANAGED tables. Sub-task Resolved Naveen Gangam  
        14.
        HMS Translation layer - Turn off HMS Translation by default. Sub-task Open Naveen Gangam  
        15.
        HMS Translation: Enforce strict locations for managed vs external tables. Sub-task Resolved Naveen Gangam  
        16.
        HMS Translation: Limit translation to hive default catalog only Sub-task Resolved Naveen Gangam  
        17.
        HMS Translation: HIVE-22189 too strict with location for EXTERNAL tables Sub-task Resolved Naveen Gangam  
        18.
        Remove default value for Capabilities from HiveConf Sub-task Resolved Naveen Gangam  
        19.
        Schema tool enhancements to merge catalogs Sub-task Resolved Naveen Gangam  
        20.
        Disallow ACID table location outside hive warehouse Sub-task Open Naveen Gangam  
        21.
        Metastore's table location check should be applied when location changed Sub-task Resolved Attila Magyar  
        22.
        Add support for unmodified_metadata capability Sub-task Resolved Naveen Gangam  
        23.
        transformDatabase() should work with changes from HIVE-22995 Sub-task Resolved Naveen Gangam

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 40m
        24.
        Ease database managed location restrictions in HMS translation Sub-task Open Naveen Gangam  

          Activity

            People

            • Assignee:
              ngangam Naveen Gangam
              Reporter:
              ngangam Naveen Gangam
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 40m
                40m