Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-27323 Iceberg: malformed manifest file or list can cause data breach
  3. HIVE-27926

Iceberg: Allow restricting Iceberg data file reads to table location

    XMLWordPrintableJSON

Details

    Description

      As the first quick solution there should be a configuration flag to allow us to restrict Iceberg reads to data files located only inside of the table locations.

      e.g. with the following definition

      CREATE EXTERNAL TABLE default.iceloc1 (txt string, secret string)
      STORED BY ICEBERG 
      LOCATION '/data/hive/external/iceloc1/'
      TBLPROPERTIES (
        'external.table.purge'='true',
        'write.metadata.path'='/data/ice/meta/iceloc1/',
        'write.data.path'='/data/ice/data/iceloc1/');
      

      The restricted location should be

      /data/hive/external/iceloc1/
      

      Note: this configuration should not be enabled by default as this breaks Iceberg's functionality storing data files in different locations and would only be useful when users use iceberg only as standard external tables with meta+data under table location.

      Attachments

        Issue Links

          Activity

            People

              ayushtkn Ayush Saxena
              jkovacs@HW Janos Kovacs
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: