Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-10626

Add support for Iceberg's Catalogs API

    XMLWordPrintableJSON

    Details

      Description

      Some engines (e.g. Spark and Hive) use different table properties for defining catalog properties.

      In the main hive configuration they store the following properties:

      • iceberg.catalog.<catalog_name>.type = hadoop
      • iceberg.catalog.<catalog_name>.warehouse = somelocation

      On the table level they have the following properties:

      • iceberg.catalog = <catalog_name>
      • name = <database.table_name>

      To load tables that use these kind of configurations we should use Iceberg's Catalogs class:

      https://github.com/apache/iceberg/blob/master/mr/src/main/java/org/apache/iceberg/mr/Catalogs.java

      Probably we'll also want to use these properties by default in the future.

        Attachments

          Activity

            People

            • Assignee:
              boroknagyz Zoltán Borók-Nagy
              Reporter:
              boroknagyz Zoltán Borók-Nagy
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: