Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-10947

SQL support for querying Iceberg metadata

Agile BoardAttach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Epic
    • Status: In Progress
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Frontend

    Description

      HIVE-25457 added support for querying Iceberg table metadata to Hive.

      They support the following syntax:
      SELECT * FROM default.iceberg_table.history;

      Spark uses the same syntax: https://iceberg.apache.org/spark-queries/#history

      Other than "history", the following metadata tables are available in Iceberg:
      The following metadata tables are available in Iceberg:

      • ENTRIES,
      • FILES,
      • HISTORY,
      • SNAPSHOTS,
      • MANIFESTS,
      • PARTITIONS,
      • ALL_DATA_FILES,
      • ALL_MANIFESTS,
      • ALL_ENTRIES

      Impala currently only supports "DESCRIBE HISTORY <tbl>". The above SELECT syntax would be more convenient for the users, also it would be more flexible as users could easily define filters in WHERE clauses. And of course we would be consistent with other engines.

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            daniel.becker Daniel Becker
            boroknagyz Zoltán Borók-Nagy

            Dates

              Created:
              Updated:

              Slack

                Issue deployment