Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-11034

Resolve schema of old data files in migrated Iceberg tables

    XMLWordPrintableJSON

Details

    • ghx-label-3

    Description

      When external tables are converted to Iceberg, the data files remain intact.
      This means that the old data files don't have field id information which is essential for schema evolution.

      However, there is a workaround for this, see: https://github.com/trinodb/trino/issues/9843

      We need to create a NameMapping which maps field ids to column names, then we can do column resolution in the legacy files with the help of the name mapping.

      Attachments

        Issue Links

          Activity

            People

              gfurnstahl Gergely Fürnstáhl
              boroknagyz Zoltán Borók-Nagy
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: