[DRILL-7331] Support Iceberg metadata expiration

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.17.0
• Labels: doc-impacting ready-to-commit
• Assignee: Arina Ielchiieva
• Reporter: Arina Ielchiieva
• Reviewer: Vova Vysotskyi
• Created: 24/Jul/19 10:05
• Updated: 05/Aug/19 07:50
• Resolved: 05/Aug/19 07:50

Description

Currently Iceberg produces snapshots and table metadata for each modification operation.
Plus it does not retire outdated data files. All these information is stored and in metadata folder and with time occupy lots of space. This Jira aims to expire outdated snapshots, table metadata and data files based on configured expiration period.

Iceberg has already mechanism to retire snapshots and data files. Mechanism to expire table metadata needs to be implemented (https://github.com/apache/incubator-iceberg/issues/181).

Issue Links

• links to: GitHub Pull Request #1831