[HUDI-757] Add a command to hudi-cli to export commit metadata

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 0.6.0
• Labels: pull-request-available
• Assignee: Prashant Wason
• Reporter: Prashant Wason
• Created: 01/Apr/20 05:24
• Updated: 26/Apr/20 11:02
• Resolved: 26/Apr/20 11:02

Description

HUDI stores commit related information in files within the .hoodie directory. Each commit / delatacommit / rollback / etc creates one or more files. To prevent a large number of files, older files are consolidated together and moved into a commit archive which has multiple such files written together using the format of HUDI Log files.

During debugging of issues or for development of new features, it may be required to refer to the metadata of older commits / cleanups / rollbacks. There is no simple way to get these from a production setup especially from the archive files.

This enhancement provides a hudi cli command which allows exporting metadata from HUDI commit archives.

Issue Links

• links to: GitHub Pull Request #1476