Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
Design a general extension mechanism for Parquet with the following requirements:
- old readers must be able to parse files written with the extension
- new readers must be able to parse files written with/without the extension and deterministically detect if the extension is present or not
Initial ideas: https://docs.google.com/document/d/1PQpY418LkIDHMFYCY8ne_G-CFpThK15LLpzWYbc7rFU/edit
Attachments
Issue Links
- links to