Details
-
Task
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
@tustvold has spent a significant amount of time fixing the Rust implementation of the parquet <–> arrow conversion logic for all the corner cases of nulls, etc.
During that process, he observed there was a relative lack of information on the topic to be found, so we would like to write some blog posts to remedy that and explain the format and parquet
The basic outline is:
Part 1: Intro / Encoding Primitive Arrays in Arrow and Parquet
Part 2: Encoding Structs and Lists in Arrow and Parquet
Part 3: Encoding Arbitrary Structs of Lists, Lists of Structs in Arrow and Parquet