[ARROW-17907] [Website] Blog about Arrow <--> Parquet translation and nesting

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Component/s: Website
• External issue URL: https://github.com/apache/arrow/issues/33117
• Assignee: Andrew Lamb
• Reporter: Andrew Lamb
• Created: 01/Oct/22 11:26
• Updated: 11/Jan/23 11:57
• Resolved: 17/Oct/22 20:39

Description

@tustvold has spent a significant amount of time fixing the Rust implementation of the parquet <–> arrow conversion logic for all the corner cases of nulls, etc. 

 

During that process, he observed there was a relative lack of information on the topic to be found, so we would like to write some blog posts to remedy that and explain the format and parquet

 

The basic outline is:

Part 1: Intro / Encoding Primitive Arrays in Arrow and Parquet
Part 2: Encoding Structs and Lists  in Arrow and Parquet
Part 3: Encoding Arbitrary Structs of Lists, Lists of Structs in Arrow and Parquet 

Sub-Tasks

• [Website] Arbitrarily Nested Data in Parquet and Arrow: Part 1: Introduction: Resolved
• [Website] Arbitrarily Nested Data in Parquet and Arrow: Part 2: Encoding Structs and Lists: Resolved
• [Website] Arbitrarily Nested Data in Parquet and Arrow: Part 3: Encoding Arbitrary Structs of Lists, Lists of Structs in Arrow and Parquet: Resolved