[ARROW-16771] [Format][C++][Go] Adding Run-Length encoding to Arrow

• Type: Task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: C++, Format, Go
• External issue URL: https://github.com/apache/arrow/issues/32104
• Assignee: Unassigned
• Reporter: Tobias Zagorni
• Created: 07/Jun/22 13:06
• Updated: 11/Jan/23 11:46

Description

As discussed here:

https://lists.apache.org/thread/djy8xn28p264vhj8y5rqbgkgwss6oyo1

 

Sub-Tasks

• [C++] Handling of array-only types using VisitTypeInline: In Progress
• [C++] Add type ID, Type and Array classes for RLE: In Progress
• [C++] Utility functions for working with RLE: In Progress
• [C++] Array Builder for RLE Arrays: Open
• [C++] Validation for RLE arrays: Open
• [C++] Compare RLE Arrays: In Progress
• [C++] Kernel input type matcher for RLE: In Progress
• [C++] Pretty Printing for RLE arrays: Open
• [C++] Concatenate implementation for RLE: In Progress
• [C++] Complete RunLengthEncoded type: Open
• [C++] Implement encode and decode functions for Run-Length encoding: In Progress
• [Docs][Format] Document Run-Length encoding in Arrow columnar format: In Progress
• [Docs][C++] Guide to to work with RLE data (in kernels?): Open
• [C++] Create Filter Kernel on RLE data: Open
• [C++] Add RLE benchmarks: Open
• [Format] Add RLE definitions to FlatBuffers: In Progress
• [Format][C++] Support RLE in IPC format: In Progress
• [C++][Archery] JSON integration testing with RLE: In Progress
• [C++] Reading and Writing RLE data from/to Parquet: Open
• [Go] Implement RLE Array and Compare: In Progress
• [Go] Array Builder for RLE Arrays: In Progress
• [Go] Concatenate Implementation for RLE Array: In Progress
• [Go] RLE Arrays IPC read/write: In Progress
• [Go] Implement Encode and Decode functions for RLE: Open
• [Go] Add RLE Benchmarks: Open
• [Go] Kernel Input Type Matcher for RLE: In Progress