[ARROW-10931] [Rust] [Parquet] Improve performance of the parquet compressors

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Rust
• External issue URL: https://github.com/apache/arrow/issues/18421
• Assignee: Unassigned
• Reporter: Andrew Lamb
• Created: 15/Dec/20 20:55
• Updated: 11/Jan/23 08:16

Description

As part of moving to stable Rust (ARROW-10636), we lost some amount of performance in the parquet compressors. The improvement to stable rust was deemed worthwhile but gbowyer thinks there is additional changes could be made to improve the compressors.

More detail can be found here;
https://github.com/apache/arrow/pull/8698#issuecomment-740958408

Issue Links

• relates to: ARROW-10636 [Rust] Remove specialisation from Rust parquet