[ARROW-4748] [Rust] [DataFusion] GROUP BY performance could be optimized

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.12.0
• Fix Version/s: 0.16.0
• Component/s: Rust, Rust - DataFusion
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/21267
• Assignee: Andy Grove
• Reporter: Andy Grove
• Created: 03/Mar/19 15:24
• Updated: 11/Jan/23 07:36
• Resolved: 13/Oct/19 15:29

Description

The logic to build the group by keys is row-based, performing an array downcast on every single group by value. This could be done in a columnar way instead.

 

I also wonder if it is possible to avoid converting the result map to an array of map entries.

Issue Links

• links to: GitHub Pull Request #5636