[ARROW-11053] [Rust] [DataFusion] Optimize joins with dynamic capacity for output batches

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Fix Version/s: 3.0.0
• Component/s: Rust - DataFusion
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/26969
• Assignee: Andy Grove
• Reporter: Andy Grove
• Created: 28/Dec/20 22:13
• Updated: 11/Jan/23 08:17
• Resolved: 30/Dec/20 18:20

Description

Rather than using the size of the left or right batches to determine the capacity of the output batches we can use the average size of previous output batches.

Issue Links

• links to: GitHub Pull Request #9036