[ARROW-10240] [Rust] [Datafusion] Optionally load tpch data into memory before running benchmark query

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: Rust, Rust - DataFusion
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/26238
• Assignee: Jörn Horstmann
• Reporter: Jörn Horstmann
• Created: 08/Oct/20 22:00
• Updated: 11/Jan/23 08:12
• Resolved: 10/Oct/20 18:52

Description

The tpch benchmark runtime seems to be dominated by csv parsing code and it is really difficult to see any performance hotspots related to actual query execution in a flamegraph.

With the date in memory and more iterations it should be easier to profile and find bottlenecks.

Issue Links

• links to: GitHub Pull Request #8409