[PARQUET-1422] [C++] Use Arrow IO interfaces natively rather than current parquet:: wrappers

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: cpp-4.0.0
• Component/s: parquet-cpp
• Labels: pull-request-available
• Assignee: Wes McKinney
• Reporter: Wes McKinney
• Created: 21/Sep/18 15:32
• Updated: 23/Jun/24 03:30
• Resolved: 31/May/19 15:13

Description

We are beginning to do some work on asynchronous IO in Arrow and it would be great to be able to leverage this in the Parquet core internals.

I am proposing to remove the Parquet-specific virtual file interfaces in

https://github.com/apache/arrow/blob/master/cpp/src/parquet/util/memory.h#L221

and instead rely directly on the Arrow ones in arrow::io. In addition to reducing the amount of code we have to maintain, we will also be able to improve performance of Parquet by utilizing common utilities for managing asynchronous / background IO

cc mdeepak xhochy

Issue Links

• is related to: ARROW-3166 [C++] Consolidate IO interfaces used in arrow/io and parquet-cpp
• links to: GitHub Pull Request #4404