Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
6.0.0
Description
The IPC reader operates at the granularity of an entire record batch; even if you're loading only a few columns, the entire record batch is read. ARROW-12683 partially addressed this issue by enabling this capability for sync read API, however, async read API still lacks of this capability.
Attachments
Issue Links
- is duplicated by
-
ARROW-14429 [C++] RecordBatchFileReader performance really bad in S3
- Closed
- relates to
-
ARROW-12683 [C++] Enable fine-grained I/O (coalescing) in IPC reader
- Resolved
- links to