Details
-
Wish
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
Description
A RecordBatch is currently sorted as a one-chunk Table. It is suboptimal as it's paying the chunk resolution cost even though it's not necessary.
A dedicated RecordBatch sort may also form the basis for a faster Table sort (first sort individual batches, then use merge sort along the sorted batches).
Attachments
Issue Links
- relates to
-
ARROW-10898 [C++] Investigate Table sort performance
- Resolved
- links to