[ARROW-7177] [Java] Provide a utility to improve the performance of vector loading/unloading

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Component/s: Java
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/23476
• Assignee: Liya Fan
• Reporter: Liya Fan
• Created: 15/Nov/19 12:58
• Updated: 11/Jan/23 07:52
• Resolved: 12/Dec/19 04:13

Description

Vector loading/unloading transforms a set of vectors to and from a set of buffers with meta data. It is heavily used in flight/IPC.

In the loading/unloading operations, only the number of type buffers are really needed. However, the current code logic gets a copy of the type buffers, which is not necessary.

In this issue, we provide a utility to get the number of type buffers, given an arrow type. It improves the performance because it removes the following overhead:

1. creating type buffer objects unnecessarily.
2. creating a list and copying list contents (in TypeLayout#getBufferTypes) for vector unloading.

Issue Links

• links to: GitHub Pull Request #5842