[ARROW-6219] [Java] Add API for JDBC adapter that can convert less then the full result set at a time.

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.15.0
• Component/s: Java
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/22607
• Assignee: Ji Liu
• Reporter: Micah Kornfield
• Created: 13/Aug/19 03:51
• Updated: 11/Jan/23 07:45
• Resolved: 16/Aug/19 02:36

Description

Somehow we should configure number of rows per batch and either let clients iterate or provide an iterator API.  Otherwise for large result sets we might run out of memory.

Issue Links

• relates to: ARROW-6202 [Java] Exception in thread "main" org.apache.arrow.memory.OutOfMemoryException: Unable to allocate buffer of size 4 due to memory limit. Current allocation: 2147483646
• links to: GitHub Pull Request #5075