[ARROW-6460] [Java] Add benchmark and large fake data UT for avro adapter

• Type: Sub-task
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 0.15.0
• Component/s: Java
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/22830
• Assignee: Ji Liu
• Reporter: Ji Liu
• Created: 05/Sep/19 04:39
• Updated: 11/Jan/23 07:47
• Resolved: 18/Sep/19 04:44

Description

To avoid OOM, we have implement iterator API in ARROW-6220.

This issue is about to add tests with a large fake data set (say 6MM rows in JDBC adapter test) and ensures no OOMs occur.

 

Issue Links

• is blocked by: ARROW-6220 [Java] Add API to avro adapter to limit number of rows returned at a time.
• links to: GitHub Pull Request #5317