[ARROW-6593] [Java] Experiment with performance difference of avoiding the use of Avro Decoder

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Java
• Labels: avro
• External issue URL: https://github.com/apache/arrow/issues/16886
• Assignee: Unassigned
• Reporter: Micah Kornfield
• Created: 18/Sep/19 05:43
• Updated: 11/Jan/23 07:48

Description

It has been posited that the Decoder object (and on-heap work in general) is potentially slow for decoding.

 

The scope of this Jira is to add a new method that instead of consuming from Decoder, consumes directly from a ByteBuffer.  In order to this we there needs to be utility classes for zig-zag decoding (one might existing in avro) from a ByteBuffer.

 

This is esentially rewriting logic in the decoder to work directly against a bytebuffer and then measure if there is a meaningful performance impact.

 

 

Issue Links

• is a clone of: ARROW-6592 [Java] Add support for skipping decoding of columns/field in Avro converter