Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-5845 [Java] Implement converter between Arrow record batches and Avro records
  3. ARROW-6593

[Java] Experiment with performance difference of avoiding the use of Avro Decoder

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Java

    Description

      It has been posited that the Decoder object (and on-heap work in general) is potentially slow for decoding.

       

      The scope of this Jira is to add a new method that instead of consuming from Decoder, consumes directly from a ByteBuffer.  In order to this we there needs to be utility classes for zig-zag decoding (one might existing in avro) from a ByteBuffer.

       

      This is esentially rewriting logic in the decoder to work directly against a bytebuffer and then measure if there is a meaningful performance impact.

       

       

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              emkornfield@gmail.com Micah Kornfield
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: