Avro
  1. Avro
  2. AVRO-557

Speed up one-time data decoding

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.3.2
    • Fix Version/s: 1.4.0
    • Component/s: java
    • Labels:
    • Hadoop Flags:
      Reviewed

      Description

      There are big gains to be had in performance when using a BinaryDecoder and a GenericDatumReader just one time. This is due to the relatively expensive parsing and initialization that came with 1.3. Patch with example code and a Perf harness to follow.

      1. AVRO-557.patch
        31 kB
        Kevin Oliver
      2. AVRO-557.patch
        5 kB
        Doug Cutting
      3. AVRO-557.patch
        6 kB
        Doug Cutting
      4. AVRO-557.patch
        11 kB
        Doug Cutting
      5. AVRO-557-partial.patch
        10 kB
        Scott Carey
      6. AVRO-557.patch
        18 kB
        Doug Cutting

        Activity

        Kevin Oliver created issue -
        Kevin Oliver made changes -
        Field Original Value New Value
        Attachment AVRO-557.patch [ 12446171 ]
        Kevin Oliver made changes -
        Labels performance
        Doug Cutting made changes -
        Attachment AVRO-557.patch [ 12451682 ]
        Doug Cutting made changes -
        Attachment AVRO-557.patch [ 12451692 ]
        Doug Cutting made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Assignee Kevin Oliver [ kevinoliver ] Doug Cutting [ cutting ]
        Doug Cutting made changes -
        Attachment AVRO-557.patch [ 12451703 ]
        Scott Carey made changes -
        Attachment AVRO-557-partial.patch [ 12451705 ]
        Doug Cutting made changes -
        Attachment AVRO-557.patch [ 12451712 ]
        Doug Cutting made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Resolution Fixed [ 1 ]
        Doug Cutting made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Doug Cutting
            Reporter:
            Kevin Oliver
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development