Uploaded image for project: 'Apache Avro'
  1. Apache Avro
  2. AVRO-957

Added Codec Support to Avro-C

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.6.2
    • c

    Description

      We (Experian Hitwise) have added codec support to avro-c (as per the avro spec), with preliminary deflate/inflate support (as well as null codec support).

      This changes the way blocks are written to the file, with the block data being passed through the codec interface, before being written to file.

      This also changes the way blocks are read from a file, with the block data first being read into a buffer, before being passed through the codec interface, then a memory reader is set to the decoded data, which is read by the user calls avro_file_reader_read_value() and avro_file_reader_read()

      Please feel free to make changes, as although I did try to emulate the coding style of the rest of the avro c library, there may be things I've done "differently"

      Code is available from Github: https://github.com/hitwise/avro (branch: codec)

      Attachments

        1. 0001-Use-builtin-CMake-logic-to-find-zlib-and-lzma.patch
          3 kB
          Douglas Creager
        2. AVRO-957.patch
          101 kB
          Michael Cooper

        Issue Links

          Activity

            People

              Unassigned Unassigned
              lmartinking Lucas Martin-King
              Votes:
              1 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: