Uploaded image for project: 'Apache Avro'
  1. Apache Avro
  2. AVRO-957

Added Codec Support to Avro-C

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.6.2
    • c

    Description

      We (Experian Hitwise) have added codec support to avro-c (as per the avro spec), with preliminary deflate/inflate support (as well as null codec support).

      This changes the way blocks are written to the file, with the block data being passed through the codec interface, before being written to file.

      This also changes the way blocks are read from a file, with the block data first being read into a buffer, before being passed through the codec interface, then a memory reader is set to the decoded data, which is read by the user calls avro_file_reader_read_value() and avro_file_reader_read()

      Please feel free to make changes, as although I did try to emulate the coding style of the rest of the avro c library, there may be things I've done "differently"

      Code is available from Github: https://github.com/hitwise/avro (branch: codec)

      Attachments

        1. 0001-Use-builtin-CMake-logic-to-find-zlib-and-lzma.patch
          3 kB
          Douglas Creager
        2. AVRO-957.patch
          101 kB
          Michael Cooper

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            lmartinking Lucas Martin-King
            Votes:
            1 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment