Uploaded image for project: 'Apache Avro'
  1. Apache Avro
  2. AVRO-554

data files created by ruby DataWriter are extremely large

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.3.0, 1.4.0
    • 1.3.3
    • ruby
    • None

    • avro-1.4.0-pre1, ruby 1.8.7 (2010-01-10 patchlevel 249) [x86_64-linux]

    Description

      Adding 10000 records of a very simple schema (3 fields) to a DataWriter results in a file that is 317mb. The same records in JSON are 430k.

      Attachments

        1. AVRO-554-2.patch
          1 kB
          Grant Rodgers
        2. AVRO-554.patch
          0.4 kB
          Grant Rodgers
        3. patched-data3000.avr
          21 kB
          Grant Rodgers
        4. data3000.avr.gz
          18 kB
          Grant Rodgers
        5. data100.avr
          0.9 kB
          Grant Rodgers
        6. data10.avr
          0.3 kB
          Grant Rodgers
        7. avro_comp.rb
          0.8 kB
          Grant Rodgers

        Activity

          People

            grantr Grant Rodgers
            grantr Grant Rodgers
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: