Uploaded image for project: 'Apache Avro'
  1. Apache Avro
  2. AVRO-554

data files created by ruby DataWriter are extremely large

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.3.0, 1.4.0
    • Fix Version/s: 1.3.3
    • Component/s: ruby
    • Labels:
      None
    • Environment:

      avro-1.4.0-pre1, ruby 1.8.7 (2010-01-10 patchlevel 249) [x86_64-linux]

      Description

      Adding 10000 records of a very simple schema (3 fields) to a DataWriter results in a file that is 317mb. The same records in JSON are 430k.

        Attachments

        1. avro_comp.rb
          0.8 kB
          Grant Rodgers
        2. AVRO-554.patch
          0.4 kB
          Grant Rodgers
        3. AVRO-554-2.patch
          1 kB
          Grant Rodgers
        4. data10.avr
          0.3 kB
          Grant Rodgers
        5. data100.avr
          0.9 kB
          Grant Rodgers
        6. data3000.avr.gz
          18 kB
          Grant Rodgers
        7. patched-data3000.avr
          21 kB
          Grant Rodgers

          Activity

            People

            • Assignee:
              grantr Grant Rodgers
              Reporter:
              grantr Grant Rodgers
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: