Uploaded image for project: 'Apache Avro'
  1. Apache Avro
  2. AVRO-1332

Improve C# DatumReader performance

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 1.7.5
    • 1.7.6
    • csharp
    • Improved DatumReader performance

    Description

      The current implementations of the C# datum readers perform resolution of the reader and writer schema on every call to Read. In my tests this was causing it to perform poorly when reading a large number of records (slower than parsing the same data from delimited text files). It would be more efficient if the reader only needed to resolve the schemas once.

      Attachments

        1. AVRO-1332-missing-files-plus-defaults-patch.patch
          132 kB
          David McIntosh
        2. AVRO-1332-defaults-patch-only.patch
          5 kB
          David McIntosh
        3. AVRO-1332-4.patch
          176 kB
          David McIntosh
        4. AVRO-1332-3.patch
          165 kB
          David McIntosh
        5. AVRO-1332-2.patch
          163 kB
          David McIntosh
        6. AVRO-1332.patch
          55 kB
          David McIntosh

        Activity

          People

            dmcintosh David McIntosh
            dmcintosh David McIntosh
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: