Uploaded image for project: 'Apache Avro'
  1. Apache Avro
  2. AVRO-1332

Improve C# DatumReader performance

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.7.5
    • Fix Version/s: 1.7.6
    • Component/s: csharp
    • Labels:
    • Release Note:
      Improved DatumReader performance

      Description

      The current implementations of the C# datum readers perform resolution of the reader and writer schema on every call to Read. In my tests this was causing it to perform poorly when reading a large number of records (slower than parsing the same data from delimited text files). It would be more efficient if the reader only needed to resolve the schemas once.

        Attachments

        1. AVRO-1332.patch
          55 kB
          David McIntosh
        2. AVRO-1332-2.patch
          163 kB
          David McIntosh
        3. AVRO-1332-3.patch
          165 kB
          David McIntosh
        4. AVRO-1332-4.patch
          176 kB
          David McIntosh
        5. AVRO-1332-defaults-patch-only.patch
          5 kB
          David McIntosh
        6. AVRO-1332-missing-files-plus-defaults-patch.patch
          132 kB
          David McIntosh

          Activity

            People

            • Assignee:
              dmcintosh David McIntosh
              Reporter:
              dmcintosh David McIntosh
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: