Uploaded image for project: 'Avro'
  1. Avro
  2. AVRO-328

Performance improvements Validating encoder/decoder for nested records

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.3.0
    • Component/s: java
    • Labels:
      None

      Description

      With nested records, Parser.pushProduction() gets called multiple times (once per record nesting). Since we do not have any events for beginning and end of records, it enhances the performance if we flatten the grammar, wherever possible.

      The forthcoming patch does just that.

      Try org.apache.avro.io.Perf -N

      On my machine (HP laptop with Cygwin) the improvement is about 20%.

      1. AVRO-328.patch
        8 kB
        Thiruvalluvan M. G.
      2. AVRO-328-test.patch
        2 kB
        Thiruvalluvan M. G.

        Activity

        Hide
        thiru_mg Thiruvalluvan M. G. added a comment -

        Improved Perf to check if it reads back what was written.

        Show
        thiru_mg Thiruvalluvan M. G. added a comment - Improved Perf to check if it reads back what was written.
        Hide
        thiru_mg Thiruvalluvan M. G. added a comment -

        Committed revision 899888.

        Show
        thiru_mg Thiruvalluvan M. G. added a comment - Committed revision 899888.

          People

          • Assignee:
            thiru_mg Thiruvalluvan M. G.
            Reporter:
            thiru_mg Thiruvalluvan M. G.
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development