[AVRO-743] Java: Performance Regression and memory pressure with GenericDatumReader

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.5.0
• Fix Version/s: 1.5.0
• Component/s: java
• Assignee: Scott Carey
• Reporter: Scott Carey
• Created: 24/Jan/11 07:26
• Updated: 12/Mar/11 00:32
• Resolved: 07/Feb/11 18:37

Description

AVRO-650 introduced a large performance regression and memory bloat issue with GenericDatumReader.

Performance plummets for some Perf.java tests (One test took 1 hour to finish on my laptop).
Some minor changes I tried result in it passing in shorter time, but with still an 80% performance degredation.

This is associated with memory bloat related to ThreadLocals.

More details provided in comments.

Issue Links

• is related to: AVRO-650 failures under client concurrency