[AVRO-1760] Thread scalability problem with the use of SynchronizedMap

• Type: Improvement
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.7.4, 1.7.5, 1.7.6, 1.7.7, 1.8.0, 1.8.1, 1.9.0
• Fix Version/s: 1.8.0
• Component/s: java
• Labels: patch performance
• Hadoop Flags: Reviewed
• Flags: Patch, Important
• Assignee: Thomas White
• Reporter: Mulugeta Mammo
• Created: 23/Nov/15 18:12
• Updated: 01/Feb/16 14:56
• Resolved: 18/Jan/16 10:54

Description

While running Adam Genomics (which uses Avro) on Apache Spark, we discovered that threads (tasks in Spark Context) block in Avro while executing the getDefaultValue(Field field) method in https://github.com/apache/avro/blob/trunk/lang/java/avro/src/main/java/org/apache/avro/generic/GenericData.java

Issue Links

• relates to: AVRO-1781 Schema.parse is not thread safe