Details
-
Sub-task
-
Status: Closed
-
Critical
-
Resolution: Fixed
-
1.7.7
-
None
-
None
Description
org.apache.avro.LogicalTypes#fromSchemaIgnoreInvalid lookups and update CACHE. CACHE is backed by hashmap without synchronization. In a multithreaded environment, it causes a infinite loop in hashmap lookup. The race condition problem is described in the following blog http://mailinator.blogspot.com/2009/06/beautiful-race-condition.html.
I experience this infinite loop in Spark jobs with high concurrency.
Attachments
Issue Links
- duplicates
-
AVRO-1781 Schema.parse is not thread safe
- Closed