[HIVE-4075] TypeInfoFactory is not thread safe and is access by multiple threads

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.10.0
• Fix Version/s: 0.11.0
• Assignee: Brock Noland Assign to me
• Reporter: Brock Noland
• Created: 26/Feb/13 21:36
• Updated: 17/May/13 01:10
• Resolved: 28/Feb/13 22:29

Description

TypeInfoFactory is not thread safe and when accessed by multiple threads calls to any of the methods can modify hashmaps concurrently resulting in infinite loops.

"pool-1-thread-240" prio=10 tid=0x00002aabd8bf7000 nid=0x5f4a runnable [0x0000000044626000] 
java.lang.Thread.State: RUNNABLE 
at java.util.HashMap.get(HashMap.java:303) 
at org.apache.hadoop.hive.serde2.typeinfo.TypeInfoFactory.getStructTypeInfo(TypeInfoFactory.java:94) 
at org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe.initSerdeParams(LazySimpleSerDe.java:237) 
at org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe.initialize(LazySimpleSerDe.java:182) 
at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:203) 
at org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:260) 
at org.apache.hadoop.hive.ql.metadata.Table.checkValidity(Table.java:167) 
at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:930) 
at org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeDropTable(DDLSemanticAnalyzer.java:706) 
at org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeInternal(DDLSemanticAnalyzer.java:212) 
at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:246) 
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:432) 
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:337) 
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:906) 
- locked <0x00002aaac6e1c270> (a java.lang.Object) 
at org.apache.hive.service.cli.operation.SQLOperation.run(SQLOperation.java:94)

Issue Links

• links to: Review Board