[TIKA-599] Thread issue with autodetect parser

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.9
• Fix Version/s: 0.10
• Component/s: parser

Environment

SunOS xxx 5.10 Generic_142901-13 i86pc i386 i86pc Solaris
java version "1.6.0_14"
Java(TM) SE Runtime Environment (build 1.6.0_14-b08)
Java HotSpot(TM) Server VM (build 14.0-b16, mixed mode)

• Assignee: Jukka Zitting
• Reporter: Erik Hetzner
• Created: 19/Feb/11 23:28
• Updated: 20/Oct/11 12:34
• Resolved: 09/Mar/11 18:21

Description

When using tika to index web crawls, I seem to have run across a thread-safety issue with the autodetect parser. My indexer has gone into an apparent loop with all 5 threads in the same bit of code:

"Thread-5" prio=3 tid=0x0898a400 nid=0x19 runnable [0x75238000]
java.lang.Thread.State: RUNNABLE
at java.util.HashMap.get(HashMap.java:303)
at org.ccil.cowan.tagsoup.Schema.getElementType(Schema.java:122)
at org.ccil.cowan.tagsoup.Parser.gi(Parser.java:959)
at org.ccil.cowan.tagsoup.HTMLScanner.scan(HTMLScanner.java:505)
at org.ccil.cowan.tagsoup.Parser.parse(Parser.java:449)
at org.apache.tika.parser.html.HtmlParser.parse(HtmlParser.java:198)
at org.apache.tika.parser.CompositeParser.parse(CompositeParser.java:197)
at org.apache.tika.parser.CompositeParser.parse(CompositeParser.java:197)
at org.apache.tika.parser.AutoDetectParser.parse(AutoDetectParser.java:135)
....

This is the same line in HashMap as we see in TIKA-374.

Let me know if you need any more information. This is with the latest tika-0.9.