[ANY23-317] Any23 fails when dealing with JavaScript

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.1
• Fix Version/s: 2.2
• Component/s: core, extractors
• Assignee: Unassigned
• Reporter: Lewis John McGibbney
• Created: 26/Dec/17 15:48
• Updated: 25/Jan/18 07:47
• Resolved: 24/Jan/18 20:58

Description

Any23 always crashes when attempting to parse <script> code blocks from HTML. This is very annoying as, as we all know, JS is prevalent in a huge number of Websites.
I propose to undertake a check for the presence of <script> tag(s), if present, check if the type is type="application/ld+json", it is process, if not discard.

Any comments folks? Any other experiences to share?

Issue Links

• relates to: ANY23-324 Replace net.sourceforge.nekohtml with jsoup