[NUTCH-2421] parse-html to prioritize HTML5 charset definitions

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 1.15
• Fix Version/s: 1.21
• Component/s: parser
• Assignee: Unassigned
• Reporter: Laurent Hervaud
• Created: 19/Sep/17 10:53
• Updated: 30/Mar/24 17:19

Description

jira NUTCH-1733 add support to HTML5 charset definitions.
In some case web site declare multiple meta element with different charset :
<meta charset="utf-8">
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
(ex : http://www.edga.fr/)
In this case the second charset is detected (iso-8859-1).
What about prioritize HTML5 charset definitions first ?