[NUTCH-1793] HttpRobotRulesParser not configured properly => "http.robots.403.allow" property is not read

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.8
• Fix Version/s: 1.9
• Component/s: protocol
• Assignee: Unassigned
• Reporter: Julien Nioche
• Created: 16/Jun/14 15:28
• Updated: 13/Mar/24 14:51
• Resolved: 17/Jun/14 08:42

Description

HttpRobotRulesParser is instanciated by HttpBase with an empty constructor and the conf() method is called later but relies on the super implementation and as a result the "http.robots.403.allow" property is not read.

Am OK to leave this property in HttpRobotRulesParser but it should override setConf so that the property is initialised properly.