[NUTCH-2678] Allow for per-host configurable protocol plugin

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.15
• Fix Version/s: 1.16
• Component/s: protocol
• Patch Info: Patch Available
• Assignee: Markus Jelsma
• Reporter: Markus Jelsma
• Created: 10/Dec/18 14:01
• Updated: 28/Jan/21 13:56
• Resolved: 18/Jan/19 12:28

Description

Introduces new configuration file for mapping protocol plugins to hostnames.

# This file defines a hostname to protocol plugin mapping. Each line takes a
# host name followed by a tab, followed by the ID of the protocol plugin. You
# can find the ID in the protocol plugin's plugin.xml file.
# 
# <hostname>\t<plugin_id>\n
# nutch.apache.org      org.apache.nutch.protocol.httpclient.Http
# tika.apache.org       org.apache.nutch.protocol.http.Http
#

Issue Links

• contains: NUTCH-2653 ProtocolFactory.getProtocol(url) creates separate plugin instances for http/https
• duplicates: NUTCH-2126 Use selenium protocol for specific sites
• links to: GitHub Pull Request #431