Details
Description
I suggest that a parameter is added to nutch-default.xml which allows to generate a proxy exception list.
<property>
<name>http.proxy.exception.list</name>
<value></value>
<description>URL's and hosts that don't use the proxy (e.g. intranets)</description>
</property>
This is useful when scanning intranet/internet combinations from behind a firewall. A preliminary patch is added to this extend to this request, showing the changes. We will test it and update it if necessary. this also reflects the reality in web browsers, where there is in most cases an exception list.