[NUTCH-2670] org.apache.nutch.indexer.IndexerMapReduce does not read the value of "indexer.delete" from nutch-site.xml

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Not A Problem
• Affects Version/s: 1.14, 1.15
• Component/s: indexer

Environment

macOS Mojave and High Sierra
MacBook Pro (Retina, 13-inch, Mid 2014)
Oracle Java 1.8.0_144-b01 and previous versions

• Assignee: Unassigned
• Reporter: Junqiang Zhang
• Created: 29/Oct/18 11:02
• Updated: 28/Jan/21 14:04
• Resolved: 07/Jan/19 10:11

Description

Inside org.apache.nutch.indexer.IndexerMapReduce.IndexerReducer, the setup() function should read the value of "indexer.delete" from nutch-site.xml, and assign the value to the variable of "delete". See the following line of code.
(line 201) delete = conf.getBoolean(INDEXER_DELETE, false);

However, the value of "indexer.delete" set in nutch-site.xml and nutch-default.xml is not assigned to the variable, "delete". I put the following setting in one of nutch-site.xml and nutch-default.xml, or in both of them. The variable of "delete" remains false.

<property>
<name>indexer.delete</name>
<value>true</value>
<description>Whether the indexer will delete documents GONE or REDIRECTS by indexing filters
</description>
</property>

I also changed the line of code to
delete = conf.getBoolean(INDEXER_DELETE, true);

Whatever value of "indexer.delete" is set in nutch-site.xml or nutch-default.xml, the value of "delete" remains false.