[NUTCH-1519] Configuration Overrides not in sync between WebTableReader and nutch-default.xml

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Auto Closed
• Affects Version/s: 2.1
• Fix Version/s: 2.5
• Component/s: crawldb, storage
• Assignee: Unassigned
• Reporter: Lewis John McGibbney
• Created: 16/Jan/13 20:47
• Updated: 13/Oct/19 22:36
• Resolved: 13/Oct/19 22:36

Description

In 2.x HEAD the WebTableReader class [0] provides Overrides for properties such as

currentJob.getConfiguration().setBoolean("mapreduce.fileoutputcommitter.marksuccessfuljobs", false);
currentJob.getConfiguration().setBoolean("db.reader.stats.sort", sort);

as well as

Configuration cfg = job.getConfiguration();
    cfg.set(WebTableRegexMapper.regexParamName, regex);
    cfg.setBoolean(WebTableRegexMapper.contentParamName, content);
    cfg.setBoolean(WebTableRegexMapper.headersParamName, headers);
    cfg.setBoolean(WebTableRegexMapper.linksParamName, links);
    cfg.setBoolean(WebTableRegexMapper.textParamName, text);

None of these are actually present and therefore configurable an able to be Overridden.
This should be sorted out.

[0] http://svn.apache.org/repos/asf/nutch/branches/2.x/src/java/org/apache/nutch/crawl/WebTableReader.java