[#NUTCH-337] Fetcher ignores the fetcher.parse value configured in config file

Nutch

Fetcher ignores the fetcher.parse value configured in config file

Created: 02/Aug/06 12:04 AM Updated: 23/Sep/06 06:56 PM

Return to search

Component/s:

fetcher

Affects Version/s:

0.8, 0.9.0

Fix Version/s:

0.8.1, 0.9.0

Time Tracking:

Not Specified

File Attachments:

	File Name	Date Attached	Attached By	Size
	respectFetcherParsePropertyV1.patch	2006-08-18 06:31 AM	Stefan Groschupf	0.5 kB

Resolution Date:

23/Sep/06 06:56 PM

Description

« Hide

using the command line call to Fetcher, if the noParsing parameter is given, everything is fine.
if the noParsing is not given, the value in the nutch-site.xml (or nutch-default.xml) should be taken but it is "true" that is always given to the call to fetch.
it should be the value from the conf.

All

Comments

Work Log

Change History

Subversion Commits

Sort Order:

[ Permlink | « Hide ]

Stefan Groschupf added a comment - 18/Aug/06 06:31 AM

Hi Jeremy, thanks for catching this. Attached a fix. Should be easy for a contributor to commit this to trunk....

Stefan Groschupf made changes - 18/Aug/06 06:31 AM

Field	Original Value	New Value
Attachment		respectFetcherParsePropertyV1.patch [ 12339071 ]

Stefan Groschupf made changes - 18/Aug/06 06:31 AM

Priority

Trivial [ 5 ]

Major [ 3 ]

Repository	Revision	Date	User	Message
ASF	#449287	Sat Sep 23 18:50:56 UTC 2006	ab	~~NUTCH-337~~: obey "fetcher.parse" property if -noParsing is not specified.
				Files Changed
				MODIFY /lucene/nutch/trunk/src/java/org/apache/nutch/crawl/Crawl.java MODIFY /lucene/nutch/trunk/src/java/org/apache/nutch/fetcher/Fetcher.java

[ Permlink | « Hide ]

Andrzej Bialecki added a comment - 23/Sep/06 06:56 PM

Patch applied to branch-0.8 and trunk. Thanks!

Andrzej Bialecki made changes - 23/Sep/06 06:56 PM

Status	Open [ 1 ]	Closed [ 6 ]
Resolution		Fixed [ 1 ]
Fix Version/s		0.8.1 [ 12312020 ]
Fix Version/s		0.9.0 [ 12312013 ]

Repository	Revision	Date	User	Message
ASF	#449289	Sat Sep 23 19:00:13 UTC 2006	ab	~~NUTCH-337~~: obey "fetcher.parse" property if -noParsing is not specified.
				Files Changed
				MODIFY /lucene/nutch/branches/branch-0.8/CHANGES.txt MODIFY /lucene/nutch/branches/branch-0.8/src/java/org/apache/nutch/crawl/Crawl.java MODIFY /lucene/nutch/branches/branch-0.8/src/java/org/apache/nutch/fetcher/Fetcher.java