[NUTCH-148] org.apache.nutch.tools.CrawlTool throws error while doing deleteduplicates

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 0.8
• Component/s: indexer

Environment

Windows XP Home

• Assignee: Unassigned
• Reporter: raghavendra prabhu
• Created: 22/Dec/05 18:49
• Updated: 24/Dec/05 04:43
• Resolved: 24/Dec/05 04:43

Description

I get the following error while running org.apache.nutch.tools.CrawlTool

The error actually is in deleteduplicates

51223 001121 Reading url hashes...
051223 001121 Sorting url hashes...
051223 001121 Deleting url duplicates...
051223 001121 Error moving bad file
G:\apache-tomcat-5.5.12\webapps\crux\WEB-INF
\classes\ddup-workingdir\ddup-20051223001121: java.io.IOException:
CreateProcess
: df -k G:\apache-tomcat-5.5.12\webapps\crux\WEB-INF\classes\ddup-workingdir\ddup-20051223001121 error=2
It throws the error here in NFSDataInputStream.java
The exception is org.apache.nutch.fs.ChecksumException: Checksum
error: G:\apach
e-tomcat-5.5.12\webapps\crux\WEB-INF\classes\ddup-workingdir\ddup-20051223001121 at 0