[NUTCH-266] hadoop bug when doing updatedb

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8
• Fix Version/s: 0.8.1, 0.9.0

Environment

windows xp, JDK 1.4.2_04

• Assignee: Unassigned
• Reporter: Eugen Kochuev
• Created: 09/May/06 03:37
• Updated: 27/Oct/06 04:31
• Resolved: 08/Aug/06 19:31

Description

I constantly get the following error message

060508 230637 Running job: job_pbhn3t
060508 230637 c:/nutch/crawl-20060508230625/crawldb/current/part-00000/data:0+245
060508 230637 c:/nutch/crawl-20060508230625/segments/20060508230628/crawl_fetch/part-00000/data:0+296
060508 230637 c:/nutch/crawl-20060508230625/segments/20060508230628/crawl_parse/part-00000:0+5258
060508 230637 job_pbhn3t
java.io.IOException: Target /tmp/hadoop/mapred/local/reduce_qnd5sx/map_qjp7tf.out already exists
at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:162)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:62)
at org.apache.hadoop.fs.LocalFileSystem.renameRaw(LocalFileSystem.java:191)
at org.apache.hadoop.fs.FileSystem.rename(FileSystem.java:306)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:101)
Exception in thread "main" java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:341)
at org.apache.nutch.crawl.CrawlDb.update(CrawlDb.java:54)
at org.apache.nutch.crawl.Crawl.main(Crawl.java:114)