[NUTCH-2383] Wrong FS exception in Fetcher

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 1.13
• Component/s: fetcher

Environment

Hadoop 2.8 and Hadoop 2.7.2

• Assignee: Unassigned
• Reporter: Yossi Tamari
• Created: 02/May/17 13:26
• Updated: 28/Jan/21 14:04
• Resolved: 04/Nov/17 16:42

Description

Running bin/crawl on either Hadoop 2.7.2 or Hadoop 2.8, the Injector and Generator succeed, but the Fetcher throws:

java.lang.IllegalArgumentException: Wrong FS: hdfs://localhost:9000/user/root/crawl/segments/20170430084337/crawl_fetch, expected: file:///

.