[NUTCH-638] Launching Distributed Searchers with URI indicating filesystem to use rather than relying on hadoop config files.

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Won't Fix
• Affects Version/s: 1.0.0
• Patch Info: Patch Available
• Assignee: Unassigned
• Reporter: Aaron Nall
• Created: 28/Jul/08 19:32
• Updated: 08/Jun/11 21:34
• Resolved: 01/Apr/11 14:36

Description

I wanted to conduct all index creation operations in hdfs but search from the local file system using the same cluster of machines. I believe that this is a common use case.

This required either a parallel nutch install or edits (scripted or manual) to hadoop-site.xml to change the file system from hdfs to local when starting a distributed searcher service. This minor patch makes IndexSearcher and NutchBean honor URIs as supported by hadoop 0.17 without altering existing functionality if simple paths are entered.