[NUTCH-2664] WebApp for Nutch running in deploy Mode Creates Seed Directory in local FileSystem

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Auto Closed
• Affects Version/s: 2.3.1
• Fix Version/s: 2.5
• Component/s: REST_api, web gui
• Labels: pull-request-available

Environment

Nutch-2.3.1

Hbase-1.2.3

Hadoo- 2.5.2

 

• Assignee: Unassigned
• Reporter: Gajanan Watkar
• Created: 20/Oct/18 12:22
• Updated: 13/Oct/19 22:36
• Resolved: 13/Oct/19 22:36

Description

When creating crawl jobs using nutch webapp, seed directory gets created in temp (/tmp on linux) directory in local filesystem. This prevents crawl job to inject urls. As injection of url fails, no further phases of crawl can be executed. Seed Directory needs to be created on HDFS in case of Nutch running in deploy mode.