[NUTCH-1931] Apache Nutch 1.x REST service and crawler visualization

• Type: Improvement
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.9
• Labels: REST features
• Assignee: Chris A. Mattmann
• Reporter: Sujen Shah
• Created: 03/Feb/15 04:57
• Updated: 27/Oct/15 20:49

Description

Currently Nutch 1.x does not have a REST API like 2.x. The REST services would help provide more information about a crawl to the user.

Along with Dr. Chris Mattmann, I would be working on writing the CXF based services and using them to create D3 based visualizations. These visualizations will help give insights on what is happening during a Nutch crawl.

Issue Links

• duplicates: NUTCH-1916 Apache Nutch CXF-based REST services
• incorporates: NUTCH-1966 Configuration endpoint for 1x REST API
• incorporates: NUTCH-2151 Service endpoint for REST API
• is duplicated by: NUTCH-1916 Apache Nutch CXF-based REST services

Sub-Tasks

• Configuration endpoint for 1x REST API: Closed
• Pretty print JSON output in config resource: Closed
• Job Administration end point for the REST service: Closed
• Endpoint to support realtime JSON output from the fetcher: Reopened
• Make FetchNodeDb optional (off by default) if NutchServer is not used: Closed
• Create Admin End point for Nutch 1.x REST service: Closed
• Job endpoint to support Indexing from the REST API: Closed
• Parameterize Generate REST endpoint: Closed
• Parameterize Fetch REST Endpoint: Closed
• Refactor Seed Resource in REST API: Closed
• Unit Test for NutchServer: Closed
• Refactoring the REST endpoints for integration with webui: Closed
• Refactor configuration end point: Closed
• Refactor /seed endpoint for backward compatibility: Closed