[NUTCH-2612] Support for sitemap processing by hostname - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: 1.14
Fix Version/s: 1.16
Component/s: sitemap
Labels:
None

Description

Add support to sitemap processor for processing just hostnames. Similar to the mapper eating sitemap URL's, but then with BaseRobotRules finding the sitemap URL's itself.

Will upload patch soon.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

NUTCH-2612.patch
24/Jul/18 13:23
8 kB
Markus Jelsma
NUTCH-2612.patch
04/Jul/18 12:43
5 kB
Markus Jelsma
NUTCH-2612.patch
03/Jul/18 12:00
5 kB
Markus Jelsma

Activity

People

Assignee:: Markus Jelsma

Reporter:: Markus Jelsma

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Dates

Created:: 26/Jun/18 13:47

Updated:: 28/Jan/21 13:56

Resolved:: 09/Sep/19 13:01