[#NUTCH-505] Outlink urls should be validated - ASF JIRA

Issue Details (XML | Word | Printable)

Key:	NUTCH-505
Type:	Improvement
Status:	Closed
Resolution:	Fixed
Priority:	Minor
Assignee:	Doğacan Güney
Reporter:	Doğacan Güney
Votes:	0
Watchers:	0

Operations

If you were logged in you would be able to see more operations.

Nutch

Outlink urls should be validated

Created: 23/Jun/07 08:14 PM Updated: 10/Apr/09 12:29 PM

Return to search

Component/s:

None

Affects Version/s:

None

Fix Version/s:

1.0.0

Time Tracking:

Not Specified

File Attachments:

	File Name	Date Attached	Attached By	Size
	filtered.txt	2007-07-12 03:07 PM	Doğacan Güney	80 kB
	NUTCH-505-v2.patch	2007-07-12 12:16 PM	Doğacan Güney	8 kB
	NUTCH-505-v3.patch	2007-07-12 03:07 PM	Doğacan Güney	10 kB
	NUTCH-505.patch	2007-07-10 07:10 PM	Doğacan Güney	30 kB
	NUTCH-505.patch	2007-07-10 12:40 PM	Doğacan Güney	30 kB
	NUTCH-505_draft.patch	2007-06-23 08:19 PM	Doğacan Güney	22 kB
	NUTCH-505_draft_v2.patch	2007-06-24 01:39 PM	Doğacan Güney	21 kB

Resolution Date:

11/Jul/07 10:54 AM

Description

See discussion here:
http://www.nabble.com/fetching-http%3A--www.variety.com-%3C-div%3E%3C-a%3E-tf3961692.html

Parse plugins may extract garbage urls from pages. We need a url validation system that tests these urls and filters out garbage.

All

Comments

Work Log

Change History

Subversion Commits

Sort Order:

Ascending order - Click to sort in descending order

No work has yet been logged on this issue.