[NUTCH-693] Add configurable option for treating nofollow behaviour.

• Type: New Feature
• Status: Closed
• Priority: Minor
• Resolution: Won't Fix
• Patch Info: Patch Available
• Assignee: Unassigned
• Reporter: Andrew McCall
• Created: 18/Feb/09 20:58
• Updated: 23/Aug/13 20:21
• Resolved: 12/Jan/13 20:41

Description

For my purposes I'd like to follow links even if they're marked nofollow- Ideally I'd like to follow them, but not pass the link juice between them.

I've attached a patch that adds a configuration element parser.html.outlinks.ignore_nofollow which allows the parser to ignore the nofollow elements on a page.

Issue Links

• is depended upon by: NUTCH-795 Add ability to maintain nofollow attribute in linkdb