[NUTCH-2798] Nutch v2.4 Not Able to crawl after javax.faces.viewstate

• Type: Bug
• Status: Closed
• Priority: Trivial
• Resolution: Not A Bug
• Affects Version/s: 2.4
• Component/s: fetcher

Environment

Ubuntu mate

• Assignee: Unassigned
• Reporter: Mihir Sharma
• Created: 06/Jul/20 14:53
• Updated: 15/Jul/20 08:39
• Resolved: 15/Jul/20 08:39

Description

Nutch v2.4 Not crawling The html page After input tag with name javax.faces.viewstate it is crawling before this tag but unable to go ahead after this javax viewstate which is having a lot special character.

This page is having different tabs, Current crawler is fetching information till date(
Date Published: 06/30/2020 09:00 PM) After that it is unable to fetch from Assembly Bill No. 103 which is title
i m crawling this site: http://leginfo.legislature.ca.gov/faces/billTextClient.xhtml?bill_id=201920200AB103

 

 

This is the output i am getting after crawling.