[CONNECTORS-907] Web connector 1.5.1 and above: Let's tune Max kbytes/sec

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Affects Version/s: ManifoldCF 1.5.1
• Component/s: Web connector
• Assignee: Unassigned
• Reporter: Shinichiro Abe
• Created: 28/Feb/14 11:51
• Updated: 15/Apr/14 07:21
• Resolved: 28/Feb/14 13:56

Description

Today I set up MCF1.5.1 and configured a job of web connector at example.
But this didn't work. It fetched only one of seed url.
I didn't figure out this reason because my manifoldcf.log said nothing.
Perhaps we need new version 1.5.2.

This problem occur in trunk, too.
But MCF 1.4.1 doesn't occur and can crawl web pages.

Issue Links

• is related to: CONNECTORS-923 Throttling byte rate limit for web connector is set to a factor of 1000 too large (15.625 ms/byte)