[DROIDS-156] CrawlingWorker runs out of memory

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.1.0, 0.2.0
• Fix Version/s: 0.1.0, 0.2.0
• Component/s: core
• Assignee: Richard Frovarp
• Reporter: Richard Frovarp
• Created: 22/Nov/11 01:28
• Updated: 23/Nov/11 02:48
• Resolved: 23/Nov/11 02:48

Description

CrawlingWorker when loading the entity can run out of memory. I discovered this when my crawler tried to pull down a 3.3GB file. This should be handled semi-gracefully.