[RYA-313] Rya Mongo Blows up on Large result sets

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.10
• Fix Version/s: 3.2.11
• Component/s: dao
• Environment: Mongo DB with Rya 3.2.11-SNAPSHOT with a lot of data in Rya
• Assignee: Andrew Smith
• Reporter: Aaron Mihalik
• Created: 18/Jul/17 19:34
• Updated: 05/Sep/17 21:33
• Resolved: 07/Aug/17 17:33

Description

Simple queries that return a lot of results fail because mongo is trying to send all of the results back at once. For instance, if I have a lot of data and run something like:

SELECT * WHERE 
{
	?s a ?t.
}

I will get this exception.

Caused by: com.mongodb.MongoCommandException: Command failed with error 16389: 'aggregation result exceeds maximum document size (16MB)' on server localhost:27017. The full response is { "ok" : 0.0, "errmsg" : "aggregation result exceeds maximum document size (16MB)", "code" : 16389 }

I think we need to toss in a "AggregationOptions with Batch = 1000", but I couldn't get that to work immediately. Somebody with more mongo experience needs to look at this.

Here is the line of code

Issue Links

• links to: GitHub Pull Request #196