[DRILL-7037] Apache Drill Crashes when a 50mb json string is queried via the REST API provided

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.14.0
• Fix Version/s: 1.19.0
• Component/s: Client - HTTP

Environment

Windows 10 

24GB RAM

8 Cores

Used the REST API call to query drill

• Assignee: Unassigned
• Reporter: Ayush Sharma
• Created: 12/Feb/19 06:23
• Updated: 18/Jan/22 11:35
• Resolved: 18/Jan/22 11:35

Description

Apache Drill crashes with OutofMemoryException (24GB RAM) when a REST API call is made by supplying a json of size 50MB in the query paramater of the REST API.

The REST API even crashes for a 10MB query (16GB RAM) and works with a 5MB query.

This is a blocker for us and will need immediate remediation.

We are also not aware of any sys.options which might bring the HEAP size down drastically or currently making it go up.