[DRILL-4259] Add new functional tests to ensure that failures can be detected independent of the testing environment

• Type: Test
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Jason Altekruse
• Created: 11/Jan/16 17:43
• Updated: 14/Jan/16 21:41

Description

In DRILL-4243 an out of memory issue was fixed after a change to the memory allocator made memory limits more strict. While the regression tests had been run by the team at Dremio prior to merging the patch, running the tests on a cluster with more cores changed the memory limits on the queries and caused several tests to fail.

While changes of this magnitude are not going to be common, we should have a test suite that reliably fails independent of the environment it is run (assuming that there are sufficient resources for the tests to run).

It would be good to at least try to reproduce this failure on a few different setups (cores, nodes in cluster) by adjusting available configuration options and adding tests with those different configurations so that the tests will fail in different environments.

Issue Links

• relates to: DRILL-4243 CTAS with partition by, results in Out Of Memory