Author: Michael Brown <firstname.lastname@example.org>
Date: Tue Jun 20 13:02:50 2017 -0700
IMPALA-5281: stress test: introduce stricter pass guidelines
1. Report incorrect results count in the console log table. Previously,
the stress test knew about incorrect results but only reported them to
the console log inline. In was on the onus of a caller to find this. Now
we have a summed count.
2. Fail the process if there are errors, incorrect results, or timeouts.
Previously, the stress test just counted these, but would not fail its
process. This leads to a much stricter pass criteria for the stress
test. This will allow CI to fail and alert a maintainer that something
I modified the result hashes for queries in a local runtime_info.json
and observed the reporting of incorrect results, incremented incorrect
results counts, and ultimately process failure.
Reviewed-by: Michael Brown <email@example.com>
Tested-by: Impala Public Jenkins