This is, in fact, due to the way the Maven Surefire plugin handles failures and timeouts (i.e. it short circuits). This is a non-issue.
This appears to be due to Jenkins being configured with surefire.timeout=480 and flakey tests timing out. I'll wait until the "fix flakey test" branch is merged before officially deeming this a non-issue.