[TINKERPOP-2387] Test suite ignores more tests than it should for GraphComputer

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Won't Do
• Affects Version/s: 3.4.7
• Component/s: test-suite
• Assignee: Unassigned
• Reporter: Stephen Mallette
• Created: 19/Jun/20 11:53
• Updated: 16/Sep/21 18:40
• Resolved: 16/Sep/21 18:40

Description

A lot of tests in the test suite will throw a VerificationException when executed on GraphComputer. iirc, we did that globally in GremlinProcessRunner to help avoid a lengthy ignore list in annotations. The problem I'm seeing is that VerificationException can lead to false negative and false positive results in tests which means we might never really notice bugs because a test is ignored automatically when it shouldn't be or we get test failures and don't really understand why (as no one every remembers the little if/then logic tucked away in GremlinProcessRunner.

This issue might need to fold under a general re-structuring of the test suite behind our cucumber tests.