[DERBY-3998] Make sure all JUnit tests are run as part of a suite

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 10.5.1.1
• Component/s: Test
• Assignee: Unassigned
• Reporter: Kristian Waagan
• Created: 29/Dec/08 17:02
• Updated: 04/May/09 18:22

Description

I discovered that all tests are not being run as part of a suite. This should be fixed.
Based on the output from a little Python script I wrote and some investigation, I ended up with the following list of tests that might require some maintenance:

1. Non-JUnit tests - breaks the naming scheme
   java/testing/org/apache/derbyTesting/functionTests/tests/store/EncryptionTest.java
   java/testing/org/apache/derbyTesting/functionTests/tests/lang/GetPropertyInfoTest.java
   java/testing/org/apache/derbyTesting/functionTests/tests/store/LogDeviceTest.java
   java/testing/org/apache/derbyTesting/functionTests/tests/store/OnlineCompressTest.java

1. Disabled to to bugs or product defects
   java/testing/org/apache/derbyTesting/functionTests/tests/jdbc4/Derby3650Test.java
   java/testing/org/apache/derbyTesting/functionTests/tests/store/Derby3980DeadlockTest.java
   java/testing/org/apache/derbyTesting/functionTests/tests/tools/SysinfoAPITest.java # commented out, see below
2. Skipping for 'SysinfoAPITest.java' due to comment: '// SysinfoAPITest currently fails when run against jars, so is' in java/testing/org/apache/derbyTesting/functionTests/tests/tools/_Suite.java
3. Skipping for 'SysinfoAPITest.java' due to comment: '//suite.addTest(SysinfoAPITest.suite());' in java/testing/org/apache/derbyTesting/functionTests/tests/tools/_Suite.java

1. Abandoned tests?
   java/testing/org/apache/derbyTesting/functionTests/tests/jdbcapi/XATest.java # 2 errors
   java/testing/org/apache/derbyTesting/functionTests/tests/jdbcapi/BLOBTest.java # 0 failures, takes around 5 - 8 minutes
   java/testing/org/apache/derbyTesting/functionTests/tests/lang/DateTimeTest.java # 0 failures, no suite method
   java/testing/org/apache/derbyTesting/functionTests/tests/lang/LangProcedureTest.java # 2 failures, 2 errors
   java/testing/org/apache/derbyTesting/functionTests/tests/derbynet/SuicideOfStreamingTest.java # requires manual run?

Please comment on this issue if you have information regarding one of the mentioned tests.

It is my impression that the following initial actions needs to be taken;
1) Fix and enable XATest. Failures related to DERBY-3319?
2) Enable BLOBTest. Might try to reduce the run time.
3) Enable DateTimeTest by creating a suite method and adding it to a _Suite class.
4) Investigate LangProcedureTest failures/errors.

FYI, the script found tests by looking for files named '*Test.java' in the java/testing/org/apache/derbyTesting/functionTests directory. I have not checked if there are JUnit tests that don't follow the naming scheme. All the processing was done by searching the source code.

Issue Links

• is related to: DERBY-4155 jdbcapi/XATest.java doesn't seem to be running anywhere