Details
-
Bug
-
Status: Closed
-
Major
-
Resolution: Not A Problem
-
2.2
-
None
-
None
-
None
-
jdk 1.6
Description
Hi all:
I am writing an automated bug finding tool, and using
Apache Commons Math as an experimental subject
for evaluation.
The tool creates executable JUnit tests as well as
explanatory code comments. I attached one bug-revealing
test as follows. Could you please kindly check it, to
see if it is a real bug or not?
Also, it would be tremendous helpful if you could give
some feedback and suggestion on the quality of generated code comments?
From the perspective of developers who are familiar with the code,
is the automatically-inferred comment useful in understanding
the generated test? is the comment helpful in bug fixing from the
perspective of developers?
Particularly when the automatically-generated tests
are often long.
Your suggestion will help us improve the tool.
Please see attachment for the failed test.
The comment appears in the form of:
//Tests pass if .... (it gives some small change to the test which can make the failed test pass)
For example:
//Test passes if var10 is: (double)<0
java.lang.Double var10 = new java.lang.Double(0.0d);
means if you change var10 to a double value which is < 0 (e.g., -1d), the failed test will pass