[OPENNLP-1478] Investigate and fix test failures on Linux/Ubuntu environment in opennlp-dl

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1.0
• Fix Version/s: 2.1.1
• Component/s: Deep Learning
• Assignee: Unassigned
• Reporter: Richard Zowalla
• Created: 04/Mar/23 07:44
• Updated: 20/Apr/23 18:10
• Resolved: 20/Apr/23 18:10

Description

We have some evaluation tests in the opennlp-dl module, which require our attentation. They were also encountered during the 2.1.0 release vote.

Goal of this ticket is to fix the failures / errors.

[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running opennlp.dl.doccat.scoring.AverageClassificationScoringStrategyTest
[INFO] Running opennlp.dl.doccat.DocumentCategorizerDLEval
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.078 s - in opennlp.dl.doccat.scoring.AverageClassificationScoringStrategyTest
[INFO] Running opennlp.dl.namefinder.NameFinderDLEval
[ERROR] Tests run: 7, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 11.675 s <<< FAILURE! - in opennlp.dl.namefinder.NameFinderDLEval
[ERROR] tokenNameFinder1Test  Time elapsed: 1.661 s  <<< FAILURE!
org.opentest4j.AssertionFailedError: expected: <8.251646041870117> but was: <8.251642227172852>
	at opennlp.dl.namefinder.NameFinderDLEval.tokenNameFinder1Test(NameFinderDLEval.java:67)

[ERROR] Tests run: 6, Failures: 3, Errors: 1, Skipped: 1, Time elapsed: 14.863 s <<< FAILURE! - in opennlp.dl.doccat.DocumentCategorizerDLEval
[ERROR] scoreMap  Time elapsed: 3.41 s  <<< FAILURE!
org.opentest4j.AssertionFailedError: expected: <0.04995147883892059> but was: <0.049951449036598206>
	at opennlp.dl.doccat.DocumentCategorizerDLEval.scoreMap(DocumentCategorizerDLEval.java:179)

[ERROR] categorizeWithInferenceOptions  Time elapsed: 0.946 s  <<< FAILURE!
org.opentest4j.AssertionFailedError: array contents differ at index [1], expected: <0.11486853659152985> but was: <0.11486850678920746>
	at opennlp.dl.doccat.DocumentCategorizerDLEval.categorizeWithInferenceOptions(DocumentCategorizerDLEval.java:154)

[ERROR] sortedScoreMap  Time elapsed: 3.079 s  <<< ERROR!
java.lang.NullPointerException: Cannot invoke "java.util.Set.size()" because the return value of "java.util.Map.get(Object)" is null
	at opennlp.dl.doccat.DocumentCategorizerDLEval.sortedScoreMap(DocumentCategorizerDLEval.java:202)

[ERROR] categorize  Time elapsed: 3.61 s  <<< FAILURE!
org.opentest4j.AssertionFailedError: array contents differ at index [0], expected: <0.3391093313694> but was: <0.33910930156707764>
	at opennlp.dl.doccat.DocumentCategorizerDLEval.categorize(DocumentCategorizerDLEval.java:86)

[INFO] 
[INFO] Results:
[INFO] 
[ERROR] Failures: 
[ERROR]   DocumentCategorizerDLEval.categorize:86 array contents differ at index [0], expected: <0.3391093313694> but was: <0.33910930156707764>
[ERROR]   DocumentCategorizerDLEval.categorizeWithInferenceOptions:154 array contents differ at index [1], expected: <0.11486853659152985> but was: <0.11486850678920746>
[ERROR]   DocumentCategorizerDLEval.scoreMap:179 expected: <0.04995147883892059> but was: <0.049951449036598206>
[ERROR]   NameFinderDLEval.tokenNameFinder1Test:67 expected: <8.251646041870117> but was: <8.251642227172852>
[ERROR] Errors: 
[ERROR]   DocumentCategorizerDLEval.sortedScoreMap:202 NullPointer Cannot invoke "java.u...
[INFO] 
[ERROR] Tests run: 15, Failures: 4, Errors: 1, Skipped: 1