Details
-
Test
-
Status: Closed
-
Minor
-
Resolution: Fixed
-
1.8.1
-
None
-
None
Description
When running the eval-tests for the 1.8.1 tag some of the tests consistently fail on an EC2 instance. On another virtual machine the tests consistently pass. When the tests fail the failures are consistent with the following:
Failed tests:
ArvoresDeitadasEval.evalPortugueseChunkerQnMultipleThreads:208->chunkerCrossEval:128 expected:<0.9649180953528779> but was:<0.9650518197155942>
ArvoresDeitadasEval.evalPortugueseSentenceDetectorMaxentQn:143->sentenceCrossEval:90 expected:<0.99261110833375> but was:<0.9927505074644777>
Conll02NameFinderEval.evalSpanishOrganizationMaxentQn:390->eval:90 expected:<0.682961897915169> but was:<0.6798418972332015>
ConllXPosTaggerEval.evalSwedishMaxentQn:152->eval:76 expected:<0.9347595473833098> but was:<0.9322842998585573>
Both systems are Ubuntu 16.04.2 running OpenJDK 1.8.0_131 but there must be some other differences affecting the tests. Those differences need to be identified.
VM1 (Tests Consistently Pass)
Apache Maven 3.3.9
Maven home: /usr/share/maven
Java version: 1.8.0_131, vendor: Oracle Corporation
Java home: /usr/lib/jvm/java-8-openjdk-amd64/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "4.4.0-1022-aws", arch: "amd64", family: "unix"
LANG=en_US.UTF-8
VM2 (Tests Consistently Fail)
Apache Maven 3.3.9
Maven home: /usr/share/maven
Java version: 1.8.0_131, vendor: Oracle Corporation
Java home: /usr/lib/jvm/java-8-openjdk-amd64/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "4.4.0-83-generic", arch: "amd64", family: "unix"
LANG=en_US.UTF-8
This VM also consistently fails when using Oracle JDK:
Java version: 1.8.0_131, vendor: Oracle Corporation
Java home: /usr/lib/jvm/java-8-oracle/jre
VM3 (Tests Consistently Pass)
Apache Maven 3.3.9
Maven home: /usr/share/maven
Java version: 1.8.0_131, vendor: Oracle Corporation
Java home: /usr/lib/jvm/java-8-openjdk-amd64/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "4.4.0-83-generic", arch: "amd64", family: "unix"
VM4 (Tests Consistently Fail)
Apache Maven 3.3.9 (bb52d8502b132ec0a5a3f4c09453c07478323dc5; 2015-11-10T11:41:47-05:00)
Maven home: C:\Program Files (x86)\maven\bin\..
Java version: 1.8.0_92, vendor: Oracle Corporation
Java home: C:\Program Files\Java\jdk1.8.0_92\jre
Default locale: en_US, platform encoding: Cp1252
OS name: "windows 10", version: "10.0", arch: "amd64", family: "dos"