[BEAM-5875] Nexmark perf tests fail due to NoClassDefFoundError for Iterables.

• Type: Bug
• Status: Resolved
• Priority: P1
• Resolution: Fixed
• Fix Version/s: Not applicable
• Component/s: testing-nexmark
• Assignee: Luke Cwik
• Reporter: Henning Rohde
• Created: 26/Oct/18 20:54
• Updated: 16/May/20 13:29
• Resolved: 31/Oct/18 17:02

Description

https://scans.gradle.com/s/vjkiys2xc3age/console-log?task=:beam-sdks-java-nexmark:run

I see:

Caused by: java.lang.NoClassDefFoundError: org/apache/beam/repackaged/beam_sdks_java_test_utils/com/google/common/collect/Iterables
at org.apache.beam.sdk.testutils.metrics.MetricsReader.checkIfMetricResultIsUnique(MetricsReader.java:128)
at org.apache.beam.sdk.testutils.metrics.MetricsReader.getCounterMetric(MetricsReader.java:65)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.currentPerf(NexmarkLauncher.java:250)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.monitor(NexmarkLauncher.java:435)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1156)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:108)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:96)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: org.apache.beam.repackaged.beam_sdks_java_test_utils.com.google.common.collect.Iterables
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 13 more

PRs for the first red run:

BEAM-5716 Move nexmark to "testing" directory in java sdk (commit: 0074138) (detail / githubweb)
BEAM-5716 Move load-tests code to "testing" directory in java sdk (commit: 6674c9d) (detail / githubweb)
BEAM-5716 Create module for testing utils (commit: 0628951) (detail / githubweb)
BEAM-5716 Extract MetricReader class, test it and use in Nexmark code (commit: 69730fc) (detail / githubweb)
BEAM-5355 Use MetricsReader in GroupByKeyLoadTest (commit: 7374eb6) (detail / githubweb)

Łukasz – would you mind taking a look? Looks like a shading issue.

Issue Links

• links to: GitHub Pull Request #6858
• links to: GitHub Pull Request #6859
• links to: GitHub Pull Request #6894