[BEAM-11418] [Go XLang] ClassNotFoundException due to incorrect artifact staging to x-lang environment.

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: Not applicable
• Component/s: cross-language, sdk-go
• Assignee: Daniel Oliveira
• Reporter: Daniel Oliveira
• Created: 08/Dec/20 03:42
• Updated: 12/May/21 21:38
• Resolved: 12/May/21 21:38

Description

Some of the test XLang transforms (CoGroupByKey, MultiInputOutput, and Partition) fail on the Go SDK (using the Java Test Expansion Service). These tests used to pass and started failing at some point for unknown reasons.

The failures tend to involve a ClassNotFound exception, like so:

RuntimeError: java.lang.IllegalArgumentException: unable to deserialize Custom DoFn With Execution Info
	at org.apache.beam.sdk.util.SerializableUtils.deserializeFromByteArray(SerializableUtils.java:78)
	at org.apache.beam.runners.core.construction.ParDoTranslation.doFnWithExecutionInformationFromProto(ParDoTranslation.java:712)
	at org.apache.beam.runners.core.construction.ParDoTranslation.getDoFn(ParDoTranslation.java:363)
	at org.apache.beam.fn.harness.FnApiDoFnRunner.<init>(FnApiDoFnRunner.java:351)
	at org.apache.beam.fn.harness.FnApiDoFnRunner$Factory.createRunnerForPTransform(FnApiDoFnRunner.java:183)
	at org.apache.beam.fn.harness.FnApiDoFnRunner$Factory.createRunnerForPTransform(FnApiDoFnRunner.java:157)
	{...}
Caused by: java.lang.ClassNotFoundException: org.apache.beam.sdk.testing.expansion.TestExpansionService$TestTransformRegistrar$PartitionBuilder
	at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	at java.lang.Class.forName0(Native Method)
	{...}

Edit: This seems to be due to artifact staging issues. This bug has been re-titled to be more accurate to the root cause.

Issue Links

• blocks: BEAM-11573 Go cross-language ValidatesRunner test failures
• links to: GitHub Pull Request #14625
• links to: GitHub Pull Request #14800