[BEAM-9370] ParDoSchemaTests fail when run with Java 11 on Flink 1.10

• Type: Bug
• Status: Resolved
• Priority: P3
• Resolution: Fixed
• Fix Version/s: Missing
• Component/s: runner-flink, sdk-java-core, testing
• Labels: Clarified
• Assignee: Unassigned
• Reporter: Ismaël Mejía
• Created: 24/Feb/20 13:57
• Updated: 13/Jan/22 21:52
• Resolved: 12/Jan/22 04:38

Description

When running the ValidatesRunner suite with Flink 1.10 (which supports natively Java 11) it fails. For more details https://scans.gradle.com/s/hkselnsuaartu/tests/failed

:runners:flink:1.10:validatesRunnerBatch » org.apache.beam.sdk.transforms.ParDoSchemaTest » testSchemaFieldSelectionUnboxing (0.309s)
java.lang.IllegalStateException: size = 2
org.apache.beam.sdk.Pipeline$PipelineExecutionException
java.lang.IllegalStateException: size = 2

at org.apache.beam.vendor.bytebuddy.v1_10_8.net.bytebuddy.matcher.FilterableList$AbstractBase.getOnly(FilterableList.java:139)
at org.apache.beam.sdk.schemas.utils.ByteBuddyUtils$ConvertValueForSetter.convertArray(ByteBuddyUtils.java:999)
at org.apache.beam.sdk.schemas.utils.ByteBuddyUtils$ConvertValueForSetter.convertArray(ByteBuddyUtils.java:945)
at org.apache.beam.sdk.schemas.utils.ByteBuddyUtils$TypeConversion.convert(ByteBuddyUtils.java:254)
at org.apache.beam.sdk.schemas.utils.ConvertHelpers$ConvertPrimitiveInstruction.lambda$appender$0(ConvertHelpers.java:206)
at org.apache.beam.vendor.bytebuddy.v1_10_8.net.bytebuddy.dynamic.scaffold.TypeWriter$MethodPool$Record$ForDefinedMethod$WithBody.applyCode(TypeWriter.java:713)
at org.apache.beam.vendor.bytebuddy.v1_10_8.net.bytebuddy.dynamic.scaffold.TypeWriter$MethodPool$Record$ForDefinedMethod$WithBody.applyBody(TypeWriter.java:698)
at org.apache.beam.vendor.bytebuddy.v1_10_8.net.bytebuddy.dynamic.scaffold.TypeWriter$MethodPool$Record$ForDefinedMethod.apply(TypeWriter.java:605)
at org.apache.beam.vendor.bytebuddy.v1_10_8.net.bytebuddy.dynamic.scaffold.TypeWriter$MethodPool$Record$AccessBridgeWrapper.apply(TypeWriter.java:1271)
at org.apache.beam.vendor.bytebuddy.v1_10_8.net.bytebuddy.dynamic.scaffold.TypeWriter$Default$ForCreation.create(TypeWriter.java:5133)
at org.apache.beam.vendor.bytebuddy.v1_10_8.net.bytebuddy.dynamic.scaffold.TypeWriter$Default.make(TypeWriter.java:1933)
at org.apache.beam.vendor.bytebuddy.v1_10_8.net.bytebuddy.dynamic.scaffold.subclass.SubclassDynamicTypeBuilder.make(SubclassDynamicTypeBuilder.java:225)
at org.apache.beam.vendor.bytebuddy.v1_10_8.net.bytebuddy.dynamic.scaffold.subclass.SubclassDynamicTypeBuilder.make(SubclassDynamicTypeBuilder.java:198)
at org.apache.beam.vendor.bytebuddy.v1_10_8.net.bytebuddy.dynamic.DynamicType$Builder$AbstractBase.make(DynamicType.java:3411)
at org.apache.beam.vendor.bytebuddy.v1_10_8.net.bytebuddy.dynamic.DynamicType$Builder$AbstractBase$Delegator.make(DynamicType.java:3607)
at org.apache.beam.sdk.schemas.utils.ConvertHelpers.getConvertPrimitive(ConvertHelpers.java:169)
at org.apache.beam.sdk.transforms.DoFnSchemaInformation$UnboxingConversionFunction.getConversionFunction(DoFnSchemaInformation.java:242)
at org.apache.beam.sdk.transforms.DoFnSchemaInformation$UnboxingConversionFunction.apply(DoFnSchemaInformation.java:235)
at org.apache.beam.runners.core.SimpleDoFnRunner$DoFnProcessContext.schemaElement(SimpleDoFnRunner.java:487)
at org.apache.beam.sdk.transforms.ParDoSchemaTest$15$DoFnInvoker.invokeProcessElement(Unknown Source)

Issue Links

• links to: https://github.com/apache/beam/pull/11480