Details
-
Bug
-
Status: Open
-
P1
-
Resolution: Unresolved
-
None
-
None
Description
This flink load tests are affected by this error
- beam_LoadTests_Go_ParDo_Flink_Batch (FAILED)
- beam_LoadTests_Go_SideInput_Flink_Batch (FAILED)
- beam_LoadTests_Python_Combine_Flink_Batch (FAILED)
- beam_LoadTests_Python_Combine_Flink_Streaming (FAILED)
- beam_LoadTests_Python_ParDo_Flink_Batch (FAILED)
- beam_LoadTests_Python_ParDo_Flink_Streaming (FAILED)
Stacktrace of the error
14:03:35 root_transform_ids: "e11"
14:03:35 root_transform_ids: "e12"
14:03:35 root_transform_ids: "e13"
14:03:35 root_transform_ids: "e14"
14:03:35 requirements: "beam:requirement:org.apache.beam:pardo:splittable_dofn:v1"
14:03:35 2022/03/07 20:03:33 Prepared job with id: load-tests-go-flink-batch-pardo-1-0307182650_12830e27-009a-44e5-8390-a53ce5f264f0 and staging token: load-tests-go-flink-batch-pardo-1-0307182650_12830e27-009a-44e5-8390-a53ce5f264f0
14:03:35 2022/03/07 20:03:33 Using specified worker binary: 'linux_amd64/pardo'
14:03:46 2022/03/07 20:03:46 Staged binary artifact with token:
14:03:47 2022/03/07 20:03:47 Submitted job: load0tests0go0flink0batch0pardo0100307182650-root-0307200346-d0077c8_166b7cfd-0805-481a-9a6a-52ba9bfddcbc
14:03:47 2022/03/07 20:03:47 Job state: STOPPED
14:03:47 2022/03/07 20:03:47 Job state: STARTING
14:03:47 2022/03/07 20:03:47 Job state: RUNNING
14:04:04 2022/03/07 20:04:04 (): org.apache.flink.client.program.ProgramInvocationException: Job failed (JobID: a8fc45aac0e16ee159027398311e082e)
14:04:04 at org.apache.flink.client.deployment.ClusterClientJobClientAdapter.lambda$null$6(ClusterClientJobClientAdapter.java:125)
14:04:04 at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616)
14:04:04 at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591)
14:04:04 at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
14:04:04 at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
14:04:04 at org.apache.flink.client.program.rest.RestClusterClient.lambda$pollResourceAsync$22(RestClusterClient.java:665)
14:04:04 at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
14:04:04 at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
14:04:04 at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
14:04:04 at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
14:04:04 at org.apache.flink.runtime.concurrent.FutureUtils.lambda$retryOperationWithDelay$9(FutureUtils.java:394)
14:04:04 at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
14:04:04 at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
14:04:04 at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
14:04:04 at java.util.concurrent.CompletableFuture.postFire(CompletableFuture.java:575)
14:04:04 at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:943)
14:04:04 at java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:456)
14:04:04 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
14:04:04 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
14:04:04 at java.lang.Thread.run(Thread.java:748)
14:04:04 Caused by: org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
14:04:04 at org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:144)
14:04:04 at org.apache.flink.client.deployment.ClusterClientJobClientAdapter.lambda$null$6(ClusterClientJobClientAdapter.java:123)
14:04:04 ... 19 more
14:04:04 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
14:04:04 at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:118)
14:04:04 at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:80)
14:04:04 at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:233)
14:04:04 at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:224)
14:04:04 at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:215)
14:04:04 at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:666)
14:04:04 at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:89)
14:04:04 at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:446)
14:04:04 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
14:04:04 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
14:04:04 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
14:04:04 at java.lang.reflect.Method.invoke(Method.java:498)
14:04:04 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:305)
14:04:04 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:212)
14:04:04 at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:77)
14:04:04 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:158)
14:04:04 at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26)
14:04:04 at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21)
14:04:04 at scala.PartialFunction.applyOrElse(PartialFunction.scala:127)
14:04:04 at scala.PartialFunction.applyOrElse$(PartialFunction.scala:126)
14:04:04 at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21)
14:04:04 at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:175)
14:04:04 at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:176)
14:04:04 at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:176)
14:04:04 at akka.actor.Actor.aroundReceive(Actor.scala:517)
14:04:04 at akka.actor.Actor.aroundReceive$(Actor.scala:515)
14:04:04 at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225)
14:04:04 at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592)
14:04:04 at akka.actor.ActorCell.invoke(ActorCell.scala:561)
14:04:04 at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258)
14:04:04 at akka.dispatch.Mailbox.run(Mailbox.scala:225)
14:04:04 at akka.dispatch.Mailbox.exec(Mailbox.scala:235)
14:04:04 at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
14:04:04 at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
14:04:04 at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
14:04:04 at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
14:04:04 Caused by: java.lang.NoClassDefFoundError: Could not initialize class org.apache.beam.runners.core.construction.SerializablePipelineOptions
14:04:04 at java.io.ObjectStreamClass.hasStaticInitializer(Native Method)
14:04:04 at java.io.ObjectStreamClass.computeDefaultSUID(ObjectStreamClass.java:1955)
14:04:04 at java.io.ObjectStreamClass.access$100(ObjectStreamClass.java:79)
14:04:04 at java.io.ObjectStreamClass$2.run(ObjectStreamClass.java:275)
14:04:04 at java.io.ObjectStreamClass$2.run(ObjectStreamClass.java:273)
14:04:04 at java.security.AccessController.doPrivileged(Native Method)
14:04:04 at java.io.ObjectStreamClass.getSerialVersionUID(ObjectStreamClass.java:272)
14:04:04 at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:694)
14:04:04 at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:2005)
14:04:04 at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1852)
14:04:04 at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2186)
14:04:04 at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1669)
14:04:04 at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2431)
14:04:04 at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2355)
14:04:04 at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2213)
14:04:04 at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1669)
14:04:04 at java.io.ObjectInputStream.readObject(ObjectInputStream.java:503)
14:04:04 at java.io.ObjectInputStream.readObject(ObjectInputStream.java:461)
14:04:04 at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:615)
14:04:04 at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:600)
14:04:04 at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:587)
14:04:04 at org.apache.flink.util.InstantiationUtil.readObjectFromConfig(InstantiationUtil.java:541)
14:04:04 at org.apache.flink.api.java.typeutils.runtime.RuntimeSerializerFactory.readParametersFromConfig(RuntimeSerializerFactory.java:78)
14:04:04 at org.apache.flink.runtime.operators.util.TaskConfig.getTypeSerializerFactory(TaskConfig.java:1246)
14:04:04 at org.apache.flink.runtime.operators.util.TaskConfig.getOutputSerializer(TaskConfig.java:599)
14:04:04 at org.apache.flink.runtime.operators.DataSourceTask.initInputFormat(DataSourceTask.java:324)
14:04:04 at org.apache.flink.runtime.operators.DataSourceTask.invoke(DataSourceTask.java:106)
14:04:04 at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:758)
14:04:04 at org.apache.flink.runtime.taskmanager.Task.run(Task.java:573)
14:04:04 at java.lang.Thread.run(Thread.java:750)
14:04:04 2022/03/07 20:04:04 (): java.lang.NoClassDefFoundError: Could not initialize class org.apache.beam.runners.core.construction.SerializablePipelineOptions
14:04:05 2022/03/07 20:04:05 Job state: FAILED
14:04:05 2022/03/07 20:04:05 Failed to execute job: job load0tests0go0flink0batch0pardo0100307182650-root-0307200346-d0077c8_166b7cfd-0805-481a-9a6a-52ba9bfddcbc failed
14:04:05 panic: Failed to execute job: job load0tests0go0flink0batch0pardo0100307182650-root-0307200346-d0077c8_166b7cfd-0805-481a-9a6a-52ba9bfddcbc failed
14:04:05
14:04:05 goroutine 1 [running]:
14:04:05 github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1143648, 0xc000120000, 0x10323eb, 0x19, 0xc0003cde00, 0x1, 0x1)
14:04:05 /var/jenkins_real_home/workspace/beam_LoadTests_Go_ParDo_Flink_Batch/src/sdks/go/pkg/beam/log/log.go:153 +0xec
14:04:05 main.main()
14:04:05 /var/jenkins_real_home/workspace/beam_LoadTests_Go_ParDo_Flink_Batch/src/sdks/go/test/load/pardo/pardo.go:105 +0x3ca
14:04:05
14:04:05 > Task :sdks:go:test:load:run FAILED