Error Message
java.lang.IllegalStateException: sendHeaders has already been called
Stacktrace
java.lang.IllegalStateException: sendHeaders has already been called
at org.apache.beam.repackaged.beam_sdks_java_harness.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at io.grpc.internal.ServerCallImpl.sendHeaders(ServerCallImpl.java:104)
at io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onNext(ServerCalls.java:282)
at org.apache.beam.sdk.fn.data.BeamFnDataBufferingOutboundObserver.close(BeamFnDataBufferingOutboundObserver.java:112)
at org.apache.beam.runners.fnexecution.control.SdkHarnessClient$ActiveBundle.close(SdkHarnessClient.java:224)
at org.apache.beam.runners.direct.portable.RemoteStageEvaluatorFactory$RemoteStageEvaluator.finishBundle(RemoteStageEvaluatorFactory.java:85)
at org.apache.beam.runners.direct.portable.DirectTransformExecutor.finishBundle(DirectTransformExecutor.java:154)
at org.apache.beam.runners.direct.portable.DirectTransformExecutor.run(DirectTransformExecutor.java:103)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Suppressed: java.lang.IllegalStateException: Processing bundle failed, TODO: [BEAM-3962] abort bundle.
at org.apache.beam.runners.fnexecution.control.SdkHarnessClient$ActiveBundle.close(SdkHarnessClient.java:234)
... 8 more
Standard Output
Shutting SDK harness down.
Standard Error
Jun 04, 2018 9:34:41 PM org.apache.beam.sdk.coders.SerializableCoder checkEqualsMethodDefined
WARNING: Can't verify serialized elements of type BoundedSource have well defined equals method. This may produce incorrect results on some PipelineRunner
Jun 04, 2018 9:34:41 PM org.apache.beam.sdk.coders.SerializableCoder checkEqualsMethodDefined
WARNING: Can't verify serialized elements of type BoundedSource have well defined equals method. This may produce incorrect results on some PipelineRunner
Jun 04, 2018 9:34:45 PM org.apache.beam.runners.fnexecution.control.FnApiControlClient closeAndTerminateOutstandingRequests
SEVERE: FnApiControlClient closed, clearing outstanding requests {5=java.util.concurrent.CompletableFuture@1051ec6e[Not completed, 1 dependents], 6=java.util.concurrent.CompletableFuture@341889cc[Not completed, 1 dependents]}
Jun 04, 2018 9:34:45 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Beam Fn Control client connected with id
Jun 04, 2018 9:34:45 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Fn Harness started
Jun 04, 2018 9:34:45 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Beam Fn Logging client connected.
Jun 04, 2018 9:34:45 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Entering instruction processing loop
Jun 04, 2018 9:34:45 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Beam Fn Data client connected.
Jun 04, 2018 9:34:45 PM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService$InboundObserver onCompleted
INFO: Logging client hanged up.
java.util.concurrent.ExecutionException: io.grpc.StatusRuntimeException: CANCELLED: Runner closed connection
at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1895)
at org.apache.beam.fn.harness.control.BeamFnControlClient.processInstructionRequests(BeamFnControlClient.java:158)
at org.apache.beam.fn.harness.FnHarness.main(FnHarness.java:157)
at org.apache.beam.runners.fnexecution.environment.InProcessEnvironmentFactory.lambda$createEnvironment$0(InProcessEnvironmentFactory.java:90)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 04, 2018 9:34:45 PM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onError
SEVERE: Failed to handle for url: "InProcessServer_4"
io.grpc.StatusRuntimeException: CANCELLED: Multiplexer hanging up
at io.grpc.Status.asRuntimeException(Status.java:540)
at io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onClose(ClientCalls.java:392)
at io.grpc.internal.ClientCallImpl.closeObserver(ClientCallImpl.java:428)
at io.grpc.internal.ClientCallImpl.access$100(ClientCallImpl.java:76)
at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.close(ClientCallImpl.java:514)
at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.access$700(ClientCallImpl.java:431)
at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:546)
at io.grpc.internal.ContextRunnable.run(ContextRunnable.java:52)
at io.grpc.internal.SerializingExecutor$TaskRunner.run(SerializingExecutor.java:152)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 04, 2018 9:34:45 PM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
WARNING: Hanged up for unknown endpoint.
Caused by: io.grpc.StatusRuntimeException: CANCELLED: Runner closed connection
at io.grpc.Status.asRuntimeException(Status.java:540)
at io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onClose(ClientCalls.java:392)
at io.grpc.internal.ClientCallImpl.closeObserver(ClientCallImpl.java:428)
at io.grpc.internal.ClientCallImpl.access$100(ClientCallImpl.java:76)
at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.close(ClientCallImpl.java:514)
at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.access$700(ClientCallImpl.java:431)
at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:546)
at io.grpc.internal.ContextRunnable.run(ContextRunnable.java:52)
at io.grpc.internal.SerializingExecutor$TaskRunner.run(SerializingExecutor.java:152)
... 3 more
Bug
P2
