[BEAM-2322] Apex Unittest WordCountTest failed on Jenkins and Local Machine

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Cannot Reproduce
• Fix Version/s: Not applicable
• Component/s: runner-apex
• Assignee: Unassigned
• Reporter: Mark Liu
• Created: 18/May/17 21:47
• Updated: 24/Jul/20 20:13
• Resolved: 19/Aug/18 22:08

Description

Unit test WordCountTest in Apex failed if project directory contains space.

Jenkins link:
https://builds.apache.org/job/beam_PostCommit_Java_JDK_Versions_Test/12/jdk=JDK%201.8%20(latest),label=beam/

Detailed error log from target/surefire-reports:

[14/WriteCounts/WriteFiles/Finalize/ParMultiDo(Anonymous):ApexParDoOperator] ERROR com.datatorrent.stram.engine.StreamingContainer  - Operator set [OperatorDeployInfo[id=14,name=WriteCounts/WriteFiles/Finalize/ParMultiDo(Anonymous),type=GENERIC,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream5,sourceNodeId=1,sourcePortName=output,locality=<null>,partitionMask=0,partitionKeys=<null>], OperatorDeployInfo.InputDeployInfo[portName=sideInput1,streamId=stream7,sourceNodeId=13,sourcePortName=output,locality=CONTAINER_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[]]] stopped running due to an exception.
java.lang.NullPointerException
        at com.datatorrent.netlet.util.Slice.<init>(Slice.java:54)
        at org.apache.beam.runners.apex.translation.utils.ApexStateInternals$ApexStateInternalsFactory.stateInternalsForKey(ApexStateInternals.java:449)
        at org.apache.beam.runners.apex.translation.utils.StateInternalsProxy.state(StateInternalsProxy.java:64)
        at org.apache.beam.runners.core.SideInputHandler.isReady(SideInputHandler.java:189)
        at org.apache.beam.runners.core.SimplePushbackSideInputDoFnRunner.isReady(SimplePushbackSideInputDoFnRunner.java:95)
        at org.apache.beam.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:76)
        at org.apache.beam.runners.apex.translation.operators.ApexParDoOperator.processElementInReadyWindows(ApexParDoOperator.java:309)
        at org.apache.beam.runners.apex.translation.operators.ApexParDoOperator.access$400(ApexParDoOperator.java:94)
        at org.apache.beam.runners.apex.translation.operators.ApexParDoOperator$1.process(ApexParDoOperator.java:196)
        at org.apache.beam.runners.apex.translation.operators.ApexParDoOperator$1.process(ApexParDoOperator.java:187)
        at com.datatorrent.api.DefaultInputPort.put(DefaultInputPort.java:79)
        at com.datatorrent.stram.stream.BufferServerSubscriber$BufferReservoir.sweep(BufferServerSubscriber.java:288)
        at com.datatorrent.stram.engine.GenericNode.run(GenericNode.java:269)
        at com.datatorrent.stram.engine.StreamingContainer$2.run(StreamingContainer.java:1428)

Space character in directory string may cause the problem and failed the translation.