[HDDS-1754] getContainerWithPipeline fails with PipelineNotFoundException

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.4.0
• Fix Version/s: 0.4.1
• Component/s: SCM
• Labels: MiniOzoneChaosCluster pull-request-available
• Target Version/s: 0.4.1
• Sprint: Done
• Assignee: Supratim Deka
• Reporter: Mukul Kumar Singh
• Created: 02/Jul/19 16:04
• Updated: 05/Aug/19 14:45
• Resolved: 12/Jul/19 05:02

Description

Once a pipeline is closed or finalized and it was not able to close all the containers inside the pipeline.

Then getContainerWithPipeline will try to fetch the pipeline state from pipelineManager after the pipeline has been closed.

2019-07-02 20:48:20,370 INFO  ipc.Server (Server.java:logException(2726)) - IPC Server handler 13 on 50130, call Call#17339 Retry#0 org.apache.hadoop.hdds.scm.protocol.StorageContainerLocationProtocol.getContainerWithPipeline from 192.168.0.2:51452
org.apache.hadoop.hdds.scm.pipeline.PipelineNotFoundException: PipelineID=e1a7b16a-48d9-4194-9774-ad49ec9ad78b not found
        at org.apache.hadoop.hdds.scm.pipeline.PipelineStateMap.getPipeline(PipelineStateMap.java:132)
        at org.apache.hadoop.hdds.scm.pipeline.PipelineStateManager.getPipeline(PipelineStateManager.java:66)
        at org.apache.hadoop.hdds.scm.pipeline.SCMPipelineManager.getPipeline(SCMPipelineManager.java:184)
        at org.apache.hadoop.hdds.scm.server.SCMClientProtocolServer.getContainerWithPipeline(SCMClientProtocolServer.java:244)
        at org.apache.hadoop.ozone.protocolPB.StorageContainerLocationProtocolServerSideTranslatorPB.getContainerWithPipeline(StorageContainerLocationProtocolServerSideTranslatorPB.java:144)
        at org.apache.hadoop.hdds.protocol.proto.StorageContainerLocationProtocolProtos$StorageContainerLocationProtocolService$2.callBlockingMethod(StorageContainerLocationProtocolProtos.java:16390)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:524)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1025)
        at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:876)
        at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:822)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2682)

Issue Links

• relates to: HDDS-1765 destroyPipeline scheduled from finalizeAndDestroyPipeline fails for short dead node interval
• links to: GitHub Pull Request #1081