[HDDS-1817] GetKey fails with IllegalArgumentException

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.4.0
• Fix Version/s: 0.4.1, 0.5.0
• Component/s: Ozone Client, SCM
• Labels: blockade pull-request-available
• Target Version/s: 0.5.0
• Sprint: HDDS Biscayne
• Assignee: Nanda kumar
• Reporter: Nanda kumar
• Created: 17/Jul/19 15:23
• Updated: 05/Aug/19 14:46
• Resolved: 24/Jul/19 23:30

Description

During get key call the client is intermittently failing with java.lang.IllegalArgumentException

E       AssertionError: Ozone get Key failed with output=[java.lang.IllegalArgumentException
E       	at com.google.common.base.Preconditions.checkArgument(Preconditions.java:72)
E       	at org.apache.hadoop.hdds.scm.XceiverClientManager.acquireClient(XceiverClientManager.java:150)
E       	at org.apache.hadoop.hdds.scm.XceiverClientManager.acquireClientForReadData(XceiverClientManager.java:143)
E       	at org.apache.hadoop.hdds.scm.storage.BlockInputStream.getChunkInfos(BlockInputStream.java:154)
E       	at org.apache.hadoop.hdds.scm.storage.BlockInputStream.initialize(BlockInputStream.java:118)
E       	at org.apache.hadoop.hdds.scm.storage.BlockInputStream.read(BlockInputStream.java:222)
E       	at org.apache.hadoop.ozone.client.io.KeyInputStream.read(KeyInputStream.java:171)
E       	at org.apache.hadoop.ozone.client.io.OzoneInputStream.read(OzoneInputStream.java:47)
E       	at java.base/java.io.InputStream.read(InputStream.java:205)
E       	at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:94)
E       	at org.apache.hadoop.ozone.web.ozShell.keys.GetKeyHandler.call(GetKeyHandler.java:98)
E       	at org.apache.hadoop.ozone.web.ozShell.keys.GetKeyHandler.call(GetKeyHandler.java:48)
E       	at picocli.CommandLine.execute(CommandLine.java:1173)
E       	at picocli.CommandLine.access$800(CommandLine.java:141)
E       	at picocli.CommandLine$RunLast.handle(CommandLine.java:1367)
E       	at picocli.CommandLine$RunLast.handle(CommandLine.java:1335)
E       	at picocli.CommandLine$AbstractParseResultHandler.handleParseResult(CommandLine.java:1243)
E       	at picocli.CommandLine.parseWithHandlers(CommandLine.java:1526)
E       	at picocli.CommandLine.parseWithHandler(CommandLine.java:1465)
E       	at org.apache.hadoop.hdds.cli.GenericCli.execute(GenericCli.java:65)
E       	at org.apache.hadoop.ozone.web.ozShell.OzoneShell.execute(OzoneShell.java:60)
E       	at org.apache.hadoop.hdds.cli.GenericCli.run(GenericCli.java:56)
E       	at org.apache.hadoop.ozone.web.ozShell.OzoneShell.main(OzoneShell.java:53)]

This is happening when the pipeline returned by SCM doesn't have any datanode information.

Issue Links

• duplicates: HDDS-1804 TestCloseContainerHandlingByClient#estBlockWrites fails intermittently
• links to: GitHub Pull Request #1152