[IMPALA-6350] split-hbase.sh failed during data load for exhaustive test run

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Cannot Reproduce
• Affects Version/s: Impala 2.11.0
• Component/s: Infrastructure
• Labels: test-infra
• Target Version: Impala 2.13.0
• Epic Color: ghx-label-6
• Assignee: Zach Amsden
• Reporter: David Knupp
• Created: 21/Dec/17 18:15
• Updated: 17/Apr/18 23:01
• Resolved: 17/Apr/18 23:01

Description

This affects test setup, but not the product.

21:24:39 Splitting HBase (logging to /data/jenkins/workspace/<job>/repos/Impala/logs/data_loading/create-hbase.log)... 
21:27:32     FAILED (Took: 2 min 53 sec)
21:27:32     '/data/jenkins/workspace/<job>/repos/Impala/testdata/bin/split-hbase.sh' failed. Tail of log:
21:27:32 	at org.apache.hadoop.hbase.client.HBaseAdmin.split(HBaseAdmin.java:2733)
21:27:32 	at org.apache.hadoop.hbase.client.HBaseAdmin.splitRegion(HBaseAdmin.java:2693)
21:27:32 	at org.apache.hadoop.hbase.client.HBaseAdmin.split(HBaseAdmin.java:2714)
21:27:32 	at org.apache.hadoop.hbase.client.HBaseAdmin.split(HBaseAdmin.java:2703)
21:27:32 	at org.apache.impala.datagenerator.HBaseTestDataRegionAssigment.performAssigment(HBaseTestDataRegionAssigment.java:112)
21:27:32 	at org.apache.impala.datagenerator.HBaseTestDataRegionAssigment.main(HBaseTestDataRegionAssigment.java:312)
21:27:32 Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.NotServingRegionException): org.apache.hadoop.hbase.NotServingRegionException: Region functional_hbase.alltypessmall,1,1513574812814.1d8e718f14ccea2c2f5c6724f023558d. is not online on localhost,16201,1513565166378
21:27:32 	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2997)
21:27:32 	at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegion(RSRpcServices.java:1055)
21:27:32 	at org.apache.hadoop.hbase.regionserver.RSRpcServices.splitRegion(RSRpcServices.java:1853)
21:27:32 	at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$2.callBlockingMethod(AdminProtos.java:22247)
21:27:32 	at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
21:27:32 	at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
21:27:32 	at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:183)
21:27:32 	at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:163)
21:27:32 
21:27:32 	at org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1272)
21:27:32 	at org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:227)
21:27:32 	at org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:336)
21:27:32 	at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.splitRegion(AdminProtos.java:23173)
21:27:32 	at org.apache.hadoop.hbase.protobuf.ProtobufUtil.split(ProtobufUtil.java:1908)
21:27:32 	... 6 more

Issue Links

• relates to: IMPALA-1995 Flaky test: PlannerTest.testHbase: splits for HBASE KEYRANGE not set up correctly.