[HBASE-18227] [AMv2] Fix test hbase.coprocessor.TestCoprocessorMetrics#testRegionObserverAfterRegionClosed

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0-alpha-1
• Fix Version/s: 2.0.0
• Component/s: amv2
• Hadoop Flags: Reviewed
• Assignee: Umesh Agashe
• Reporter: Umesh Agashe
• Created: 16/Jun/17 20:22
• Updated: 17/Jun/22 18:11
• Resolved: 17/Jun/17 03:20

Description

When ExecuteProceduresRemoteCall in RemoteProcedureDispatcher is enabled the test hbase.coprocessor.TestCoprocessorMetrics#testRegionObserverAfterRegionClosed fails as it uses not supported call admin.closeRegion() to close a region. Disabling table later throws exception as one of the region is not online (already closed).

org.apache.hadoop.hbase.NotServingRegionException: The region d8c770379823cbe6cdc517327024b128 is not online, and is not opening.
  at org.apache.hadoop.hbase.regionserver.HRegionServer.closeRegion(HRegionServer.java:3111)
  at org.apache.hadoop.hbase.regionserver.RSRpcServices.closeRegion(RSRpcServices.java:1485)
  at org.apache.hadoop.hbase.regionserver.RSRpcServices.executeProcedures(RSRpcServices.java:3430)
  at org.apache.hadoop.hbase.shaded.protobuf.generated.AdminProtos$AdminService$2.callBlockingMethod(AdminProtos.java:28757)
  at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:406)
  at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:133)
  at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:278)
  at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:258)
2017-06-16 11:25:02,177 WARN  [RSProcedureDispatcher-pool4-t6] procedure.RSProcedureDispatcher$AbstractRSRemoteCall(200): the request should be tried elsewhere instead; server=172.21.2.192,53652,1497637493318 try=0
org.apache.hadoop.hbase.NotServingRegionException: org.apache.hadoop.hbase.NotServingRegionException: The region d8c770379823cbe6cdc517327024b128 is not online, and is not opening.
  at org.apache.hadoop.hbase.regionserver.HRegionServer.closeRegion(HRegionServer.java:3111)
  at org.apache.hadoop.hbase.regionserver.RSRpcServices.closeRegion(RSRpcServices.java:1485)
  at org.apache.hadoop.hbase.regionserver.RSRpcServices.executeProcedures(RSRpcServices.java:3430)
  at org.apache.hadoop.hbase.shaded.protobuf.generated.AdminProtos$AdminService$2.callBlockingMethod(AdminProtos.java:28757)
  at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:406)
  at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:133)
  at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:278)
  at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:258)
  at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
  at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
  at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
  at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
  at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:93)
  at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:83)
  at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:370)
  at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.getRemoteException(ProtobufUtil.java:347)
  at org.apache.hadoop.hbase.master.procedure.RSProcedureDispatcher$ExecuteProceduresRemoteCall.sendRequest(RSProcedureDispatcher.java:295)
  at org.apache.hadoop.hbase.master.procedure.RSProcedureDispatcher$ExecuteProceduresRemoteCall.call(RSProcedureDispatcher.java:265)
  at org.apache.hadoop.hbase.master.procedure.RSProcedureDispatcher$ExecuteProceduresRemoteCall.call(RSProcedureDispatcher.java:246)
  at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.NotServingRegionException): org.apache.hadoop.hbase.NotServingRegionException: The region d8c770379823cbe6cdc517327024b128 is not online, and is not opening.
  at org.apache.hadoop.hbase.regionserver.HRegionServer.closeRegion(HRegionServer.java:3111)
  at org.apache.hadoop.hbase.regionserver.RSRpcServices.closeRegion(RSRpcServices.java:1485)
  at org.apache.hadoop.hbase.regionserver.RSRpcServices.executeProcedures(RSRpcServices.java:3430)
  at org.apache.hadoop.hbase.shaded.protobuf.generated.AdminProtos$AdminService$2.callBlockingMethod(AdminProtos.java:28757)
  at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:406)
  at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:133)
  at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:278)
  at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:258)

Issue Links

• blocks: HBASE-18104 [AMv2] Enable aggregation of RPCs (assigns/unassigns, etc.)