[PHOENIX-5366] Perform splittable SYSCAT actions on the client only

• Type: Sub-task
• Status: Closed
• Priority: Critical
• Resolution: Duplicate
• Fix Version/s: 4.15.0, 5.1.0
• Assignee: Unassigned
• Reporter: Lars Hofhansl
• Created: 24/Jun/19 02:29
• Updated: 21/Dec/19 00:57
• Resolved: 19/Jul/19 01:59

Description

With Splittable Syscat we reintroduced new server-to-server communication. We should this all from the client. tdsilva.

Also, sometimes when I run tests they hang. In that case the logs are filled with exceptions like these:

2019-06-23 19:21:05,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45747] org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper(344): Possibly transient ZooKeeper, quorum=localhost:54696, exception=org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/meta-region-server
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/meta-region-server
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.getData(RecoverableZooKeeper.java:434)
at org.apache.hadoop.hbase.zookeeper.ZKUtil.getData(ZKUtil.java:672)
at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.getMetaRegionState(MetaTableLocator.java:487)
at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.getMetaRegionLocation(MetaTableLocator.java:168)
at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:607)
at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:588)
at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:561)
at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getMetaRegionLocation(ZooKeeperRegistry.java:61)
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateMeta(ConnectionManager.java:1268)
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1229)
at org.apache.hadoop.hbase.client.CoprocessorHConnection.locateRegion(CoprocessorHConnection.java:41)
at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.getRegionLocations(RpcRetryingCallerWithReadReplicas.java:357)
at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:153)
at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:58)
at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:231)
at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:272)
at org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:433)
at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:307)
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegionInMeta(ConnectionManager.java:1343)
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1232)
at org.apache.hadoop.hbase.client.CoprocessorHConnection.locateRegion(CoprocessorHConnection.java:41)
at org.apache.hadoop.hbase.client.AsyncProcess$AsyncRequestFutureImpl.findAllLocationsOrFail(AsyncProcess.java:1063)
at org.apache.hadoop.hbase.client.AsyncProcess$AsyncRequestFutureImpl.groupAndSendMultiAction(AsyncProcess.java:980)
at org.apache.hadoop.hbase.client.AsyncProcess$AsyncRequestFutureImpl.access$200(AsyncProcess.java:667)
at org.apache.hadoop.hbase.client.AsyncProcess.submitAll(AsyncProcess.java:649)
at org.apache.hadoop.hbase.client.AsyncProcess.submitAll(AsyncProcess.java:612)
at org.apache.hadoop.hbase.client.HTable.batch(HTable.java:922)
at org.apache.hadoop.hbase.client.HTable.batch(HTable.java:939)
at org.apache.hadoop.hbase.client.HTableWrapper.batch(HTableWrapper.java:255)
at org.apache.phoenix.coprocessor.MetaDataEndpointImpl.processRemoteRegionMutations(MetaDataEndpointImpl.java:2757)
at org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:2381)
at org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:17053)
at org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:8481)

 

Issue Links

• is a parent of: PHOENIX-5498 When dropping a view, send delete mutations for parent->child links from client to server rather than doing server-server RPCs
• relates to: PHOENIX-4861 While adding a view column make a single RPC to update the encoded column qualifier counter and remove the table from the cache of the physical table
• relates to: PHOENIX-4810 Send parent->child link mutations to SYSTEM.CHILD_LINK table in MetdataClient.createTableInternal