[KYLIN-3880] DataType is incompatible in Kylin HBase coprocessor

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: v2.6.2, v3.0.0-alpha
• Assignee: Shaohui Liu
• Reporter: Shaohui Liu
• Created: 18/Mar/19 03:10
• Updated: 10/May/19 07:00
• Resolved: 27/Mar/19 03:32

Description

During upgrade kylin from 2.4.1 to 2.5.2, the query will failed for the incompatible class in Kylin HBase coprocessor

2019-03-12,17:48:11,530 INFO [FifoRWQ.default.readRpcServer.handler=197,queue=13,port=24600] org.apache.hadoop.hdfs.DFSClient: Access token was invalid when connecting to /10.152.33.45:22402 : org.apache.hadoop.hdfs.security.token.block.InvalidBlockTokenException: Got access token error for OP_READ_BLOCK, self=/10.152.33.44:55387, remote=/10.152.33.45:22402, for file /hbase/zjyprc-xiaomi/data/miui_sec/data/4b88a72f5bd37daca00efb842e676ca8/C/6593503eb213431998db117cf3dab3a6, for pool BP-792581576-10.152.48.22-1510572454905 block 1899006034_825272806
2019-03-12,17:48:12,135 INFO [FifoRWQ.default.readRpcServer.handler=231,queue=15,port=24600] org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService: start query dc0fadcf-3689-5508-9a45-559aaebfd4e0 in thread FifoRWQ.default.readRpcServer.handler=231,queue=15,port=24600
2019-03-12,17:48:12,135 ERROR [FifoRWQ.default.readRpcServer.handler=231,queue=15,port=24600] org.apache.hadoop.ipc.RpcServer: Unexpected throwable object 
java.lang.RuntimeException: java.io.InvalidClassException: org.apache.kylin.metadata.datatype.DataType; local class incompatible: stream classdesc serialVersionUID = -8891652700267537109, local class serialVersionUID = -4061244870979488887
	at org.apache.kylin.cube.gridtable.TrimmedCubeCodeSystem.readDimensionEncoding(TrimmedCubeCodeSystem.java:87)
	at org.apache.kylin.cube.gridtable.TrimmedCubeCodeSystem$1.deserialize(TrimmedCubeCodeSystem.java:122)
	at org.apache.kylin.cube.gridtable.TrimmedCubeCodeSystem$1.deserialize(TrimmedCubeCodeSystem.java:91)
	at org.apache.kylin.gridtable.GTInfo$1.deserialize(GTInfo.java:346)
	at org.apache.kylin.gridtable.GTInfo$1.deserialize(GTInfo.java:307)
	at org.apache.kylin.gridtable.GTScanRequest$2.deserialize(GTScanRequest.java:466)
	at org.apache.kylin.gridtable.GTScanRequest$2.deserialize(GTScanRequest.java:412)
	at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.visitCube(CubeVisitService.java:259)
	at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService.callMethod(CubeVisitProtos.java:5555)
	at org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:6625)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.execServiceOnRegion(HRegionServer.java:4336)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.execService(HRegionServer.java:4318)
	at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:34964)
	at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2059)
	at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:126)
	at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:152)
	at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:128)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.InvalidClassException: org.apache.kylin.metadata.datatype.DataType; local class incompatible: stream classdesc serialVersionUID = -8891652700267537109, local class serialVersionUID = -4061244870979488887
	at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:699)
	at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1885)
	at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1751)
	at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2042)
	at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)
	at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2287)
	at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211)
	at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2069)
	at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)
	at java.io.ObjectInputStream.readObject(ObjectInputStream.java:431)
	at org.apache.kylin.dimension.AbstractDateDimEnc.readExternal(AbstractDateDimEnc.java:137)
	at java.io.ObjectInputStream.readExternalData(ObjectInputStream.java:2118)
	at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2067)
	at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)
	at java.io.ObjectInputStream.readObject(ObjectInputStream.java:431)
	at org.apache.kylin.cube.gridtable.TrimmedCubeCodeSystem.readDimensionEncoding(TrimmedCubeCodeSystem.java:84)
	... 17 more

Issue Links

• links to: GitHub Pull Request #527