[IOTDB-3261] [ cluster ] Create metadata concurrently ：Internal error processing getOrCreateSchemaPartition NPE

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.14.0-SNAPSHOT
• Component/s: Core/Schema Manager, mpp-cluster
• Labels: pull-request-available
• Sprint: 2022-6-Cluster
• Assignee: Yongzao Dan
• Reporter: 刘珍
• Due: 06/Jun/22
• Created: 23/May/22 05:34
• Updated: 06/Jun/22 05:45
• Resolved: 06/Jun/22 05:45

Description

master_0523_51e9703
3C3D
并发创建schema，有如下异常（sg创建成功，show devices报错）
2022-05-23 13:47:32,264 [pool-1-IoTDB-ConfigNodeRPC-Client-37] ERROR o.a.t.ProcessFunction:47 - Internal error processing getOrCreateDataPartition
java.util.ConcurrentModificationException: null
at java.util.ArrayList$Itr.checkForComodification(ArrayList.java:911)
at java.util.ArrayList$Itr.next(ArrayList.java:861)
at org.apache.iotdb.confignode.manager.load.balancer.allocator.CopySetRegionAllocator.genWeightedRandomRegion(CopySetRegionAllocator.java:116)
at org.apache.iotdb.confignode.manager.load.balancer.allocator.CopySetRegionAllocator.allocateRegion(CopySetRegionAllocator.java:65)
at org.apache.iotdb.confignode.manager.load.balancer.RegionBalancer.genRegionsAllocationPlan(RegionBalancer.java:87)
at org.apache.iotdb.confignode.manager.load.LoadManager.initializeRegions(LoadManager.java:92)
at org.apache.iotdb.confignode.manager.PartitionManager.checkAndAllocateRegionsIfNecessary(PartitionManager.java:295)
at org.apache.iotdb.confignode.manager.PartitionManager.getOrCreateDataPartition(PartitionManager.java:202)
at org.apache.iotdb.confignode.manager.ConfigManager.getOrCreateDataPartition(ConfigManager.java:431)
at org.apache.iotdb.confignode.service.thrift.ConfigNodeRPCServiceProcessor.getOrCreateDataPartition(ConfigNodeRPCServiceProcessor.java:302)
at org.apache.iotdb.confignode.rpc.thrift.ConfigIService$Processor$getOrCreateDataPartition.getResult(ConfigIService.java:1790)
at org.apache.iotdb.confignode.rpc.thrift.ConfigIService$Processor$getOrCreateDataPartition.getResult(ConfigIService.java:1770)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:38)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:38)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:248)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2022-05-23 13:47:32,264 [pool-1-IoTDB-ConfigNodeRPC-Client-57] ERROR o.a.t.ProcessFunction:47 - Internal error processing getOrCreateDataPartition
java.lang.NullPointerException: null
at org.apache.iotdb.confignode.manager.load.balancer.allocator.CopySetRegionAllocator.intersectionCheck(CopySetRegionAllocator.java:143)
at org.apache.iotdb.confignode.manager.load.balancer.allocator.CopySetRegionAllocator.allocateRegion(CopySetRegionAllocator.java:66)
at org.apache.iotdb.confignode.manager.load.balancer.RegionBalancer.genRegionsAllocationPlan(RegionBalancer.java:87)
at org.apache.iotdb.confignode.manager.load.LoadManager.initializeRegions(LoadManager.java:92)
at org.apache.iotdb.confignode.manager.PartitionManager.checkAndAllocateRegionsIfNecessary(PartitionManager.java:295)
at org.apache.iotdb.confignode.manager.PartitionManager.getOrCreateDataPartition(PartitionManager.java:202)
at org.apache.iotdb.confignode.manager.ConfigManager.getOrCreateDataPartition(ConfigManager.java:431)
at org.apache.iotdb.confignode.service.thrift.ConfigNodeRPCServiceProcessor.getOrCreateDataPartition(ConfigNodeRPCServiceProcessor.java:302)
at org.apache.iotdb.confignode.rpc.thrift.ConfigIService$Processor$getOrCreateDataPartition.getResult(ConfigIService.java:1790)
at org.apache.iotdb.confignode.rpc.thrift.ConfigIService$Processor$getOrCreateDataPartition.getResult(ConfigIService.java:1770)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:38)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:38)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:248)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)

IoTDB> show devices;
Msg: 500: [INTERNAL_SERVER_ERROR(500)] Exception occurred: "show devices". executeStatement failed. null

show storage group; 结果正确。

1. 机器信息
192.168.130.3/4/5
benchmark配置文件见附件(192.168.130.2 /home/benchmark/bm_0514_ee75a49 )。

confignode log error见附件。
datanode log error见附件。

Issue Links

• links to: GitHub Pull Request #6127
• links to: GitHub Pull Request #6156