2013-04-24 22:52:43,335 INFO [PRI IPC Server handler 1 on 60020] org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open region: usertable,user100000000,1366836176975.b0c7eb004dca0e9e5457b1155d8a1375. on jdec2hbase0403-5.some.org,60020,1366843956031 2013-04-24 22:52:43,381 WARN [PRI IPC Server handler 1 on 60020] org.apache.hadoop.conf.Configuration: hadoop.native.lib is deprecated. Instead, use io.native.lib.available 2013-04-24 22:52:43,698 INFO [PRI IPC Server handler 1 on 60020] org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open region: usertable,user1500000,1366836176976.3beed4e32cfbec9b6c521aac795c07ac. on jdec2hbase0403-5.some.org,60020,1366843956031 2013-04-24 22:52:43,699 INFO [PRI IPC Server handler 1 on 60020] org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open region: usertable,user22500000,1366836176978.043dfe7460368b2d2687b7c344451e93. on jdec2hbase0403-5.some.org,60020,1366843956031 2013-04-24 22:52:43,706 INFO [PRI IPC Server handler 1 on 60020] org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open region: usertable,user30500000,1366836176980.1cad5b9c39d78510cbe6a8d49f54fc90. on jdec2hbase0403-5.some.org,60020,1366843956031 2013-04-24 22:52:43,707 INFO [PRI IPC Server handler 1 on 60020] org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open region: usertable,user33000000,1366836176980.85d81ed41a0a01be9fd3c1ccfc136c75. on jdec2hbase0403-5.some.org,60020,1366843956031 2013-04-24 22:52:43,707 INFO [PRI IPC Server handler 1 on 60020] org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open region: usertable,user35500000,1366836176980.4a1d9fbfe0dc04a65211ba135cdcdaf9. on jdec2hbase0403-5.some.org,60020,1366843956031 2013-04-24 22:52:43,708 INFO [PRI IPC Server handler 1 on 60020] org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open region: usertable,user44000000,1366836176982.a14cc242d1d9ec3bcc672fdab3bd7b09. on jdec2hbase0403-5.some.org,60020,1366843956031 2013-04-24 22:52:43,708 INFO [PRI IPC Server handler 1 on 60020] org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open region: usertable,user49500000,1366836176983.7ea67b8a8b2a879bb46d7a45f255a7fe. on jdec2hbase0403-5.some.org,60020,1366843956031 2013-04-24 22:52:43,708 DEBUG [RS_OPEN_REGION-jdec2hbase0403-5.some.org,60020,1366843956031-0] org.apache.hadoop.hbase.zookeeper.ZKAssign: regionserver:60020-0x13dd0cb444b3370 Attempting to transition node b0c7eb004dca0e9e5457b1155d8a1375 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-04-24 22:52:43,708 DEBUG [RS_OPEN_REGION-jdec2hbase0403-5.some.org,60020,1366843956031-1] org.apache.hadoop.hbase.zookeeper.ZKAssign: regionserver:60020-0x13dd0cb444b3370 Attempting to transition node 3beed4e32cfbec9b6c521aac795c07ac from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-04-24 22:52:43,709 INFO [PRI IPC Server handler 1 on 60020] org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open region: usertable,user52500000,1366836176983.7e8bae5388521407514dcd9830b65303. on jdec2hbase0403-5.some.org,60020,1366843956031 2013-04-24 22:52:43,709 INFO [PRI IPC Server handler 1 on 60020] org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open region: usertable,user5500000,1366836176984.3a1992a9f7079862addb0d0932b45185. on jdec2hbase0403-5.some.org,60020,1366843956031 2013-04-24 22:52:43,710 INFO [PRI IPC Server handler 1 on 60020] org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open region: usertable,user55000000,1366836176984.eae9bf1f4318c1349ee4ed9d2f5287ce. on jdec2hbase0403-5.some.org,60020,1366843956031 2013-04-24 22:52:43,710 INFO [PRI IPC Server handler 1 on 60020] org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open region: usertable,user55500000,1366836176984.8abdde13840c95abb947390afaad11e9. on jdec2hbase0403-5.some.org,60020,1366843956031 2013-04-24 22:52:43,711 INFO [PRI IPC Server handler 1 on 60020] org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open region: usertable,user57000000,1366836176984.5e7af036a82babab030c2f421daf149b. on jdec2hbase0403-5.some.org,60020,1366843956031 2013-04-24 22:52:43,711 INFO [PRI IPC Server handler 1 on 60020] org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open region: usertable,user59500000,1366836176985.1c16788e3bb151494f760978b29c9fa3. on jdec2hbase0403-5.some.org,60020,1366843956031 2013-04-24 22:52:43,712 INFO [PRI IPC Server handler 1 on 60020] org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open region: usertable,user67000000,1366836176986.646c1d609cf2ab9fbdbf9034300758b7. on jdec2hbase0403-5.some.org,60020,1366843956031 2013-04-24 22:52:43,713 INFO [PRI IPC Server handler 1 on 60020] org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open region: usertable,user69000000,1366836176986.4e3d8c6be2b6df26036fc268cb42cb1c. on jdec2hbase0403-5.some.org,60020,1366843956031 2013-04-24 22:52:43,713 INFO [PRI IPC Server handler 1 on 60020] org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open region: usertable,user71500000,1366836176987.66a2e4f53bff35fe9c1d31ec21fef260. on jdec2hbase0403-5.some.org,60020,1366843956031 2013-04-24 22:52:43,713 INFO [PRI IPC Server handler 1 on 60020] org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open region: usertable,user8000000,1366836176988.a1558ea529119acfb5faba5e7f692d62. on jdec2hbase0403-5.some.org,60020,1366843956031 2013-04-24 22:52:43,714 INFO [PRI IPC Server handler 1 on 60020] org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open region: usertable,user82500000,1366836176989.48b84657a13e2f323a1a97c1ae45c85b. on jdec2hbase0403-5.some.org,60020,1366843956031 2013-04-24 22:52:43,714 INFO [PRI IPC Server handler 1 on 60020] org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open region: usertable,user87000000,1366836176989.34a38f9eb15de0091f9be97ec0ced465. on jdec2hbase0403-5.some.org,60020,1366843956031 2013-04-24 22:52:43,715 INFO [PRI IPC Server handler 1 on 60020] org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open region: usertable,user87500000,1366836176989.204cb9d6c7c953a3091de4809db08b75. on jdec2hbase0403-5.some.org,60020,1366843956031 2013-04-24 22:52:43,708 DEBUG [RS_OPEN_REGION-jdec2hbase0403-5.some.org,60020,1366843956031-2] org.apache.hadoop.hbase.zookeeper.ZKAssign: regionserver:60020-0x13dd0cb444b3370 Attempting to transition node 043dfe7460368b2d2687b7c344451e93 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-04-24 22:52:43,751 DEBUG [RS_OPEN_REGION-jdec2hbase0403-5.some.org,60020,1366843956031-1] org.apache.hadoop.hbase.zookeeper.ZKAssign: regionserver:60020-0x13dd0cb444b3370 Successfully transitioned node 3beed4e32cfbec9b6c521aac795c07ac from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-04-24 22:52:43,752 DEBUG [RS_OPEN_REGION-jdec2hbase0403-5.some.org,60020,1366843956031-2] org.apache.hadoop.hbase.zookeeper.ZKAssign: regionserver:60020-0x13dd0cb444b3370 Successfully transitioned node 043dfe7460368b2d2687b7c344451e93 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-04-24 22:52:43,753 DEBUG [RS_OPEN_REGION-jdec2hbase0403-5.some.org,60020,1366843956031-0] org.apache.hadoop.hbase.zookeeper.ZKAssign: regionserver:60020-0x13dd0cb444b3370 Successfully transitioned node b0c7eb004dca0e9e5457b1155d8a1375 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-04-24 22:52:43,766 INFO [RS_OPEN_REGION-jdec2hbase0403-5.some.org,60020,1366843956031-1] org.apache.hadoop.hbase.regionserver.HRegion: HRegion.openHRegion Region name ==usertable,user1500000,1366836176976.3beed4e32cfbec9b6c521aac795c07ac. 2013-04-24 22:52:43,766 INFO [RS_OPEN_REGION-jdec2hbase0403-5.some.org,60020,1366843956031-0] org.apache.hadoop.hbase.regionserver.HRegion: HRegion.openHRegion Region name ==usertable,user100000000,1366836176975.b0c7eb004dca0e9e5457b1155d8a1375. 2013-04-24 22:52:43,767 DEBUG [RS_OPEN_REGION-jdec2hbase0403-5.some.org,60020,1366843956031-1] org.apache.hadoop.hbase.regionserver.HRegion: Opening region: {NAME => 'usertable,user1500000,1366836176976.3beed4e32cfbec9b6c521aac795c07ac.', STARTKEY => 'user1500000', ENDKEY => 'user15000000', ENCODED => 3beed4e32cfbec9b6c521aac795c07ac,} 2013-04-24 22:52:43,767 INFO [RS_OPEN_REGION-jdec2hbase0403-5.some.org,60020,1366843956031-2] org.apache.hadoop.hbase.regionserver.HRegion: HRegion.openHRegion Region name ==usertable,user22500000,1366836176978.043dfe7460368b2d2687b7c344451e93. 2013-04-24 22:52:43,767 DEBUG [RS_OPEN_REGION-jdec2hbase0403-5.some.org,60020,1366843956031-2] org.apache.hadoop.hbase.regionserver.HRegion: Opening region: {NAME => 'usertable,user22500000,1366836176978.043dfe7460368b2d2687b7c344451e93.', STARTKEY => 'user22500000', ENDKEY => 'user23000000', ENCODED => 043dfe7460368b2d2687b7c344451e93,} 2013-04-24 22:52:43,767 DEBUG [RS_OPEN_REGION-jdec2hbase0403-5.some.org,60020,1366843956031-0] org.apache.hadoop.hbase.regionserver.HRegion: Opening region: {NAME => 'usertable,user100000000,1366836176975.b0c7eb004dca0e9e5457b1155d8a1375.', STARTKEY => 'user100000000', ENDKEY => 'user10500000', ENCODED => b0c7eb004dca0e9e5457b1155d8a1375,} 2013-04-24 22:52:43,798 DEBUG [RS_OPEN_REGION-jdec2hbase0403-5.some.org,60020,1366843956031-0] org.apache.hadoop.hbase.regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table usertable b0c7eb004dca0e9e5457b1155d8a1375 2013-04-24 22:52:43,798 DEBUG [RS_OPEN_REGION-jdec2hbase0403-5.some.org,60020,1366843956031-0] org.apache.hadoop.hbase.regionserver.HRegion: Instantiated usertable,user100000000,1366836176975.b0c7eb004dca0e9e5457b1155d8a1375. 2013-04-24 22:52:43,799 ERROR [RS_OPEN_REGION-jdec2hbase0403-5.some.org,60020,1366843956031-1] org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler: Failed open of region=usertable,user1500000,1366836176976.3beed4e32cfbec9b6c521aac795c07ac., starting to roll back the global memstore size. java.lang.IllegalStateException: Could not instantiate a region instance. at org.apache.hadoop.hbase.regionserver.HRegion.newHRegion(HRegion.java:3798) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4057) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4008) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:3959) at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:448) at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:136) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:130) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) at java.lang.Thread.run(Thread.java:662) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:513) at org.apache.hadoop.hbase.regionserver.HRegion.newHRegion(HRegion.java:3795) ... 9 more Caused by: org.apache.hadoop.metrics2.MetricsException: Metrics source RegionServer,sub=Regions already exists! at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:126) at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:107) at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:217) at org.apache.hadoop.hbase.metrics.BaseSourceImpl.(BaseSourceImpl.java:75) at org.apache.hadoop.hbase.regionserver.MetricsRegionAggregateSourceImpl.(MetricsRegionAggregateSourceImpl.java:49) at org.apache.hadoop.hbase.regionserver.MetricsRegionAggregateSourceImpl.(MetricsRegionAggregateSourceImpl.java:41) at org.apache.hadoop.hbase.regionserver.MetricsRegionServerSourceFactoryImpl.getAggregate(MetricsRegionServerSourceFactoryImpl.java:33) at org.apache.hadoop.hbase.regionserver.MetricsRegionServerSourceFactoryImpl.createRegion(MetricsRegionServerSourceFactoryImpl.java:50) at org.apache.hadoop.hbase.regionserver.MetricsRegion.(MetricsRegion.java:35) at org.apache.hadoop.hbase.regionserver.HRegion.(HRegion.java:488) at org.apache.hadoop.hbase.regionserver.HRegion.(HRegion.java:400) ... 14 more 2013-04-24 22:52:43,803 INFO [RS_OPEN_REGION-jdec2hbase0403-5.some.org,60020,1366843956031-1] org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler: Opening of region {NAME => 'usertable,user1500000,1366836176976.3beed4e32cfbec9b6c521aac795c07ac.', STARTKEY => 'user1500000', ENDKEY => 'user15000000', ENCODED => 3beed4e32cfbec9b6c521aac795c07ac,} failed, transitioning from OPENING to FAILED_OPEN in ZK, expecting version 1 2013-04-24 22:52:43,803 DEBUG [RS_OPEN_REGION-jdec2hbase0403-5.some.org,60020,1366843956031-1] org.apache.hadoop.hbase.zookeeper.ZKAssign: regionserver:60020-0x13dd0cb444b3370 Attempting to transition node 3beed4e32cfbec9b6c521aac795c07ac from RS_ZK_REGION_OPENING to RS_ZK_REGION_FAILED_OPEN