2008-01-13 18:28:37,936 INFO org.apache.hadoop.hbase.HRegion: compaction completed on region webdata,,1200269242626. Took 3mins, 47sec 2008-01-13 18:28:37,937 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/size needed. 2008-01-13 18:28:37,937 DEBUG org.apache.hadoop.hbase.HRegion: 1329286581/size needs compaction 2008-01-13 18:28:37,937 INFO org.apache.hadoop.hbase.HRegion: starting compaction on region webdata,,1200269242626 2008-01-13 18:28:37,937 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 4 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1329286581/size 2008-01-13 18:28:38,124 INFO org.apache.hadoop.hbase.HRegion: Splitting webdata,,1200269242626 because largest aggregate size is 24.1m and desired size is 16.0m 2008-01-13 18:28:40,280 DEBUG org.apache.hadoop.hbase.HStore: moving 1329286581/size/3004809515886341159 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1329286581/size/7691169099001456548 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1329286581/size 2008-01-13 18:28:40,341 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 4 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1329286581/rank_total 2008-01-13 18:28:40,450 DEBUG org.apache.hadoop.hbase.HStore: moving 1329286581/rank_total/3692278499957345058 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1329286581/rank_total/2580775529888082927 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1329286581/rank_total 2008-01-13 18:28:40,503 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 4 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1329286581/first_seen 2008-01-13 18:28:40,608 DEBUG org.apache.hadoop.hbase.HStore: moving 1329286581/first_seen/4680753660894284897 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1329286581/first_seen/8252913820934447963 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1329286581/first_seen 2008-01-13 18:28:40,660 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 4 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1329286581/anchor 2008-01-13 18:29:28,737 DEBUG org.apache.hadoop.hbase.HStore: moving 1329286581/anchor/6141275926904042385 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1329286581/anchor/5014886567036278401 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1329286581/anchor 2008-01-13 18:29:28,923 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1329286581/last_seen 2008-01-13 18:30:18,692 DEBUG org.apache.hadoop.hbase.HStore: moving 1329286581/last_seen/2811575769943809396 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1329286581/last_seen/2668521843223847984 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1329286581/last_seen 2008-01-13 18:30:18,892 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 2 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1329286581/source 2008-01-13 18:30:18,978 DEBUG org.apache.hadoop.hbase.HStore: moving 1329286581/source/7207457762718998657 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1329286581/source/7936556516480662102 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1329286581/source 2008-01-13 18:30:19,013 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 2 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1329286581/stime 2008-01-13 18:30:21,111 DEBUG org.apache.hadoop.hbase.HStore: moving 1329286581/stime/3402523838608062203 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1329286581/stime/317543319630007536 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1329286581/stime 2008-01-13 18:30:21,152 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 2 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1329286581/in_rank 2008-01-13 18:31:09,962 DEBUG org.apache.hadoop.hbase.HStore: moving 1329286581/in_rank/8316577521786828703 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1329286581/in_rank/6968098886621832964 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1329286581/in_rank 2008-01-13 18:31:10,144 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 1 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1329286581/rank_visual 2008-01-13 18:31:10,150 DEBUG org.apache.hadoop.hbase.HStore: nothing to compact for 1329286581/rank_visual 2008-01-13 18:31:10,150 INFO org.apache.hadoop.hbase.HRegion: compaction completed on region webdata,,1200269242626. Took 2mins, 32sec 2008-01-13 18:31:10,150 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/size not needed. 2008-01-13 18:31:10,150 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/rank_total not needed. 2008-01-13 18:31:10,150 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/first_seen not needed. 2008-01-13 18:31:10,150 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/anchor not needed. 2008-01-13 18:31:10,151 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/last_seen not needed. 2008-01-13 18:31:10,151 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/source not needed. 2008-01-13 18:31:10,151 DEBUG org.apache.hadoop.hbase.HRegionServer: webdata,,1200269242626 closing (Adding to retiringRegions) 2008-01-13 18:31:10,151 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/stime not needed. 2008-01-13 18:31:10,151 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/in_rank not needed. 2008-01-13 18:31:10,151 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/rank_visual not needed. 2008-01-13 18:31:10,151 DEBUG org.apache.hadoop.hbase.HRegion: Started memcache flush for region webdata,,1200269242626. Size 19.8m 2008-01-13 18:31:10,151 DEBUG org.apache.hadoop.hbase.HRegion: region webdata,,1200269242626 does not need compaction 2008-01-13 18:31:10,151 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/size not needed. 2008-01-13 18:31:10,151 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/rank_total not needed. 2008-01-13 18:31:10,151 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/first_seen not needed. 2008-01-13 18:31:10,152 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/anchor not needed. 2008-01-13 18:31:10,152 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/last_seen not needed. 2008-01-13 18:31:10,152 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/source not needed. 2008-01-13 18:31:10,152 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/stime not needed. 2008-01-13 18:31:10,152 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/in_rank not needed. 2008-01-13 18:31:10,152 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/rank_visual not needed. 2008-01-13 18:31:10,152 DEBUG org.apache.hadoop.hbase.HRegion: region webdata,,1200269242626 does not need compaction 2008-01-13 18:31:10,152 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/size not needed. 2008-01-13 18:31:10,152 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/rank_total not needed. 2008-01-13 18:31:10,152 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/first_seen not needed. 2008-01-13 18:31:10,152 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/anchor not needed. 2008-01-13 18:31:10,152 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/last_seen not needed. 2008-01-13 18:31:10,153 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/source not needed. 2008-01-13 18:31:10,153 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/stime not needed. 2008-01-13 18:31:10,153 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/in_rank not needed. 2008-01-13 18:31:10,153 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/rank_visual not needed. 2008-01-13 18:31:10,153 DEBUG org.apache.hadoop.hbase.HRegion: region webdata,,1200269242626 does not need compaction 2008-01-13 18:31:10,153 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/size not needed. 2008-01-13 18:31:10,153 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/rank_total not needed. 2008-01-13 18:31:10,153 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/first_seen not needed. 2008-01-13 18:31:10,153 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/anchor not needed. 2008-01-13 18:31:10,153 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/last_seen not needed. 2008-01-13 18:31:10,153 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/source not needed. 2008-01-13 18:31:10,153 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/stime not needed. 2008-01-13 18:31:10,153 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/in_rank not needed. 2008-01-13 18:31:10,154 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1329286581/rank_visual not needed. 2008-01-13 18:31:10,154 DEBUG org.apache.hadoop.hbase.HRegion: region webdata,,1200269242626 does not need compaction 2008-01-13 18:31:10,326 DEBUG org.apache.hadoop.hbase.HStore: Added 1329286581/size/3727726047865285802 with 2050 entries, sequence id 4101786, and size 33.5k for 1329286581/size 2008-01-13 18:31:10,385 DEBUG org.apache.hadoop.hbase.HStore: Added 1329286581/rank_total/6947632026560623179 with 0 entries, sequence id 4101786, and size 153.0 for 1329286581/rank_total 2008-01-13 18:31:10,444 DEBUG org.apache.hadoop.hbase.HStore: Added 1329286581/first_seen/6598843430545264702 with 0 entries, sequence id 4101786, and size 153.0 for 1329286581/first_seen 2008-01-13 18:31:11,664 DEBUG org.apache.hadoop.hbase.HStore: Added 1329286581/anchor/3657345400583655837 with 60479 entries, sequence id 4101786, and size 1.3m for 1329286581/anchor 2008-01-13 18:31:12,874 DEBUG org.apache.hadoop.hbase.HStore: Added 1329286581/last_seen/5713336442054070672 with 60479 entries, sequence id 4101786, and size 837.5k for 1329286581/last_seen 2008-01-13 18:31:12,929 DEBUG org.apache.hadoop.hbase.HStore: Added 1329286581/source/2971124719086648357 with 0 entries, sequence id 4101786, and size 153.0 for 1329286581/source 2008-01-13 18:31:13,054 DEBUG org.apache.hadoop.hbase.HStore: Added 1329286581/stime/8224259125503209495 with 2050 entries, sequence id 4101786, and size 30.0k for 1329286581/stime 2008-01-13 18:31:14,196 DEBUG org.apache.hadoop.hbase.HStore: Added 1329286581/in_rank/4811455380185964199 with 60479 entries, sequence id 4101786, and size 855.4k for 1329286581/in_rank 2008-01-13 18:31:14,250 DEBUG org.apache.hadoop.hbase.HStore: Added 1329286581/rank_visual/1745324876548740825 with 0 entries, sequence id 4101786, and size 153.0 for 1329286581/rank_visual 2008-01-13 18:31:14,250 DEBUG org.apache.hadoop.hbase.HRegion: Finished memcache flush for region webdata,,1200269242626 in 4099ms, sequenceid=4101786 2008-01-13 18:31:14,251 DEBUG org.apache.hadoop.hbase.HStore: closed 1329286581/size 2008-01-13 18:31:14,251 DEBUG org.apache.hadoop.hbase.HStore: closed 1329286581/rank_total 2008-01-13 18:31:14,251 DEBUG org.apache.hadoop.hbase.HStore: closed 1329286581/first_seen 2008-01-13 18:31:14,251 DEBUG org.apache.hadoop.hbase.HStore: closed 1329286581/anchor 2008-01-13 18:31:14,252 DEBUG org.apache.hadoop.hbase.HStore: closed 1329286581/last_seen 2008-01-13 18:31:14,253 DEBUG org.apache.hadoop.hbase.HStore: closed 1329286581/source 2008-01-13 18:31:14,253 DEBUG org.apache.hadoop.hbase.HStore: closed 1329286581/stime 2008-01-13 18:31:14,254 DEBUG org.apache.hadoop.hbase.HStore: closed 1329286581/in_rank 2008-01-13 18:31:14,254 DEBUG org.apache.hadoop.hbase.HStore: closed 1329286581/rank_visual 2008-01-13 18:31:14,255 DEBUG org.apache.hadoop.hbase.HRegionServer: webdata,,1200269242626 closed 2008-01-13 18:31:14,255 INFO org.apache.hadoop.hbase.HRegion: closed webdata,,1200269242626 2008-01-13 18:31:14,255 DEBUG org.apache.hadoop.hbase.HRegionServer: webdata,,1200269242626 closed 2008-01-13 18:31:14,308 INFO org.apache.hadoop.ipc.Server: IPC Server handler 8 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@b32ed4) from 10.0.0.2:36602: error: java.io.IOException: Region webdata,,1200269242626 closed java.io.IOException: Region webdata,,1200269242626 closed at org.apache.hadoop.hbase.HRegion.obtainRowLock(HRegion.java:1439) at org.apache.hadoop.hbase.HRegion.batchUpdate(HRegion.java:1130) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1459) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,311 INFO org.apache.hadoop.ipc.Server: IPC Server handler 5 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1568fb5) from 10.0.0.4:54276: error: java.io.IOException: Region webdata,,1200269242626 closed java.io.IOException: Region webdata,,1200269242626 closed at org.apache.hadoop.hbase.HRegion.obtainRowLock(HRegion.java:1439) at org.apache.hadoop.hbase.HRegion.batchUpdate(HRegion.java:1130) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1459) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,311 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1077fc9) from 10.0.0.3:34121: error: java.io.IOException: Region webdata,,1200269242626 closed java.io.IOException: Region webdata,,1200269242626 closed at org.apache.hadoop.hbase.HRegion.obtainRowLock(HRegion.java:1439) at org.apache.hadoop.hbase.HRegion.batchUpdate(HRegion.java:1130) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1459) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,311 INFO org.apache.hadoop.ipc.Server: IPC Server handler 4 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@cf710e) from 10.0.0.1:38401: error: java.io.IOException: Region webdata,,1200269242626 closed java.io.IOException: Region webdata,,1200269242626 closed at org.apache.hadoop.hbase.HRegion.obtainRowLock(HRegion.java:1439) at org.apache.hadoop.hbase.HRegion.batchUpdate(HRegion.java:1130) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1459) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,311 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1c7980c) from 10.0.0.1:38401: error: java.io.IOException: Region webdata,,1200269242626 closed java.io.IOException: Region webdata,,1200269242626 closed at org.apache.hadoop.hbase.HRegion.obtainRowLock(HRegion.java:1439) at org.apache.hadoop.hbase.HRegion.batchUpdate(HRegion.java:1130) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1459) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,314 WARN org.apache.hadoop.ipc.Server: IPC Server handler 7 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@19e215b) from 10.0.0.3:34121: discarded for being too old (156132) 2008-01-13 18:31:14,314 WARN org.apache.hadoop.ipc.Server: IPC Server handler 5 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@19762f) from 10.0.0.3:34121: discarded for being too old (156132) 2008-01-13 18:31:14,309 INFO org.apache.hadoop.ipc.Server: IPC Server handler 2 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1911540) from 10.0.0.1:38401: error: java.io.IOException: Region webdata,,1200269242626 closed java.io.IOException: Region webdata,,1200269242626 closed at org.apache.hadoop.hbase.HRegion.obtainRowLock(HRegion.java:1439) at org.apache.hadoop.hbase.HRegion.batchUpdate(HRegion.java:1130) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1459) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,315 WARN org.apache.hadoop.ipc.Server: IPC Server handler 7 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@70be88) from 10.0.0.2:36602: discarded for being too old (156133) 2008-01-13 18:31:14,316 WARN org.apache.hadoop.ipc.Server: IPC Server handler 7 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@199939) from 10.0.0.4:54276: discarded for being too old (156043) 2008-01-13 18:31:14,316 WARN org.apache.hadoop.ipc.Server: IPC Server handler 3 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1ecfe07) from 10.0.0.2:36602: discarded for being too old (156134) 2008-01-13 18:31:14,316 WARN org.apache.hadoop.ipc.Server: IPC Server handler 7 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@9a9b65) from 10.0.0.1:38401: discarded for being too old (86149) 2008-01-13 18:31:14,317 WARN org.apache.hadoop.ipc.Server: IPC Server handler 3 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@78aa80) from 10.0.0.1:38401: discarded for being too old (86150) 2008-01-13 18:31:14,317 WARN org.apache.hadoop.ipc.Server: IPC Server handler 7 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1712651) from 10.0.0.3:34121: discarded for being too old (86140) 2008-01-13 18:31:14,317 WARN org.apache.hadoop.ipc.Server: IPC Server handler 7 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@f102d3) from 10.0.0.3:34121: discarded for being too old (86139) 2008-01-13 18:31:14,317 WARN org.apache.hadoop.ipc.Server: IPC Server handler 4 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@f07355) from 10.0.0.3:34121: discarded for being too old (86139) 2008-01-13 18:31:14,317 WARN org.apache.hadoop.ipc.Server: IPC Server handler 7 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@23f1bb) from 10.0.0.4:54276: discarded for being too old (86128) 2008-01-13 18:31:14,317 WARN org.apache.hadoop.ipc.Server: IPC Server handler 4 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1d33a6b) from 10.0.0.4:54276: discarded for being too old (86127) 2008-01-13 18:31:14,309 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1911540) from 10.0.0.4:54276: error: java.io.IOException: Region webdata,,1200269242626 closed java.io.IOException: Region webdata,,1200269242626 closed at org.apache.hadoop.hbase.HRegion.obtainRowLock(HRegion.java:1439) at org.apache.hadoop.hbase.HRegion.batchUpdate(HRegion.java:1130) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1459) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,318 WARN org.apache.hadoop.ipc.Server: IPC Server handler 4 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@d1e233) from 10.0.0.2:36602: discarded for being too old (86118) 2008-01-13 18:31:14,318 WARN org.apache.hadoop.ipc.Server: IPC Server handler 7 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@a0864f) from 10.0.0.4:54276: discarded for being too old (86128) 2008-01-13 18:31:14,317 WARN org.apache.hadoop.ipc.Server: IPC Server handler 3 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@18aab40) from 10.0.0.3:34121: discarded for being too old (86140) 2008-01-13 18:31:14,318 WARN org.apache.hadoop.ipc.Server: IPC Server handler 4 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@15983b7) from 10.0.0.2:36602: discarded for being too old (86117) 2008-01-13 18:31:14,319 WARN org.apache.hadoop.ipc.Server: IPC Server handler 7 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1d6747b) from 10.0.0.2:36602: discarded for being too old (86118) 2008-01-13 18:31:14,317 WARN org.apache.hadoop.ipc.Server: IPC Server handler 5 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1d98a) from 10.0.0.1:38401: discarded for being too old (86150) 2008-01-13 18:31:14,319 WARN org.apache.hadoop.ipc.Server: IPC Server handler 4 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@6397eb) from 10.0.0.4:54276: discarded for being too old (86026) 2008-01-13 18:31:14,320 INFO org.apache.hadoop.ipc.Server: IPC Server handler 5 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@8aeb74) from 10.0.0.1:38401: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,323 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@bb494b) from 10.0.0.1:38401: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,319 WARN org.apache.hadoop.ipc.Server: IPC Server handler 3 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@7976c1) from 10.0.0.2:36602: discarded for being too old (86118) 2008-01-13 18:31:14,325 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@f892a4) from 10.0.0.3:34121: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,327 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@df0438) from 10.0.0.3:34121: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,329 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@18e261d) from 10.0.0.4:54276: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,331 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1684706) from 10.0.0.4:54276: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,333 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@10efd7c) from 10.0.0.4:54276: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,335 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@12412e7) from 10.0.0.2:36602: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,337 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1552b76) from 10.0.0.2:36602: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,323 INFO org.apache.hadoop.ipc.Server: IPC Server handler 5 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1c8efd1) from 10.0.0.3:34121: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,340 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@988707) from 10.0.0.2:36602: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,325 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1636e4e) from 10.0.0.3:34121: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,321 INFO org.apache.hadoop.ipc.Server: IPC Server handler 4 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1b01afa) from 10.0.0.1:38401: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,345 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@d90453) from 10.0.0.4:54276: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,320 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@6835fb) from 10.0.0.1:38401: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,316 WARN org.apache.hadoop.ipc.Server: IPC Server handler 2 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@502819) from 10.0.0.1:38401: discarded for being too old (86149) 2008-01-13 18:31:14,308 INFO org.apache.hadoop.ipc.Server: IPC Server handler 6 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@12bf892) from 10.0.0.3:34121: error: java.io.IOException: Region webdata,,1200269242626 closed java.io.IOException: Region webdata,,1200269242626 closed at org.apache.hadoop.hbase.HRegion.obtainRowLock(HRegion.java:1439) at org.apache.hadoop.hbase.HRegion.batchUpdate(HRegion.java:1130) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1459) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,308 INFO org.apache.hadoop.ipc.Server: IPC Server handler 0 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@a2220f) from 10.0.0.1:38401: error: java.io.IOException: Region webdata,,1200269242626 closed java.io.IOException: Region webdata,,1200269242626 closed at org.apache.hadoop.hbase.HRegion.obtainRowLock(HRegion.java:1439) at org.apache.hadoop.hbase.HRegion.batchUpdate(HRegion.java:1130) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1459) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,308 INFO org.apache.hadoop.ipc.Server: IPC Server handler 9 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@6a3960) from 10.0.0.2:36602: error: java.io.IOException: Region webdata,,1200269242626 closed java.io.IOException: Region webdata,,1200269242626 closed at org.apache.hadoop.hbase.HRegion.obtainRowLock(HRegion.java:1439) at org.apache.hadoop.hbase.HRegion.batchUpdate(HRegion.java:1130) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1459) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,352 INFO org.apache.hadoop.ipc.Server: IPC Server handler 5 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1c8ef56) from 10.0.0.2:36602: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,364 ERROR org.apache.hadoop.hbase.HRegionServer: Error opening scanner (fsOk: true) org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.openScanner(HRegionServer.java:1477) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,366 INFO org.apache.hadoop.ipc.Server: IPC Server handler 4 on 60020, call openScanner(webdata,,1200269242626, [Lorg.apache.hadoop.io.Text;@1d0d124, , 9223372036854775807, null) from 10.0.0.1:38682: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.openScanner(HRegionServer.java:1477) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,393 INFO org.apache.hadoop.ipc.Server: Process Thread Dump: Discarding call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@a4488) from 10.0.0.4:54276 31 active threads Thread 887 (IPC Client connection to /10.0.0.1:9000): State: RUNNABLE Blocked count: 1 Waited count: 170 Stack: java.net.SocketInputStream.socketRead0(Native Method) java.net.SocketInputStream.read(SocketInputStream.java:129) java.io.FilterInputStream.read(FilterInputStream.java:111) org.apache.hadoop.ipc.Client$Connection$1.read(Client.java:188) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:235) java.io.DataInputStream.readInt(DataInputStream.java:353) org.apache.hadoop.ipc.Client$Connection.run(Client.java:274) Thread 43 (IPC Server handler 9 on 60020): State: BLOCKED Blocked count: 15879 Waited count: 132993 Blocked on org.apache.log4j.spi.RootLogger@165b7e Blocked by 41 (IPC Server handler 7 on 60020) Stack: org.apache.log4j.Category.callAppenders(Category.java:202) org.apache.log4j.Category.forcedLog(Category.java:388) org.apache.log4j.Category.log(Category.java:853) org.apache.commons.logging.impl.Log4JLogger.info(Log4JLogger.java:145) org.apache.hadoop.ipc.Server$Handler.run(Server.java:905) Thread 42 (IPC Server handler 8 on 60020): State: RUNNABLE Blocked count: 15919 Waited count: 132942 Stack: sun.management.ThreadImpl.getThreadInfo0(Native Method) sun.management.ThreadImpl.getThreadInfo(ThreadImpl.java:144) sun.management.ThreadImpl.getThreadInfo(ThreadImpl.java:120) org.apache.hadoop.util.ReflectionUtils.printThreadInfo(ReflectionUtils.java:114) org.apache.hadoop.util.ReflectionUtils.logThreadInfo(ReflectionUtils.java:168) org.apache.hadoop.ipc.Server$Handler.run(Server.java:886) Thread 41 (IPC Server handler 7 on 60020): State: TIMED_WAITING Blocked count: 16001 Waited count: 133022 Stack: java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Server$Handler.run(Server.java:877) Thread 40 (IPC Server handler 6 on 60020): State: TIMED_WAITING Blocked count: 16024 Waited count: 132837 Stack: java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Server$Handler.run(Server.java:877) Thread 39 (IPC Server handler 5 on 60020): State: TIMED_WAITING Blocked count: 15981 Waited count: 133061 Stack: java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Server$Handler.run(Server.java:877) Thread 38 (IPC Server handler 4 on 60020): State: TIMED_WAITING Blocked count: 15921 Waited count: 133016 Stack: java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Server$Handler.run(Server.java:877) Thread 37 (IPC Server handler 3 on 60020): State: TIMED_WAITING Blocked count: 15998 Waited count: 133046 Stack: java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Server$Handler.run(Server.java:877) Thread 36 (IPC Server handler 2 on 60020): State: TIMED_WAITING Blocked count: 15837 Waited count: 133089 Stack: java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Server$Handler.run(Server.java:877) Thread 35 (IPC Server handler 1 on 60020): State: TIMED_WAITING Blocked count: 15901 Waited count: 133019 Stack: java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Server$Handler.run(Server.java:877) Thread 34 (IPC Server handler 0 on 60020): State: TIMED_WAITING Blocked count: 16085 Waited count: 132940 Stack: java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Server$Handler.run(Server.java:877) Thread 14 (IPC Server listener on 60020): State: RUNNABLE Blocked count: 5368 Waited count: 0 Stack: sun.nio.ch.PollArrayWrapper.poll0(Native Method) sun.nio.ch.PollArrayWrapper.poll(PollArrayWrapper.java:100) sun.nio.ch.PollSelectorImpl.doSelect(PollSelectorImpl.java:56) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:84) org.apache.hadoop.ipc.Server$Listener.run(Server.java:319) Thread 15 (IPC Server Responder): State: RUNNABLE Blocked count: 0 Waited count: 0 Stack: sun.nio.ch.PollArrayWrapper.poll0(Native Method) sun.nio.ch.PollArrayWrapper.poll(PollArrayWrapper.java:100) sun.nio.ch.PollSelectorImpl.doSelect(PollSelectorImpl.java:56) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.ipc.Server$Responder.run(Server.java:475) Thread 33 (SocketListener0-1): State: TIMED_WAITING Blocked count: 2 Waited count: 174 Stack: java.lang.Object.wait(Native Method) org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522) Thread 32 (SocketListener0-0): State: TIMED_WAITING Blocked count: 0 Waited count: 174 Stack: java.lang.Object.wait(Native Method) org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522) Thread 31 (Acceptor ServerSocket[addr=0.0.0.0/0.0.0.0,port=0,localport=60030]): State: RUNNABLE Blocked count: 0 Waited count: 0 Stack: java.net.PlainSocketImpl.socketAccept(Native Method) java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) java.net.ServerSocket.implAccept(ServerSocket.java:450) java.net.ServerSocket.accept(ServerSocket.java:421) org.mortbay.util.ThreadedServer.acceptSocket(ThreadedServer.java:432) org.mortbay.util.ThreadedServer$Acceptor.run(ThreadedServer.java:631) Thread 30 (SessionScavenger): State: TIMED_WAITING Blocked count: 0 Waited count: 0 Stack: java.lang.Thread.sleep(Native Method) org.mortbay.jetty.servlet.AbstractSessionManager$SessionScavenger.run(AbstractSessionManager.java:587) Thread 16 (regionserver/0:0:0:0:0:0:0:0:60020.leaseChecker): State: TIMED_WAITING Blocked count: 0 Waited count: 0 Stack: java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:62) org.apache.hadoop.hbase.Chore.run(Chore.java:63) Thread 13 (regionserver/0:0:0:0:0:0:0:0:60020.worker): State: TIMED_WAITING Blocked count: 0 Waited count: 232 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:146) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1879) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:396) org.apache.hadoop.hbase.HRegionServer$Worker.run(HRegionServer.java:1150) java.lang.Thread.run(Thread.java:595) Thread 11 (regionserver/0:0:0:0:0:0:0:0:60020.splitter): State: TIMED_WAITING Blocked count: 5 Waited count: 414 Stack: java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client.call(Client.java:504) org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:198) org.apache.hadoop.dfs.$Proxy1.create(Unknown Source) sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) java.lang.reflect.Method.invoke(Method.java:585) org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82) org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59) org.apache.hadoop.dfs.$Proxy1.create(Unknown Source) org.apache.hadoop.dfs.DFSClient$DFSOutputStream.(DFSClient.java:1472) org.apache.hadoop.dfs.DFSClient.create(DFSClient.java:380) org.apache.hadoop.dfs.DistributedFileSystem.create(DistributedFileSystem.java:122) org.apache.hadoop.fs.FileSystem.create(FileSystem.java:434) org.apache.hadoop.fs.FileSystem.create(FileSystem.java:415) org.apache.hadoop.fs.FileSystem.create(FileSystem.java:322) org.apache.hadoop.fs.FileSystem.create(FileSystem.java:314) org.apache.hadoop.hbase.HStoreFile.writeSplitInfo(HStoreFile.java:261) org.apache.hadoop.hbase.HStoreFile.writeReferenceFiles(HStoreFile.java:244) org.apache.hadoop.hbase.HStoreFile.splitStoreFile(HStoreFile.java:237) Thread 10 (regionserver/0:0:0:0:0:0:0:0:60020.compactor): State: TIMED_WAITING Blocked count: 12 Waited count: 2639 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:146) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1879) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:396) org.apache.hadoop.hbase.HRegionServer$Compactor.run(HRegionServer.java:401) Thread 9 (regionserver/0:0:0:0:0:0:0:0:60020.cacheFlusher): State: TIMED_WAITING Blocked count: 13 Waited count: 2175 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:146) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1879) java.util.concurrent.DelayQueue.poll(DelayQueue.java:176) org.apache.hadoop.hbase.HRegionServer$Flusher.run(HRegionServer.java:468) Thread 12 (regionserver/0:0:0:0:0:0:0:0:60020.logRoller): State: TIMED_WAITING Blocked count: 11 Waited count: 706 Stack: java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.HRegionServer$LogRoller.run(HRegionServer.java:579) Thread 29 (org.apache.hadoop.dfs.DFSClient$LeaseChecker@9945ce): State: TIMED_WAITING Blocked count: 0 Waited count: 57 Stack: java.lang.Thread.sleep(Native Method) org.apache.hadoop.dfs.DFSClient$LeaseChecker.run(DFSClient.java:595) java.lang.Thread.run(Thread.java:595) Thread 27 (org.apache.hadoop.io.ObjectWritable Connection Culler): State: TIMED_WAITING Blocked count: 6 Waited count: 0 Stack: java.lang.Thread.sleep(Native Method) org.apache.hadoop.ipc.Client$ConnectionCuller.run(Client.java:421) Thread 20 (org.apache.hadoop.hbase.io.HbaseObjectWritable Connection Culler): State: TIMED_WAITING Blocked count: 10 Waited count: 0 Stack: java.lang.Thread.sleep(Native Method) org.apache.hadoop.ipc.Client$ConnectionCuller.run(Client.java:421) Thread 19 (DestroyJavaVM): State: RUNNABLE Blocked count: 0 Waited count: 0 Stack: Thread 18 (regionserver/0:0:0:0:0:0:0:0:60020): State: TIMED_WAITING Blocked count: 2 Waited count: 588 Stack: java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:62) org.apache.hadoop.hbase.HRegionServer.run(HRegionServer.java:827) java.lang.Thread.run(Thread.java:595) Thread 4 (Signal Dispatcher): State: RUNNABLE Blocked count: 0 Waited count: 0 Stack: Thread 3 (Finalizer): State: WAITING Blocked count: 214 Waited count: 91 Waiting on java.lang.ref.ReferenceQueue$Lock@5f2db0 Stack: java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132) java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159) Thread 2 (Reference Handler): State: WAITING Blocked count: 367 Waited count: 88 Waiting on java.lang.ref.Reference$Lock@b0a3f5 Stack: java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:474) java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116) 2008-01-13 18:31:14,394 WARN org.apache.hadoop.ipc.Server: IPC Server handler 8 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@a4488) from 10.0.0.4:54276: discarded for being too old (156214) 2008-01-13 18:31:14,403 ERROR org.apache.hadoop.hbase.HRegionServer: Error opening scanner (fsOk: true) org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.openScanner(HRegionServer.java:1477) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,406 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 60020, call openScanner(webdata,,1200269242626, [Lorg.apache.hadoop.io.Text;@dc41c5, , 9223372036854775807, null) from 10.0.0.1:38682: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.openScanner(HRegionServer.java:1477) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,448 ERROR org.apache.hadoop.hbase.HRegionServer: Error opening scanner (fsOk: true) org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.openScanner(HRegionServer.java:1477) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,453 INFO org.apache.hadoop.ipc.Server: IPC Server handler 2 on 60020, call openScanner(webdata,,1200269242626, [Lorg.apache.hadoop.io.Text;@6214f5, , 9223372036854775807, null) from 10.0.0.1:38682: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.openScanner(HRegionServer.java:1477) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,483 ERROR org.apache.hadoop.hbase.HRegionServer: Error opening scanner (fsOk: true) org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.openScanner(HRegionServer.java:1477) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,487 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1 on 60020, call openScanner(webdata,,1200269242626, [Lorg.apache.hadoop.io.Text;@14e113b, , 9223372036854775807, null) from 10.0.0.1:38682: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.openScanner(HRegionServer.java:1477) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,514 ERROR org.apache.hadoop.hbase.HRegionServer: Error opening scanner (fsOk: true) org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.openScanner(HRegionServer.java:1477) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:14,517 INFO org.apache.hadoop.ipc.Server: IPC Server handler 6 on 60020, call openScanner(webdata,,1200269242626, [Lorg.apache.hadoop.io.Text;@4d76b4, , 9223372036854775807, null) from 10.0.0.1:38682: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.openScanner(HRegionServer.java:1477) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:15,491 DEBUG org.apache.hadoop.hbase.HStore: starting 253202986/anchor (no reconstruction log) 2008-01-13 18:31:15,491 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/anchor/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/anchor/mapfiles 2008-01-13 18:31:15,514 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 253202986/anchor is 4101786 2008-01-13 18:31:15,535 DEBUG org.apache.hadoop.hbase.HStore: starting 253202986/first_seen (no reconstruction log) 2008-01-13 18:31:15,535 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/first_seen/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/first_seen/mapfiles 2008-01-13 18:31:15,558 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 253202986/first_seen is 4101786 2008-01-13 18:31:15,578 DEBUG org.apache.hadoop.hbase.HStore: starting 253202986/in_rank (no reconstruction log) 2008-01-13 18:31:15,578 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/in_rank/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/in_rank/mapfiles 2008-01-13 18:31:15,600 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 253202986/in_rank is 4101786 2008-01-13 18:31:15,620 DEBUG org.apache.hadoop.hbase.HStore: starting 253202986/last_seen (no reconstruction log) 2008-01-13 18:31:15,620 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/last_seen/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/last_seen/mapfiles 2008-01-13 18:31:15,648 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 253202986/last_seen is 4101786 2008-01-13 18:31:15,671 DEBUG org.apache.hadoop.hbase.HStore: starting 253202986/rank_total (no reconstruction log) 2008-01-13 18:31:15,671 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/rank_total/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/rank_total/mapfiles 2008-01-13 18:31:15,695 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 253202986/rank_total is 4101786 2008-01-13 18:31:15,712 DEBUG org.apache.hadoop.hbase.HStore: starting 253202986/rank_visual (no reconstruction log) 2008-01-13 18:31:15,712 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/rank_visual/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/rank_visual/mapfiles 2008-01-13 18:31:15,732 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 253202986/rank_visual is 4101786 2008-01-13 18:31:15,749 DEBUG org.apache.hadoop.hbase.HStore: starting 253202986/size (no reconstruction log) 2008-01-13 18:31:15,749 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/size/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/size/mapfiles 2008-01-13 18:31:15,769 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 253202986/size is 4101786 2008-01-13 18:31:15,786 DEBUG org.apache.hadoop.hbase.HStore: starting 253202986/source (no reconstruction log) 2008-01-13 18:31:15,786 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/source/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/source/mapfiles 2008-01-13 18:31:15,805 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 253202986/source is 4101786 2008-01-13 18:31:15,823 DEBUG org.apache.hadoop.hbase.HStore: starting 253202986/stime (no reconstruction log) 2008-01-13 18:31:15,823 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/stime/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/stime/mapfiles 2008-01-13 18:31:15,843 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 253202986/stime is 4101786 2008-01-13 18:31:15,858 DEBUG org.apache.hadoop.hbase.HRegion: Next sequence id for region webdata,,1200270518132 is 4101787 2008-01-13 18:31:15,860 INFO org.apache.hadoop.hbase.HRegion: region webdata,,1200270518132 available 2008-01-13 18:31:15,861 DEBUG org.apache.hadoop.hbase.HStore: closed 253202986/size 2008-01-13 18:31:15,861 DEBUG org.apache.hadoop.hbase.HStore: closed 253202986/rank_total 2008-01-13 18:31:15,861 DEBUG org.apache.hadoop.hbase.HStore: closed 253202986/first_seen 2008-01-13 18:31:15,862 DEBUG org.apache.hadoop.hbase.HStore: closed 253202986/anchor 2008-01-13 18:31:15,863 DEBUG org.apache.hadoop.hbase.HStore: closed 253202986/last_seen 2008-01-13 18:31:15,864 DEBUG org.apache.hadoop.hbase.HStore: closed 253202986/source 2008-01-13 18:31:15,864 DEBUG org.apache.hadoop.hbase.HStore: closed 253202986/stime 2008-01-13 18:31:15,866 DEBUG org.apache.hadoop.hbase.HStore: closed 253202986/in_rank 2008-01-13 18:31:15,866 DEBUG org.apache.hadoop.hbase.HStore: closed 253202986/rank_visual 2008-01-13 18:31:15,867 INFO org.apache.hadoop.hbase.HRegion: closed webdata,,1200270518132 2008-01-13 18:31:15,873 DEBUG org.apache.hadoop.hbase.HStore: starting 1531268868/anchor (no reconstruction log) 2008-01-13 18:31:15,873 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/anchor/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/anchor/mapfiles 2008-01-13 18:31:15,896 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1531268868/anchor is 4101786 2008-01-13 18:31:15,916 DEBUG org.apache.hadoop.hbase.HStore: starting 1531268868/first_seen (no reconstruction log) 2008-01-13 18:31:15,916 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/first_seen/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/first_seen/mapfiles 2008-01-13 18:31:15,939 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1531268868/first_seen is 4101786 2008-01-13 18:31:15,959 DEBUG org.apache.hadoop.hbase.HStore: starting 1531268868/in_rank (no reconstruction log) 2008-01-13 18:31:15,959 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/in_rank/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/in_rank/mapfiles 2008-01-13 18:31:15,981 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1531268868/in_rank is 4101786 2008-01-13 18:31:16,001 DEBUG org.apache.hadoop.hbase.HStore: starting 1531268868/last_seen (no reconstruction log) 2008-01-13 18:31:16,001 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/last_seen/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/last_seen/mapfiles 2008-01-13 18:31:16,024 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1531268868/last_seen is 4101786 2008-01-13 18:31:16,045 DEBUG org.apache.hadoop.hbase.HStore: starting 1531268868/rank_total (no reconstruction log) 2008-01-13 18:31:16,045 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/rank_total/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/rank_total/mapfiles 2008-01-13 18:31:16,068 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1531268868/rank_total is 4101786 2008-01-13 18:31:16,088 DEBUG org.apache.hadoop.hbase.HStore: starting 1531268868/rank_visual (no reconstruction log) 2008-01-13 18:31:16,088 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/rank_visual/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/rank_visual/mapfiles 2008-01-13 18:31:16,111 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1531268868/rank_visual is 4101786 2008-01-13 18:31:16,130 DEBUG org.apache.hadoop.hbase.HStore: starting 1531268868/size (no reconstruction log) 2008-01-13 18:31:16,130 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/size/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/size/mapfiles 2008-01-13 18:31:16,154 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1531268868/size is 4101786 2008-01-13 18:31:16,174 DEBUG org.apache.hadoop.hbase.HStore: starting 1531268868/source (no reconstruction log) 2008-01-13 18:31:16,174 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/source/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/source/mapfiles 2008-01-13 18:31:16,197 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1531268868/source is 4101786 2008-01-13 18:31:16,218 DEBUG org.apache.hadoop.hbase.HStore: starting 1531268868/stime (no reconstruction log) 2008-01-13 18:31:16,219 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/stime/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/stime/mapfiles 2008-01-13 18:31:16,245 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1531268868/stime is 4101786 2008-01-13 18:31:16,263 DEBUG org.apache.hadoop.hbase.HRegion: Next sequence id for region webdata,com.trb.fox59/go/schedule/?track=subnav:http,1200270518136 is 4101787 2008-01-13 18:31:16,265 INFO org.apache.hadoop.hbase.HRegion: region webdata,com.trb.fox59/go/schedule/?track=subnav:http,1200270518136 available 2008-01-13 18:31:16,265 DEBUG org.apache.hadoop.hbase.HStore: closed 1531268868/size 2008-01-13 18:31:16,266 DEBUG org.apache.hadoop.hbase.HStore: closed 1531268868/rank_total 2008-01-13 18:31:16,267 DEBUG org.apache.hadoop.hbase.HStore: closed 1531268868/first_seen 2008-01-13 18:31:16,268 DEBUG org.apache.hadoop.hbase.HStore: closed 1531268868/anchor 2008-01-13 18:31:16,270 DEBUG org.apache.hadoop.hbase.HStore: closed 1531268868/last_seen 2008-01-13 18:31:16,270 DEBUG org.apache.hadoop.hbase.HStore: closed 1531268868/source 2008-01-13 18:31:16,271 DEBUG org.apache.hadoop.hbase.HStore: closed 1531268868/stime 2008-01-13 18:31:16,273 DEBUG org.apache.hadoop.hbase.HStore: closed 1531268868/in_rank 2008-01-13 18:31:16,273 DEBUG org.apache.hadoop.hbase.HStore: closed 1531268868/rank_visual 2008-01-13 18:31:16,274 INFO org.apache.hadoop.hbase.HRegion: closed webdata,com.trb.fox59/go/schedule/?track=subnav:http,1200270518136 2008-01-13 18:31:16,277 DEBUG org.apache.hadoop.hbase.HRegion: Cleaned up hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1329286581/splits true 2008-01-13 18:31:16,277 INFO org.apache.hadoop.hbase.HRegion: Region split of webdata,,1200269242626 complete; new regions: webdata,,1200270518132, webdata,com.trb.fox59/go/schedule/?track=subnav:http,1200270518136. Split took 2mins, 38sec 2008-01-13 18:31:16,304 DEBUG org.apache.hadoop.hbase.HConnectionManager$TableServers: No servers for .META.. Doing a find... 2008-01-13 18:31:16,364 DEBUG org.apache.hadoop.hbase.HConnectionManager$TableServers: Found 1 region(s) for .META. at address: 10.0.0.2:60020, regioninfo: regionname: -ROOT-,,0, startKey: <>, encodedName(70236052) tableDesc: {name: -ROOT-, families: {info:={name: info, max versions: 1, compression: NONE, in memory: false, max length: 2147483647, bloom filter: none}}} 2008-01-13 18:31:16,365 INFO org.apache.hadoop.hbase.HRegionServer: Updating .META. with region split info 2008-01-13 18:31:16,373 DEBUG org.apache.hadoop.hbase.HRegionServer: Reporting region split to master 2008-01-13 18:31:16,373 INFO org.apache.hadoop.hbase.HRegionServer: region split, META update, and report to master all successful. Old region=webdata,,1200269242626, new regions: webdata,,1200270518132, webdata,com.trb.fox59/go/schedule/?track=subnav:http,1200270518136 2008-01-13 18:31:18,237 INFO org.apache.hadoop.hbase.HRegionServer: MSG_REGION_OPEN : webdata,,1200270518132 2008-01-13 18:31:18,241 DEBUG org.apache.hadoop.hbase.HStore: starting 253202986/anchor (no reconstruction log) 2008-01-13 18:31:18,241 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/anchor/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/anchor/mapfiles 2008-01-13 18:31:18,264 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 253202986/anchor is 4101786 2008-01-13 18:31:18,284 DEBUG org.apache.hadoop.hbase.HStore: starting 253202986/first_seen (no reconstruction log) 2008-01-13 18:31:18,284 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/first_seen/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/first_seen/mapfiles 2008-01-13 18:31:18,308 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 253202986/first_seen is 4101786 2008-01-13 18:31:18,329 DEBUG org.apache.hadoop.hbase.HStore: starting 253202986/in_rank (no reconstruction log) 2008-01-13 18:31:18,329 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/in_rank/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/in_rank/mapfiles 2008-01-13 18:31:18,351 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 253202986/in_rank is 4101786 2008-01-13 18:31:18,371 DEBUG org.apache.hadoop.hbase.HStore: starting 253202986/last_seen (no reconstruction log) 2008-01-13 18:31:18,371 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/last_seen/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/last_seen/mapfiles 2008-01-13 18:31:18,393 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 253202986/last_seen is 4101786 2008-01-13 18:31:18,416 DEBUG org.apache.hadoop.hbase.HStore: starting 253202986/rank_total (no reconstruction log) 2008-01-13 18:31:18,416 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/rank_total/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/rank_total/mapfiles 2008-01-13 18:31:18,438 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 253202986/rank_total is 4101786 2008-01-13 18:31:18,457 DEBUG org.apache.hadoop.hbase.HStore: starting 253202986/rank_visual (no reconstruction log) 2008-01-13 18:31:18,458 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/rank_visual/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/rank_visual/mapfiles 2008-01-13 18:31:18,479 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 253202986/rank_visual is 4101786 2008-01-13 18:31:18,498 DEBUG org.apache.hadoop.hbase.HStore: starting 253202986/size (no reconstruction log) 2008-01-13 18:31:18,498 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/size/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/size/mapfiles 2008-01-13 18:31:18,520 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 253202986/size is 4101786 2008-01-13 18:31:18,539 DEBUG org.apache.hadoop.hbase.HStore: starting 253202986/source (no reconstruction log) 2008-01-13 18:31:18,540 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/source/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/source/mapfiles 2008-01-13 18:31:18,561 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 253202986/source is 4101786 2008-01-13 18:31:18,583 DEBUG org.apache.hadoop.hbase.HStore: starting 253202986/stime (no reconstruction log) 2008-01-13 18:31:18,583 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/stime/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/253202986/stime/mapfiles 2008-01-13 18:31:18,606 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 253202986/stime is 4101786 2008-01-13 18:31:18,624 DEBUG org.apache.hadoop.hbase.HRegion: Next sequence id for region webdata,,1200270518132 is 4101787 2008-01-13 18:31:18,626 INFO org.apache.hadoop.hbase.HRegion: region webdata,,1200270518132 available 2008-01-13 18:31:18,626 INFO org.apache.hadoop.hbase.HRegionServer: MSG_REGION_OPEN : webdata,com.trb.fox59/go/schedule/?track=subnav:http,1200270518136 2008-01-13 18:31:18,628 DEBUG org.apache.hadoop.hbase.HStore: starting 1531268868/anchor (no reconstruction log) 2008-01-13 18:31:18,628 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/anchor/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/anchor/mapfiles 2008-01-13 18:31:18,652 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1531268868/anchor is 4101786 2008-01-13 18:31:18,680 DEBUG org.apache.hadoop.hbase.HStore: starting 1531268868/first_seen (no reconstruction log) 2008-01-13 18:31:18,680 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/first_seen/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/first_seen/mapfiles 2008-01-13 18:31:18,714 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1531268868/first_seen is 4101786 2008-01-13 18:31:18,736 DEBUG org.apache.hadoop.hbase.HStore: starting 1531268868/in_rank (no reconstruction log) 2008-01-13 18:31:18,736 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/in_rank/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/in_rank/mapfiles 2008-01-13 18:31:18,759 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1531268868/in_rank is 4101786 2008-01-13 18:31:18,781 DEBUG org.apache.hadoop.hbase.HStore: starting 1531268868/last_seen (no reconstruction log) 2008-01-13 18:31:18,782 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/last_seen/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/last_seen/mapfiles 2008-01-13 18:31:18,804 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1531268868/last_seen is 4101786 2008-01-13 18:31:18,827 DEBUG org.apache.hadoop.hbase.HStore: starting 1531268868/rank_total (no reconstruction log) 2008-01-13 18:31:18,828 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/rank_total/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/rank_total/mapfiles 2008-01-13 18:31:18,850 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1531268868/rank_total is 4101786 2008-01-13 18:31:18,876 DEBUG org.apache.hadoop.hbase.HStore: starting 1531268868/rank_visual (no reconstruction log) 2008-01-13 18:31:18,876 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/rank_visual/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/rank_visual/mapfiles 2008-01-13 18:31:18,901 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1531268868/rank_visual is 4101786 2008-01-13 18:31:18,925 DEBUG org.apache.hadoop.hbase.HStore: starting 1531268868/size (no reconstruction log) 2008-01-13 18:31:18,925 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/size/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/size/mapfiles 2008-01-13 18:31:18,951 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1531268868/size is 4101786 2008-01-13 18:31:18,976 DEBUG org.apache.hadoop.hbase.HStore: starting 1531268868/source (no reconstruction log) 2008-01-13 18:31:18,976 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/source/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/source/mapfiles 2008-01-13 18:31:19,003 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1531268868/source is 4101786 2008-01-13 18:31:19,027 DEBUG org.apache.hadoop.hbase.HStore: starting 1531268868/stime (no reconstruction log) 2008-01-13 18:31:19,027 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/stime/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1531268868/stime/mapfiles 2008-01-13 18:31:19,050 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1531268868/stime is 4101786 2008-01-13 18:31:19,071 DEBUG org.apache.hadoop.hbase.HRegion: Next sequence id for region webdata,com.trb.fox59/go/schedule/?track=subnav:http,1200270518136 is 4101787 2008-01-13 18:31:19,073 INFO org.apache.hadoop.hbase.HRegion: region webdata,com.trb.fox59/go/schedule/?track=subnav:http,1200270518136 available 2008-01-13 18:31:24,360 INFO org.apache.hadoop.ipc.Server: IPC Server handler 0 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@114b82b) from 10.0.0.1:38401: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:24,361 INFO org.apache.hadoop.ipc.Server: IPC Server handler 0 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@147358f) from 10.0.0.1:38401: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:24,362 INFO org.apache.hadoop.ipc.Server: IPC Server handler 0 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@d5eb7) from 10.0.0.1:38401: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:24,362 INFO org.apache.hadoop.ipc.Server: IPC Server handler 0 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1c54796) from 10.0.0.1:38401: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:24,373 INFO org.apache.hadoop.ipc.Server: IPC Server handler 4 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@ded0f0) from 10.0.0.4:54276: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:24,374 INFO org.apache.hadoop.ipc.Server: IPC Server handler 8 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@676e3f) from 10.0.0.4:54276: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:24,395 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@770d2e) from 10.0.0.3:34121: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:24,397 INFO org.apache.hadoop.ipc.Server: IPC Server handler 2 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@27982) from 10.0.0.3:34121: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:24,398 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@778255) from 10.0.0.3:34121: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:24,398 INFO org.apache.hadoop.ipc.Server: IPC Server handler 6 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@778255) from 10.0.0.3:34121: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:24,419 INFO org.apache.hadoop.ipc.Server: IPC Server handler 0 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@da90c) from 10.0.0.4:54276: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:24,420 INFO org.apache.hadoop.ipc.Server: IPC Server handler 9 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@d58939) from 10.0.0.4:54276: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:24,432 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@124111a) from 10.0.0.2:36602: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:24,432 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@dec8b3) from 10.0.0.2:36602: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:24,433 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@4a7df6) from 10.0.0.2:36602: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:24,434 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 60020, call batchUpdate(webdata,,1200269242626, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@93df2c) from 10.0.0.2:36602: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1457) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:36,005 INFO org.apache.hadoop.hbase.HRegionServer: Rolling hlog. Number of entries: 30010 2008-01-13 18:31:36,188 DEBUG org.apache.hadoop.hbase.HLog: Closing current log writer hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.121 to get a new one 2008-01-13 18:31:36,191 INFO org.apache.hadoop.hbase.HLog: new log writer created at hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.122 2008-01-13 18:31:36,192 DEBUG org.apache.hadoop.hbase.HLog: Found 5 logs to remove using oldest outstanding seqnum of 4101787 from region webdata,com.trb.fox59/go/schedule/?track=subnav:http,1200270518136 2008-01-13 18:31:36,192 INFO org.apache.hadoop.hbase.HLog: removing old log file hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.116 whose highest sequence/edit id is 3958971 2008-01-13 18:31:36,196 INFO org.apache.hadoop.hbase.HLog: removing old log file hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.117 whose highest sequence/edit id is 3989010 2008-01-13 18:31:36,199 INFO org.apache.hadoop.hbase.HLog: removing old log file hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.118 whose highest sequence/edit id is 4019028 2008-01-13 18:31:36,202 INFO org.apache.hadoop.hbase.HLog: removing old log file hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.119 whose highest sequence/edit id is 4049038 2008-01-13 18:31:36,206 INFO org.apache.hadoop.hbase.HLog: removing old log file hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.120 whose highest sequence/edit id is 4079044 2008-01-13 18:31:39,441 ERROR org.apache.hadoop.hbase.HRegionServer: Error opening scanner (fsOk: true) org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.openScanner(HRegionServer.java:1477) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:39,450 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 60020, call openScanner(webdata,,1200269242626, [Lorg.apache.hadoop.io.Text;@3a1834, , 9223372036854775807, null) from 10.0.0.1:40779: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200269242626 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1636) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1608) at org.apache.hadoop.hbase.HRegionServer.openScanner(HRegionServer.java:1477) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:903) 2008-01-13 18:31:42,576 INFO org.apache.hadoop.hbase.HRegionServer: Rolling hlog. Number of entries: 30011 2008-01-13 18:31:42,765 DEBUG org.apache.hadoop.hbase.HLog: Closing current log writer hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.122 to get a new one 2008-01-13 18:31:42,769 INFO org.apache.hadoop.hbase.HLog: new log writer created at hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.123 2008-01-13 18:31:42,769 DEBUG org.apache.hadoop.hbase.HLog: Found 0 logs to remove using oldest outstanding seqnum of 4101787 from region webdata,com.trb.fox59/go/schedule/?track=subnav:http,1200270518136 2008-01-13 18:31:48,664 INFO org.apache.hadoop.hbase.HRegionServer: Rolling hlog. Number of entries: 30005 2008-01-13 18:31:48,867 DEBUG org.apache.hadoop.hbase.HLog: Closing current log writer hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.123 to get a new one 2008-01-13 18:31:48,872 INFO org.apache.hadoop.hbase.HLog: new log writer created at hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.124 2008-01-13 18:31:48,872 DEBUG org.apache.hadoop.hbase.HLog: Found 0 logs to remove using oldest outstanding seqnum of 4101787 from region webdata,com.trb.fox59/go/schedule/?track=subnav:http,1200270518136 2008-01-13 18:31:54,783 INFO org.apache.hadoop.hbase.HRegionServer: Rolling hlog. Number of entries: 30020 2008-01-13 18:31:54,960 DEBUG org.apache.hadoop.hbase.HLog: Closing current log writer hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.124 to get a new one 2008-01-13 18:31:55,181 INFO org.apache.hadoop.hbase.HLog: new log writer created at hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.125 2008-01-13 18:31:55,182 DEBUG org.apache.hadoop.hbase.HLog: Found 0 logs to remove using oldest outstanding seqnum of 4101787 from region webdata,com.trb.fox59/go/schedule/?track=subnav:http,1200270518136 2008-01-13 18:32:01,115 INFO org.apache.hadoop.hbase.HRegionServer: Rolling hlog. Number of entries: 30002 2008-01-13 18:32:01,484 DEBUG org.apache.hadoop.hbase.HLog: Closing current log writer hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.125 to get a new one 2008-01-13 18:32:01,489 INFO org.apache.hadoop.hbase.HLog: new log writer created at hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.126 2008-01-13 18:32:01,489 DEBUG org.apache.hadoop.hbase.HLog: Found 0 logs to remove using oldest outstanding seqnum of 4101787 from region webdata,com.trb.fox59/go/schedule/?track=subnav:http,1200270518136 2008-01-13 18:32:07,397 INFO org.apache.hadoop.hbase.HRegionServer: Rolling hlog. Number of entries: 30002 2008-01-13 18:32:07,562 DEBUG org.apache.hadoop.hbase.HLog: Closing current log writer hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.126 to get a new one 2008-01-13 18:32:07,567 INFO org.apache.hadoop.hbase.HLog: new log writer created at hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.127 2008-01-13 18:32:07,567 DEBUG org.apache.hadoop.hbase.HLog: Found 0 logs to remove using oldest outstanding seqnum of 4101787 from region webdata,com.trb.fox59/go/schedule/?track=subnav:http,1200270518136 2008-01-13 18:32:13,877 INFO org.apache.hadoop.hbase.HRegionServer: Rolling hlog. Number of entries: 30030 2008-01-13 18:32:14,260 DEBUG org.apache.hadoop.hbase.HLog: Closing current log writer hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.127 to get a new one 2008-01-13 18:32:14,265 INFO org.apache.hadoop.hbase.HLog: new log writer created at hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.128 2008-01-13 18:32:14,265 DEBUG org.apache.hadoop.hbase.HLog: Found 0 logs to remove using oldest outstanding seqnum of 4101787 from region webdata,com.trb.fox59/go/schedule/?track=subnav:http,1200270518136 2008-01-13 18:32:18,631 DEBUG org.apache.hadoop.hbase.HRegion: Started memcache flush for region webdata,,1200270518132. Size 10.4m 2008-01-13 18:32:19,105 DEBUG org.apache.hadoop.hbase.HStore: Added 253202986/size/5952794678008483100 with 1300 entries, sequence id 4305109, and size 20.7k for 253202986/size 2008-01-13 18:32:19,259 DEBUG org.apache.hadoop.hbase.HStore: Added 253202986/rank_total/6539012030164435311 with 0 entries, sequence id 4305109, and size 153.0 for 253202986/rank_total 2008-01-13 18:32:19,389 DEBUG org.apache.hadoop.hbase.HStore: Added 253202986/first_seen/5857426588912702506 with 0 entries, sequence id 4305109, and size 153.0 for 253202986/first_seen 2008-01-13 18:32:20,622 DEBUG org.apache.hadoop.hbase.HStore: Added 253202986/anchor/6804601756552080932 with 31567 entries, sequence id 4305109, and size 684.5k for 253202986/anchor 2008-01-13 18:32:21,565 DEBUG org.apache.hadoop.hbase.HStore: Added 253202986/last_seen/2441329250557884246 with 31567 entries, sequence id 4305109, and size 472.0k for 253202986/last_seen 2008-01-13 18:32:21,691 DEBUG org.apache.hadoop.hbase.HStore: Added 253202986/source/298241002813419007 with 0 entries, sequence id 4305109, and size 153.0 for 253202986/source 2008-01-13 18:32:21,875 DEBUG org.apache.hadoop.hbase.HStore: Added 253202986/stime/3797256977253172515 with 1300 entries, sequence id 4305109, and size 18.3k for 253202986/stime 2008-01-13 18:32:21,902 INFO org.apache.hadoop.hbase.HRegionServer: Rolling hlog. Number of entries: 30019 2008-01-13 18:32:22,856 DEBUG org.apache.hadoop.hbase.HStore: Added 253202986/in_rank/4553818692075413634 with 31567 entries, sequence id 4305109, and size 482.1k for 253202986/in_rank 2008-01-13 18:32:22,999 DEBUG org.apache.hadoop.hbase.HStore: Added 253202986/rank_visual/3673009980492949343 with 0 entries, sequence id 4305109, and size 153.0 for 253202986/rank_visual 2008-01-13 18:32:22,999 DEBUG org.apache.hadoop.hbase.HRegion: Finished memcache flush for region webdata,,1200270518132 in 4369ms, sequenceid=4305109 2008-01-13 18:32:23,000 DEBUG org.apache.hadoop.hbase.HRegion: Started memcache flush for region webdata,com.trb.fox59/go/schedule/?track=subnav:http,1200270518136. Size 12.1m 2008-01-13 18:32:23,003 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 253202986/size needed. 2008-01-13 18:32:23,003 DEBUG org.apache.hadoop.hbase.HRegion: 253202986/size needs compaction 2008-01-13 18:32:23,003 INFO org.apache.hadoop.hbase.HRegion: starting compaction on region webdata,,1200270518132 2008-01-13 18:32:23,003 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 253202986/size 2008-01-13 18:32:23,273 DEBUG org.apache.hadoop.hbase.HLog: Closing current log writer hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.128 to get a new one 2008-01-13 18:32:23,280 INFO org.apache.hadoop.hbase.HLog: new log writer created at hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.129 2008-01-13 18:32:23,280 DEBUG org.apache.hadoop.hbase.HLog: Found 0 logs to remove using oldest outstanding seqnum of 4101787 from region webdata,com.trb.fox59/go/schedule/?track=subnav:http,1200270518136 2008-01-13 18:32:23,505 DEBUG org.apache.hadoop.hbase.HStore: Added 1531268868/size/5752715022711258650 with 1691 entries, sequence id 4323855, and size 27.7k for 1531268868/size 2008-01-13 18:32:23,705 DEBUG org.apache.hadoop.hbase.HStore: Added 1531268868/rank_total/4403464296781012456 with 0 entries, sequence id 4323855, and size 153.0 for 1531268868/rank_total 2008-01-13 18:32:23,709 INFO org.apache.hadoop.hbase.Leases: regionserver/0:0:0:0:0:0:0:0:60020.leaseChecker lease expired -5296130339019908701/-5296130339019908701 2008-01-13 18:32:23,710 INFO org.apache.hadoop.hbase.HRegionServer: Scanner -5296130339019908701 lease expired 2008-01-13 18:32:23,903 DEBUG org.apache.hadoop.hbase.HStore: Added 1531268868/first_seen/883106758988382608 with 0 entries, sequence id 4323855, and size 153.0 for 1531268868/first_seen 2008-01-13 18:32:25,259 DEBUG org.apache.hadoop.hbase.HStore: moving 253202986/size/2084231359692995314 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 253202986/size/251807677590165162 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 253202986/size 2008-01-13 18:32:25,326 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 253202986/rank_total 2008-01-13 18:32:25,357 DEBUG org.apache.hadoop.hbase.HStore: Added 1531268868/anchor/6880650459408633954 with 37619 entries, sequence id 4323855, and size 799.6k for 1531268868/anchor 2008-01-13 18:32:25,521 DEBUG org.apache.hadoop.hbase.HStore: moving 253202986/rank_total/4531166170024338236 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 253202986/rank_total/6992521455106769081 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 253202986/rank_total 2008-01-13 18:32:25,599 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 253202986/first_seen 2008-01-13 18:32:25,829 DEBUG org.apache.hadoop.hbase.HStore: moving 253202986/first_seen/4198138862801566769 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 253202986/first_seen/2972211280219870795 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 253202986/first_seen 2008-01-13 18:32:25,908 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 253202986/anchor 2008-01-13 18:32:26,871 DEBUG org.apache.hadoop.hbase.HStore: Added 1531268868/last_seen/2792065193639524098 with 37619 entries, sequence id 4323855, and size 531.0k for 1531268868/last_seen 2008-01-13 18:32:27,023 DEBUG org.apache.hadoop.hbase.HStore: Added 1531268868/source/3577305737197136854 with 0 entries, sequence id 4323855, and size 153.0 for 1531268868/source 2008-01-13 18:32:27,212 DEBUG org.apache.hadoop.hbase.HStore: Added 1531268868/stime/3537347265239558719 with 1691 entries, sequence id 4323855, and size 25.3k for 1531268868/stime 2008-01-13 18:32:28,492 DEBUG org.apache.hadoop.hbase.HStore: Added 1531268868/in_rank/6516488943722839620 with 37619 entries, sequence id 4323855, and size 540.3k for 1531268868/in_rank 2008-01-13 18:32:28,630 DEBUG org.apache.hadoop.hbase.HStore: Added 1531268868/rank_visual/6169205730090924667 with 0 entries, sequence id 4323855, and size 153.0 for 1531268868/rank_visual 2008-01-13 18:32:28,631 DEBUG org.apache.hadoop.hbase.HRegion: Finished memcache flush for region webdata,com.trb.fox59/go/schedule/?track=subnav:http,1200270518136 in 5631ms, sequenceid=4323855 2008-01-13 18:32:31,028 INFO org.apache.hadoop.hbase.HRegionServer: Rolling hlog. Number of entries: 30001 2008-01-13 18:32:31,384 DEBUG org.apache.hadoop.hbase.HLog: Closing current log writer hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.129 to get a new one 2008-01-13 18:32:31,388 INFO org.apache.hadoop.hbase.HLog: new log writer created at hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.130 2008-01-13 18:32:31,389 DEBUG org.apache.hadoop.hbase.HLog: Found 7 logs to remove using oldest outstanding seqnum of 4323821 from region webdata,,1200270518132 2008-01-13 18:32:31,389 INFO org.apache.hadoop.hbase.HLog: removing old log file hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.121 whose highest sequence/edit id is 4109054 2008-01-13 18:32:31,392 INFO org.apache.hadoop.hbase.HLog: removing old log file hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.122 whose highest sequence/edit id is 4139065 2008-01-13 18:32:31,396 INFO org.apache.hadoop.hbase.HLog: removing old log file hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.123 whose highest sequence/edit id is 4169073 2008-01-13 18:32:31,400 INFO org.apache.hadoop.hbase.HLog: removing old log file hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.124 whose highest sequence/edit id is 4199093 2008-01-13 18:32:31,403 INFO org.apache.hadoop.hbase.HLog: removing old log file hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.125 whose highest sequence/edit id is 4229095 2008-01-13 18:32:31,407 INFO org.apache.hadoop.hbase.HLog: removing old log file hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.126 whose highest sequence/edit id is 4259097 2008-01-13 18:32:31,411 INFO org.apache.hadoop.hbase.HLog: removing old log file hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.127 whose highest sequence/edit id is 4289127 2008-01-13 18:32:37,831 INFO org.apache.hadoop.hbase.HRegionServer: Rolling hlog. Number of entries: 30021 2008-01-13 18:32:38,164 DEBUG org.apache.hadoop.hbase.HLog: Closing current log writer hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.130 to get a new one 2008-01-13 18:32:38,169 INFO org.apache.hadoop.hbase.HLog: new log writer created at hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.131 2008-01-13 18:32:38,170 DEBUG org.apache.hadoop.hbase.HLog: Found 0 logs to remove using oldest outstanding seqnum of 4323821 from region webdata,,1200270518132 2008-01-13 18:32:44,678 INFO org.apache.hadoop.hbase.HRegionServer: Rolling hlog. Number of entries: 30014 2008-01-13 18:32:44,988 DEBUG org.apache.hadoop.hbase.HLog: Closing current log writer hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.131 to get a new one 2008-01-13 18:32:44,992 INFO org.apache.hadoop.hbase.HLog: new log writer created at hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.132 2008-01-13 18:32:44,992 DEBUG org.apache.hadoop.hbase.HLog: Found 0 logs to remove using oldest outstanding seqnum of 4323821 from region webdata,,1200270518132 2008-01-13 18:32:51,588 INFO org.apache.hadoop.hbase.HRegionServer: Rolling hlog. Number of entries: 30014 2008-01-13 18:32:51,943 DEBUG org.apache.hadoop.hbase.HLog: Closing current log writer hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.132 to get a new one 2008-01-13 18:32:51,948 INFO org.apache.hadoop.hbase.HLog: new log writer created at hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.3_1200268927500_60020/hlog.dat.133 2008-01-13 18:32:51,948 DEBUG org.apache.hadoop.hbase.HLog: Found 0 logs to remove using oldest outstanding seqnum of 4323821 from region webdata,,1200270518132 2008-01-13 18:33:04,099 DEBUG org.apache.hadoop.hbase.HStore: moving 253202986/anchor/7804824974909619965 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 253202986/anchor/5077177974885606685 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 253202986/anchor 2008-01-13 18:33:04,242 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 253202986/last_seen 2008-01-13 18:33:23,002 DEBUG org.apache.hadoop.hbase.HRegion: Started memcache flush for region webdata,,1200270518132. Size 7.6m 2008-01-13 18:33:23,256 DEBUG org.apache.hadoop.hbase.HStore: Added 253202986/size/8110538488608256963 with 1015 entries, sequence id 4458120, and size 16.3k for 253202986/size 2008-01-13 18:33:23,317 DEBUG org.apache.hadoop.hbase.HStore: Added 253202986/rank_total/7696860129469358104 with 0 entries, sequence id 4458120, and size 153.0 for 253202986/rank_total 2008-01-13 18:33:23,376 DEBUG org.apache.hadoop.hbase.HStore: Added 253202986/first_seen/3929570726953102423 with 0 entries, sequence id 4458120, and size 153.0 for 253202986/first_seen 2008-01-13 18:33:23,936 DEBUG org.apache.hadoop.hbase.HStore: Added 253202986/anchor/5356454824143138186 with 23898 entries, sequence id 4458120, and size 538.9k for 253202986/anchor 2008-01-13 18:33:24,400 DEBUG org.apache.hadoop.hbase.HStore: Added 253202986/last_seen/1140440600352132179 with 23898 entries, sequence id 4458120, and size 360.1k for 253202986/last_seen 2008-01-13 18:33:24,458 DEBUG org.apache.hadoop.hbase.HStore: Added 253202986/source/3773677431071178447 with 0 entries, sequence id 4458120, and size 153.0 for 253202986/source 2008-01-13 18:33:24,528 DEBUG org.apache.hadoop.hbase.HStore: Added 253202986/stime/1761852692221847730 with 1015 entries, sequence id 4458120, and size 14.5k for 253202986/stime 2008-01-13 18:33:25,038 DEBUG org.apache.hadoop.hbase.HStore: Added 253202986/in_rank/9058392379302494836 with 23898 entries, sequence id 4458120, and size 368.2k for 253202986/in_rank 2008-01-13 18:33:25,104 DEBUG org.apache.hadoop.hbase.HStore: Added 253202986/rank_visual/2977527849398889744 with 0 entries, sequence id 4458120, and size 153.0 for 253202986/rank_visual 2008-01-13 18:33:25,104 DEBUG org.apache.hadoop.hbase.HRegion: Finished memcache flush for region webdata,,1200270518132 in 2102ms, sequenceid=4458120