2008-01-15 14:51:09,422 INFO org.apache.hadoop.hbase.HRegionServer: MSG_REGION_OPEN : webdata,com.technorati/tag/potiron:http,1200430256772 2008-01-15 14:51:09,475 DEBUG org.apache.hadoop.hbase.HStore: starting 1515921105/anchor (no reconstruction log) 2008-01-15 14:51:09,475 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1515921105/anchor/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1515921105/anchor/mapfiles 2008-01-15 14:51:09,555 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1515921105/anchor is 1404937 2008-01-15 14:51:09,611 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2008-01-15 14:51:09,633 DEBUG org.apache.hadoop.hbase.HStore: starting 1515921105/first_seen (no reconstruction log) 2008-01-15 14:51:09,633 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1515921105/first_seen/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1515921105/first_seen/mapfiles 2008-01-15 14:51:09,674 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1515921105/first_seen is 1404937 2008-01-15 14:51:09,708 DEBUG org.apache.hadoop.hbase.HStore: starting 1515921105/in_rank (no reconstruction log) 2008-01-15 14:51:09,708 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1515921105/in_rank/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1515921105/in_rank/mapfiles 2008-01-15 14:51:09,747 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1515921105/in_rank is 1404937 2008-01-15 14:51:09,781 DEBUG org.apache.hadoop.hbase.HStore: starting 1515921105/last_seen (no reconstruction log) 2008-01-15 14:51:09,781 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1515921105/last_seen/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1515921105/last_seen/mapfiles 2008-01-15 14:51:09,819 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1515921105/last_seen is 1404937 2008-01-15 14:51:09,864 DEBUG org.apache.hadoop.hbase.HStore: starting 1515921105/rank_total (no reconstruction log) 2008-01-15 14:51:09,864 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1515921105/rank_total/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1515921105/rank_total/mapfiles 2008-01-15 14:51:09,925 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1515921105/rank_total is 1404937 2008-01-15 14:51:09,969 DEBUG org.apache.hadoop.hbase.HStore: starting 1515921105/rank_visual (no reconstruction log) 2008-01-15 14:51:09,969 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1515921105/rank_visual/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1515921105/rank_visual/mapfiles 2008-01-15 14:51:10,019 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1515921105/rank_visual is 1404937 2008-01-15 14:51:10,068 DEBUG org.apache.hadoop.hbase.HStore: starting 1515921105/size (no reconstruction log) 2008-01-15 14:51:10,068 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1515921105/size/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1515921105/size/mapfiles 2008-01-15 14:51:10,121 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1515921105/size is 1404937 2008-01-15 14:51:10,165 DEBUG org.apache.hadoop.hbase.HStore: starting 1515921105/source (no reconstruction log) 2008-01-15 14:51:10,166 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1515921105/source/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1515921105/source/mapfiles 2008-01-15 14:51:10,208 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1515921105/source is 1404937 2008-01-15 14:51:10,240 DEBUG org.apache.hadoop.hbase.HStore: starting 1515921105/stime (no reconstruction log) 2008-01-15 14:51:10,240 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1515921105/stime/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1515921105/stime/mapfiles 2008-01-15 14:51:10,276 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1515921105/stime is 1404937 2008-01-15 14:51:10,311 DEBUG org.apache.hadoop.hbase.HRegion: Next sequence id for region webdata,com.technorati/tag/potiron:http,1200430256772 is 1404938 2008-01-15 14:51:10,314 INFO org.apache.hadoop.hbase.HRegion: region webdata,com.technorati/tag/potiron:http,1200430256772 available 2008-01-15 14:51:10,314 DEBUG org.apache.hadoop.hbase.HLog: changing sequence number from 0 to 1404938 2008-01-15 14:51:10,314 INFO org.apache.hadoop.hbase.HRegionServer: MSG_REGION_OPEN : webdata,,1200430256769 2008-01-15 14:51:10,322 DEBUG org.apache.hadoop.hbase.HStore: starting 674087192/anchor (no reconstruction log) 2008-01-15 14:51:10,322 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/674087192/anchor/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/674087192/anchor/mapfiles 2008-01-15 14:51:10,370 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 674087192/anchor is 1404937 2008-01-15 14:51:10,419 DEBUG org.apache.hadoop.hbase.HStore: starting 674087192/first_seen (no reconstruction log) 2008-01-15 14:51:10,419 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/674087192/first_seen/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/674087192/first_seen/mapfiles 2008-01-15 14:51:10,461 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 674087192/first_seen is 1404937 2008-01-15 14:51:10,491 DEBUG org.apache.hadoop.hbase.HStore: starting 674087192/in_rank (no reconstruction log) 2008-01-15 14:51:10,491 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/674087192/in_rank/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/674087192/in_rank/mapfiles 2008-01-15 14:51:10,527 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 674087192/in_rank is 1404937 2008-01-15 14:51:10,559 DEBUG org.apache.hadoop.hbase.HStore: starting 674087192/last_seen (no reconstruction log) 2008-01-15 14:51:10,559 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/674087192/last_seen/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/674087192/last_seen/mapfiles 2008-01-15 14:51:10,608 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 674087192/last_seen is 1404937 2008-01-15 14:51:10,662 DEBUG org.apache.hadoop.hbase.HStore: starting 674087192/rank_total (no reconstruction log) 2008-01-15 14:51:10,662 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/674087192/rank_total/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/674087192/rank_total/mapfiles 2008-01-15 14:51:10,714 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 674087192/rank_total is 1404937 2008-01-15 14:51:10,754 DEBUG org.apache.hadoop.hbase.HStore: starting 674087192/rank_visual (no reconstruction log) 2008-01-15 14:51:10,754 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/674087192/rank_visual/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/674087192/rank_visual/mapfiles 2008-01-15 14:51:10,797 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 674087192/rank_visual is 1404937 2008-01-15 14:51:10,834 DEBUG org.apache.hadoop.hbase.HStore: starting 674087192/size (no reconstruction log) 2008-01-15 14:51:10,834 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/674087192/size/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/674087192/size/mapfiles 2008-01-15 14:51:10,873 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 674087192/size is 1404937 2008-01-15 14:51:10,917 DEBUG org.apache.hadoop.hbase.HStore: starting 674087192/source (no reconstruction log) 2008-01-15 14:51:10,917 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/674087192/source/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/674087192/source/mapfiles 2008-01-15 14:51:10,967 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 674087192/source is 1404937 2008-01-15 14:51:10,996 DEBUG org.apache.hadoop.hbase.HStore: starting 674087192/stime (no reconstruction log) 2008-01-15 14:51:10,996 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/674087192/stime/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/674087192/stime/mapfiles 2008-01-15 14:51:11,026 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 674087192/stime is 1404937 2008-01-15 14:51:11,051 DEBUG org.apache.hadoop.hbase.HRegion: Next sequence id for region webdata,,1200430256769 is 1404938 2008-01-15 14:51:11,053 INFO org.apache.hadoop.hbase.HRegion: region webdata,,1200430256769 available 2008-01-15 14:52:10,320 DEBUG org.apache.hadoop.hbase.HRegion: Started memcache flush for region webdata,com.technorati/tag/potiron:http,1200430256772. Size 11.4m 2008-01-15 14:52:10,968 DEBUG org.apache.hadoop.hbase.HStore: Added 1515921105/size/8855177024948794589 with 1581 entries, sequence id 1628599, and size 86.8k for 1515921105/size 2008-01-15 14:52:11,152 DEBUG org.apache.hadoop.hbase.HStore: Added 1515921105/rank_total/1690116034098733494 with 0 entries, sequence id 1628599, and size 110.0 for 1515921105/rank_total 2008-01-15 14:52:11,326 DEBUG org.apache.hadoop.hbase.HStore: Added 1515921105/first_seen/1455557313880930203 with 0 entries, sequence id 1628599, and size 110.0 for 1515921105/first_seen 2008-01-15 14:52:13,031 DEBUG org.apache.hadoop.hbase.HStore: Added 1515921105/anchor/7682750976952587681 with 36618 entries, sequence id 1628599, and size 4.2m for 1515921105/anchor 2008-01-15 14:52:14,339 DEBUG org.apache.hadoop.hbase.HStore: Added 1515921105/last_seen/8418528334320738152 with 36618 entries, sequence id 1628599, and size 4.2m for 1515921105/last_seen 2008-01-15 14:52:14,500 DEBUG org.apache.hadoop.hbase.HStore: Added 1515921105/source/3581720496294123026 with 0 entries, sequence id 1628599, and size 110.0 for 1515921105/source 2008-01-15 14:52:14,768 DEBUG org.apache.hadoop.hbase.HStore: Added 1515921105/stime/7729850211227062881 with 1581 entries, sequence id 1628599, and size 97.5k for 1515921105/stime 2008-01-15 14:52:15,928 DEBUG org.apache.hadoop.hbase.HStore: Added 1515921105/in_rank/943371630795627276 with 36618 entries, sequence id 1628599, and size 4.4m for 1515921105/in_rank 2008-01-15 14:52:16,106 DEBUG org.apache.hadoop.hbase.HStore: Added 1515921105/rank_visual/2548212578992019127 with 0 entries, sequence id 1628599, and size 110.0 for 1515921105/rank_visual 2008-01-15 14:52:16,107 DEBUG org.apache.hadoop.hbase.HRegion: Finished memcache flush for region webdata,com.technorati/tag/potiron:http,1200430256772 in 5790ms, sequenceid=1628599 2008-01-15 14:52:16,110 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1515921105/size needed. 2008-01-15 14:52:16,110 DEBUG org.apache.hadoop.hbase.HRegion: 1515921105/size needs compaction 2008-01-15 14:52:16,110 INFO org.apache.hadoop.hbase.HRegion: starting compaction on region webdata,com.technorati/tag/potiron:http,1200430256772 2008-01-15 14:52:16,111 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1515921105/size 2008-01-15 14:52:16,112 DEBUG org.apache.hadoop.hbase.HRegion: Started memcache flush for region webdata,,1200430256769. Size 12.6m 2008-01-15 14:52:16,406 DEBUG org.apache.hadoop.hbase.HStore: Added 674087192/size/5554051404058659756 with 1726 entries, sequence id 1651277, and size 95.9k for 674087192/size 2008-01-15 14:52:16,655 DEBUG org.apache.hadoop.hbase.HStore: Added 674087192/rank_total/8484028049795336423 with 0 entries, sequence id 1651277, and size 110.0 for 674087192/rank_total 2008-01-15 14:52:16,824 DEBUG org.apache.hadoop.hbase.HStore: Added 674087192/first_seen/3450375952989416007 with 0 entries, sequence id 1651277, and size 110.0 for 674087192/first_seen 2008-01-15 14:52:17,081 INFO org.apache.hadoop.hbase.HRegionServer: Rolling hlog. Number of entries: 250010 2008-01-15 14:52:18,963 DEBUG org.apache.hadoop.hbase.HStore: Added 674087192/anchor/8372509725324475028 with 39578 entries, sequence id 1651277, and size 4.7m for 674087192/anchor 2008-01-15 14:52:19,051 DEBUG org.apache.hadoop.hbase.HStore: moving 1515921105/size/8306075260595610659 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1515921105/size/8970708446008922282 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1515921105/size 2008-01-15 14:52:19,168 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1515921105/rank_total 2008-01-15 14:52:19,606 DEBUG org.apache.hadoop.hbase.HStore: moving 1515921105/rank_total/902130235082219279 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1515921105/rank_total/2518853072405565799 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1515921105/rank_total 2008-01-15 14:52:19,786 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1515921105/first_seen 2008-01-15 14:52:20,320 DEBUG org.apache.hadoop.hbase.HStore: moving 1515921105/first_seen/322502560618608226 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1515921105/first_seen/7730277264846046728 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1515921105/first_seen 2008-01-15 14:52:20,449 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1515921105/anchor 2008-01-15 14:52:20,455 DEBUG org.apache.hadoop.hbase.HStore: Added 674087192/last_seen/3128525983325684825 with 39578 entries, sequence id 1651277, and size 4.7m for 674087192/last_seen 2008-01-15 14:52:20,712 DEBUG org.apache.hadoop.hbase.HStore: Added 674087192/source/5622454906733142449 with 0 entries, sequence id 1651277, and size 110.0 for 674087192/source 2008-01-15 14:52:20,975 DEBUG org.apache.hadoop.hbase.HStore: Added 674087192/stime/6508748769264839814 with 1726 entries, sequence id 1651277, and size 107.3k for 674087192/stime 2008-01-15 14:52:22,766 DEBUG org.apache.hadoop.hbase.HStore: Added 674087192/in_rank/2217024406710479477 with 39578 entries, sequence id 1651277, and size 4.8m for 674087192/in_rank 2008-01-15 14:52:23,033 DEBUG org.apache.hadoop.hbase.HStore: Added 674087192/rank_visual/8568855648166366687 with 0 entries, sequence id 1651277, and size 110.0 for 674087192/rank_visual 2008-01-15 14:52:23,034 DEBUG org.apache.hadoop.hbase.HRegion: Finished memcache flush for region webdata,,1200430256769 in 6923ms, sequenceid=1651277 2008-01-15 14:52:24,725 DEBUG org.apache.hadoop.hbase.HLog: Closing current log writer hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.4_1200429714191_60020/hlog.dat.000 to get a new one 2008-01-15 14:52:24,732 INFO org.apache.hadoop.hbase.HLog: new log writer created at hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.4_1200429714191_60020/hlog.dat.001 2008-01-15 14:52:24,734 DEBUG org.apache.hadoop.hbase.HLog: Found 0 logs to remove using oldest outstanding seqnum of 1651250 from region webdata,com.technorati/tag/potiron:http,1200430256772 2008-01-15 14:52:31,201 DEBUG org.apache.hadoop.hbase.HStore: moving 1515921105/anchor/101844797008193856 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1515921105/anchor/8434060185797232189 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1515921105/anchor 2008-01-15 14:52:31,330 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1515921105/last_seen 2008-01-15 14:52:42,406 DEBUG org.apache.hadoop.hbase.HStore: moving 1515921105/last_seen/170416630495691918 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1515921105/last_seen/3753855671475939483 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1515921105/last_seen 2008-01-15 14:52:42,531 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1515921105/source 2008-01-15 14:52:42,813 DEBUG org.apache.hadoop.hbase.HStore: moving 1515921105/source/8592788349601853769 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1515921105/source/6066722165330486151 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1515921105/source 2008-01-15 14:52:43,045 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1515921105/stime 2008-01-15 14:52:44,049 DEBUG org.apache.hadoop.hbase.HStore: moving 1515921105/stime/2657882662716551649 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1515921105/stime/2941808113474666469 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1515921105/stime 2008-01-15 14:52:44,107 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1515921105/in_rank 2008-01-15 14:52:55,488 DEBUG org.apache.hadoop.hbase.HStore: moving 1515921105/in_rank/540269286895623344 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1515921105/in_rank/9019184839191348597 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1515921105/in_rank 2008-01-15 14:52:55,586 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1515921105/rank_visual 2008-01-15 14:52:55,866 DEBUG org.apache.hadoop.hbase.HStore: moving 1515921105/rank_visual/4211306568646143337 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1515921105/rank_visual/8443248497314160630 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1515921105/rank_visual 2008-01-15 14:52:55,978 INFO org.apache.hadoop.hbase.HRegion: compaction completed on region webdata,com.technorati/tag/potiron:http,1200430256772. Took 39sec 2008-01-15 14:52:55,979 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 674087192/size needed. 2008-01-15 14:52:55,979 DEBUG org.apache.hadoop.hbase.HRegion: 674087192/size needs compaction 2008-01-15 14:52:55,979 INFO org.apache.hadoop.hbase.HRegion: starting compaction on region webdata,,1200430256769 2008-01-15 14:52:55,980 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 674087192/size 2008-01-15 14:52:56,116 INFO org.apache.hadoop.hbase.HRegion: Splitting webdata,com.technorati/tag/potiron:http,1200430256772 because largest aggregate size is 25.0m and desired size is 16.0m 2008-01-15 14:52:56,198 DEBUG org.apache.hadoop.hbase.HRegion: compactions and cache flushes disabled for region webdata,com.technorati/tag/potiron:http,1200430256772 2008-01-15 14:52:56,199 DEBUG org.apache.hadoop.hbase.HRegion: new updates and scanners for region webdata,com.technorati/tag/potiron:http,1200430256772 disabled 2008-01-15 14:52:56,199 DEBUG org.apache.hadoop.hbase.HRegion: no more active scanners for region webdata,com.technorati/tag/potiron:http,1200430256772 2008-01-15 14:52:56,199 DEBUG org.apache.hadoop.hbase.HRegion: no more write locks outstanding on region webdata,com.technorati/tag/potiron:http,1200430256772 2008-01-15 14:52:56,200 DEBUG org.apache.hadoop.hbase.HRegionServer: webdata,com.technorati/tag/potiron:http,1200430256772 closing (Adding to retiringRegions) 2008-01-15 14:52:56,200 DEBUG org.apache.hadoop.hbase.HRegion: Started memcache flush for region webdata,com.technorati/tag/potiron:http,1200430256772. Size 7.7m 2008-01-15 14:52:56,209 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1 on 60020, call batchUpdate(webdata,com.technorati/tag/potiron:http,1200430256772, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@322bce) from 10.0.0.2:35791: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:52:56,218 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 60020, call batchUpdate(webdata,com.technorati/tag/potiron:http,1200430256772, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1f0aecc) from 10.0.0.1:58656: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:52:56,219 INFO org.apache.hadoop.ipc.Server: IPC Server handler 8 on 60020, call batchUpdate(webdata,com.technorati/tag/potiron:http,1200430256772, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@64023c) from 10.0.0.3:60554: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:52:56,221 INFO org.apache.hadoop.ipc.Server: IPC Server handler 4 on 60020, call batchUpdate(webdata,com.technorati/tag/potiron:http,1200430256772, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1cebc9f) from 10.0.0.4:39669: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:52:56,221 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 60020, call batchUpdate(webdata,com.technorati/tag/potiron:http,1200430256772, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1c1ac46) from 10.0.0.2:35791: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:52:56,228 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1 on 60020, call batchUpdate(webdata,com.technorati/tag/potiron:http,1200430256772, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1342a67) from 10.0.0.4:39669: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:52:56,227 INFO org.apache.hadoop.ipc.Server: IPC Server handler 0 on 60020, call batchUpdate(webdata,com.technorati/tag/potiron:http,1200430256772, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1557c0) from 10.0.0.3:60554: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:52:56,276 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1 on 60020, call batchUpdate(webdata,com.technorati/tag/potiron:http,1200430256772, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1cbda0a) from 10.0.0.1:58656: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:52:56,303 INFO org.apache.hadoop.ipc.Server: IPC Server handler 5 on 60020, call batchUpdate(webdata,com.technorati/tag/potiron:http,1200430256772, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@57ea52) from 10.0.0.2:35791: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:52:56,341 INFO org.apache.hadoop.ipc.Server: IPC Server handler 5 on 60020, call batchUpdate(webdata,com.technorati/tag/potiron:http,1200430256772, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1d8d39f) from 10.0.0.4:39669: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:52:56,359 INFO org.apache.hadoop.ipc.Server: IPC Server handler 2 on 60020, call batchUpdate(webdata,com.technorati/tag/potiron:http,1200430256772, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@2d95b3) from 10.0.0.2:35791: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:52:56,378 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1 on 60020, call batchUpdate(webdata,com.technorati/tag/potiron:http,1200430256772, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@bf5555) from 10.0.0.3:60554: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:52:56,416 DEBUG org.apache.hadoop.hbase.HStore: Added 1515921105/size/7755773979423753850 with 1272 entries, sequence id 1804607, and size 70.1k for 1515921105/size 2008-01-15 14:52:56,417 INFO org.apache.hadoop.ipc.Server: IPC Server handler 6 on 60020, call batchUpdate(webdata,com.technorati/tag/potiron:http,1200430256772, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@17b4703) from 10.0.0.4:39669: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:52:56,481 INFO org.apache.hadoop.ipc.Server: IPC Server handler 2 on 60020, call batchUpdate(webdata,com.technorati/tag/potiron:http,1200430256772, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@73305c) from 10.0.0.1:58656: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:52:56,531 DEBUG org.apache.hadoop.hbase.HStore: Added 1515921105/rank_total/6532249503378101204 with 0 entries, sequence id 1804607, and size 110.0 for 1515921105/rank_total 2008-01-15 14:52:56,557 DEBUG org.apache.hadoop.hbase.HStore: moving 674087192/size/2130923167972909226 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 674087192/size/4212641526049142996 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 674087192/size 2008-01-15 14:52:56,648 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 674087192/rank_total 2008-01-15 14:52:56,650 DEBUG org.apache.hadoop.hbase.HStore: Added 1515921105/first_seen/7152963414691705905 with 0 entries, sequence id 1804607, and size 110.0 for 1515921105/first_seen 2008-01-15 14:52:56,654 INFO org.apache.hadoop.ipc.Server: IPC Server handler 4 on 60020, call batchUpdate(webdata,com.technorati/tag/potiron:http,1200430256772, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@6c1a82) from 10.0.0.1:58656: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:52:56,776 DEBUG org.apache.hadoop.hbase.HStore: moving 674087192/rank_total/5243492196587667964 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 674087192/rank_total/5117979151043469519 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 674087192/rank_total 2008-01-15 14:52:56,820 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 674087192/first_seen 2008-01-15 14:52:56,922 DEBUG org.apache.hadoop.hbase.HStore: moving 674087192/first_seen/7421266512058498332 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 674087192/first_seen/7179161036076096367 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 674087192/first_seen 2008-01-15 14:52:56,977 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 674087192/anchor 2008-01-15 14:52:57,197 DEBUG org.apache.hadoop.hbase.HStore: Added 1515921105/anchor/7301496333177606663 with 24378 entries, sequence id 1804607, and size 2.9m for 1515921105/anchor 2008-01-15 14:52:57,245 INFO org.apache.hadoop.ipc.Server: IPC Server handler 2 on 60020, call batchUpdate(webdata,com.technorati/tag/potiron:http,1200430256772, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1408a92) from 10.0.0.3:60554: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:52:57,761 DEBUG org.apache.hadoop.hbase.HStore: Added 1515921105/last_seen/3787130042197173840 with 24378 entries, sequence id 1804607, and size 2.9m for 1515921105/last_seen 2008-01-15 14:52:57,822 DEBUG org.apache.hadoop.hbase.HStore: Added 1515921105/source/8159532514831951801 with 0 entries, sequence id 1804607, and size 110.0 for 1515921105/source 2008-01-15 14:52:57,906 DEBUG org.apache.hadoop.hbase.HStore: Added 1515921105/stime/5825876125056636910 with 1272 entries, sequence id 1804607, and size 78.7k for 1515921105/stime 2008-01-15 14:52:58,418 DEBUG org.apache.hadoop.hbase.HStore: Added 1515921105/in_rank/2356831793228550652 with 24378 entries, sequence id 1804607, and size 3.0m for 1515921105/in_rank 2008-01-15 14:52:58,485 DEBUG org.apache.hadoop.hbase.HStore: Added 1515921105/rank_visual/6859524930149453090 with 0 entries, sequence id 1804607, and size 110.0 for 1515921105/rank_visual 2008-01-15 14:52:58,485 DEBUG org.apache.hadoop.hbase.HRegion: Finished memcache flush for region webdata,com.technorati/tag/potiron:http,1200430256772 in 2285ms, sequenceid=1804607 2008-01-15 14:52:58,485 DEBUG org.apache.hadoop.hbase.HStore: closed 1515921105/size 2008-01-15 14:52:58,486 DEBUG org.apache.hadoop.hbase.HStore: closed 1515921105/rank_total 2008-01-15 14:52:58,486 DEBUG org.apache.hadoop.hbase.HStore: closed 1515921105/first_seen 2008-01-15 14:52:58,487 DEBUG org.apache.hadoop.hbase.HStore: closed 1515921105/anchor 2008-01-15 14:52:58,489 DEBUG org.apache.hadoop.hbase.HStore: closed 1515921105/last_seen 2008-01-15 14:52:58,489 DEBUG org.apache.hadoop.hbase.HStore: closed 1515921105/source 2008-01-15 14:52:58,489 DEBUG org.apache.hadoop.hbase.HStore: closed 1515921105/stime 2008-01-15 14:52:58,491 DEBUG org.apache.hadoop.hbase.HStore: closed 1515921105/in_rank 2008-01-15 14:52:58,492 DEBUG org.apache.hadoop.hbase.HStore: closed 1515921105/rank_visual 2008-01-15 14:52:58,492 DEBUG org.apache.hadoop.hbase.HRegionServer: webdata,com.technorati/tag/potiron:http,1200430256772 closed 2008-01-15 14:52:58,493 INFO org.apache.hadoop.hbase.HRegion: closed webdata,com.technorati/tag/potiron:http,1200430256772 2008-01-15 14:52:58,493 DEBUG org.apache.hadoop.hbase.HRegionServer: webdata,com.technorati/tag/potiron:http,1200430256772 closed 2008-01-15 14:53:00,003 DEBUG org.apache.hadoop.hbase.HStore: starting 1438658724/anchor (no reconstruction log) 2008-01-15 14:53:00,003 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/anchor/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/anchor/mapfiles 2008-01-15 14:53:00,031 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1438658724/anchor is 1804607 2008-01-15 14:53:00,053 DEBUG org.apache.hadoop.hbase.HStore: starting 1438658724/first_seen (no reconstruction log) 2008-01-15 14:53:00,054 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/first_seen/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/first_seen/mapfiles 2008-01-15 14:53:00,080 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1438658724/first_seen is 1804607 2008-01-15 14:53:00,105 DEBUG org.apache.hadoop.hbase.HStore: starting 1438658724/in_rank (no reconstruction log) 2008-01-15 14:53:00,106 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/in_rank/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/in_rank/mapfiles 2008-01-15 14:53:00,144 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1438658724/in_rank is 1804607 2008-01-15 14:53:00,166 DEBUG org.apache.hadoop.hbase.HStore: starting 1438658724/last_seen (no reconstruction log) 2008-01-15 14:53:00,167 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/last_seen/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/last_seen/mapfiles 2008-01-15 14:53:00,194 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1438658724/last_seen is 1804607 2008-01-15 14:53:00,216 DEBUG org.apache.hadoop.hbase.HStore: starting 1438658724/rank_total (no reconstruction log) 2008-01-15 14:53:00,217 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/rank_total/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/rank_total/mapfiles 2008-01-15 14:53:00,246 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1438658724/rank_total is 1804607 2008-01-15 14:53:00,269 DEBUG org.apache.hadoop.hbase.HStore: starting 1438658724/rank_visual (no reconstruction log) 2008-01-15 14:53:00,269 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/rank_visual/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/rank_visual/mapfiles 2008-01-15 14:53:00,294 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1438658724/rank_visual is 1804607 2008-01-15 14:53:00,316 DEBUG org.apache.hadoop.hbase.HStore: starting 1438658724/size (no reconstruction log) 2008-01-15 14:53:00,316 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/size/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/size/mapfiles 2008-01-15 14:53:00,342 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1438658724/size is 1804607 2008-01-15 14:53:00,364 DEBUG org.apache.hadoop.hbase.HStore: starting 1438658724/source (no reconstruction log) 2008-01-15 14:53:00,364 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/source/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/source/mapfiles 2008-01-15 14:53:00,391 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1438658724/source is 1804607 2008-01-15 14:53:00,418 DEBUG org.apache.hadoop.hbase.HStore: starting 1438658724/stime (no reconstruction log) 2008-01-15 14:53:00,418 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/stime/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/stime/mapfiles 2008-01-15 14:53:00,447 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1438658724/stime is 1804607 2008-01-15 14:53:00,466 DEBUG org.apache.hadoop.hbase.HRegion: Next sequence id for region webdata,com.technorati/tag/potiron:http,1200430376177 is 1804608 2008-01-15 14:53:00,468 INFO org.apache.hadoop.hbase.HRegion: region webdata,com.technorati/tag/potiron:http,1200430376177 available 2008-01-15 14:53:00,468 DEBUG org.apache.hadoop.hbase.HRegion: compactions and cache flushes disabled for region webdata,com.technorati/tag/potiron:http,1200430376177 2008-01-15 14:53:00,468 DEBUG org.apache.hadoop.hbase.HRegion: new updates and scanners for region webdata,com.technorati/tag/potiron:http,1200430376177 disabled 2008-01-15 14:53:00,468 DEBUG org.apache.hadoop.hbase.HRegion: no more active scanners for region webdata,com.technorati/tag/potiron:http,1200430376177 2008-01-15 14:53:00,468 DEBUG org.apache.hadoop.hbase.HRegion: no more write locks outstanding on region webdata,com.technorati/tag/potiron:http,1200430376177 2008-01-15 14:53:00,469 DEBUG org.apache.hadoop.hbase.HStore: closed 1438658724/size 2008-01-15 14:53:00,470 DEBUG org.apache.hadoop.hbase.HStore: closed 1438658724/rank_total 2008-01-15 14:53:00,470 DEBUG org.apache.hadoop.hbase.HStore: closed 1438658724/first_seen 2008-01-15 14:53:00,471 DEBUG org.apache.hadoop.hbase.HStore: closed 1438658724/anchor 2008-01-15 14:53:00,473 DEBUG org.apache.hadoop.hbase.HStore: closed 1438658724/last_seen 2008-01-15 14:53:00,474 DEBUG org.apache.hadoop.hbase.HStore: closed 1438658724/source 2008-01-15 14:53:00,474 DEBUG org.apache.hadoop.hbase.HStore: closed 1438658724/stime 2008-01-15 14:53:00,476 DEBUG org.apache.hadoop.hbase.HStore: closed 1438658724/in_rank 2008-01-15 14:53:00,477 DEBUG org.apache.hadoop.hbase.HStore: closed 1438658724/rank_visual 2008-01-15 14:53:00,477 INFO org.apache.hadoop.hbase.HRegion: closed webdata,com.technorati/tag/potiron:http,1200430376177 2008-01-15 14:53:00,485 DEBUG org.apache.hadoop.hbase.HStore: starting 970354973/anchor (no reconstruction log) 2008-01-15 14:53:00,485 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/anchor/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/anchor/mapfiles 2008-01-15 14:53:00,513 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 970354973/anchor is 1804607 2008-01-15 14:53:00,535 DEBUG org.apache.hadoop.hbase.HStore: starting 970354973/first_seen (no reconstruction log) 2008-01-15 14:53:00,535 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/first_seen/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/first_seen/mapfiles 2008-01-15 14:53:00,561 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 970354973/first_seen is 1804607 2008-01-15 14:53:00,584 DEBUG org.apache.hadoop.hbase.HStore: starting 970354973/in_rank (no reconstruction log) 2008-01-15 14:53:00,584 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/in_rank/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/in_rank/mapfiles 2008-01-15 14:53:00,610 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 970354973/in_rank is 1804607 2008-01-15 14:53:00,641 DEBUG org.apache.hadoop.hbase.HStore: starting 970354973/last_seen (no reconstruction log) 2008-01-15 14:53:00,641 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/last_seen/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/last_seen/mapfiles 2008-01-15 14:53:00,669 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 970354973/last_seen is 1804607 2008-01-15 14:53:00,698 DEBUG org.apache.hadoop.hbase.HStore: starting 970354973/rank_total (no reconstruction log) 2008-01-15 14:53:00,698 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/rank_total/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/rank_total/mapfiles 2008-01-15 14:53:00,725 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 970354973/rank_total is 1804607 2008-01-15 14:53:00,750 DEBUG org.apache.hadoop.hbase.HStore: starting 970354973/rank_visual (no reconstruction log) 2008-01-15 14:53:00,750 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/rank_visual/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/rank_visual/mapfiles 2008-01-15 14:53:00,786 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 970354973/rank_visual is 1804607 2008-01-15 14:53:00,821 DEBUG org.apache.hadoop.hbase.HStore: starting 970354973/size (no reconstruction log) 2008-01-15 14:53:00,821 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/size/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/size/mapfiles 2008-01-15 14:53:00,873 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 970354973/size is 1804607 2008-01-15 14:53:00,895 DEBUG org.apache.hadoop.hbase.HStore: starting 970354973/source (no reconstruction log) 2008-01-15 14:53:00,895 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/source/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/source/mapfiles 2008-01-15 14:53:00,920 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 970354973/source is 1804607 2008-01-15 14:53:00,945 DEBUG org.apache.hadoop.hbase.HStore: starting 970354973/stime (no reconstruction log) 2008-01-15 14:53:00,945 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/stime/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/stime/mapfiles 2008-01-15 14:53:00,972 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 970354973/stime is 1804607 2008-01-15 14:53:00,992 DEBUG org.apache.hadoop.hbase.HRegion: Next sequence id for region webdata,net.airmotive.www/air_rides.htm:http,1200430376197 is 1804608 2008-01-15 14:53:00,994 INFO org.apache.hadoop.hbase.HRegion: region webdata,net.airmotive.www/air_rides.htm:http,1200430376197 available 2008-01-15 14:53:00,995 DEBUG org.apache.hadoop.hbase.HRegion: compactions and cache flushes disabled for region webdata,net.airmotive.www/air_rides.htm:http,1200430376197 2008-01-15 14:53:00,995 DEBUG org.apache.hadoop.hbase.HRegion: new updates and scanners for region webdata,net.airmotive.www/air_rides.htm:http,1200430376197 disabled 2008-01-15 14:53:00,995 DEBUG org.apache.hadoop.hbase.HRegion: no more active scanners for region webdata,net.airmotive.www/air_rides.htm:http,1200430376197 2008-01-15 14:53:00,995 DEBUG org.apache.hadoop.hbase.HRegion: no more write locks outstanding on region webdata,net.airmotive.www/air_rides.htm:http,1200430376197 2008-01-15 14:53:00,995 DEBUG org.apache.hadoop.hbase.HStore: closed 970354973/size 2008-01-15 14:53:00,996 DEBUG org.apache.hadoop.hbase.HStore: closed 970354973/rank_total 2008-01-15 14:53:00,996 DEBUG org.apache.hadoop.hbase.HStore: closed 970354973/first_seen 2008-01-15 14:53:00,997 DEBUG org.apache.hadoop.hbase.HStore: closed 970354973/anchor 2008-01-15 14:53:00,998 DEBUG org.apache.hadoop.hbase.HStore: closed 970354973/last_seen 2008-01-15 14:53:00,999 DEBUG org.apache.hadoop.hbase.HStore: closed 970354973/source 2008-01-15 14:53:00,999 DEBUG org.apache.hadoop.hbase.HStore: closed 970354973/stime 2008-01-15 14:53:01,000 DEBUG org.apache.hadoop.hbase.HStore: closed 970354973/in_rank 2008-01-15 14:53:01,001 DEBUG org.apache.hadoop.hbase.HStore: closed 970354973/rank_visual 2008-01-15 14:53:01,001 INFO org.apache.hadoop.hbase.HRegion: closed webdata,net.airmotive.www/air_rides.htm:http,1200430376197 2008-01-15 14:53:01,006 DEBUG org.apache.hadoop.hbase.HRegion: Cleaned up hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1515921105/splits true 2008-01-15 14:53:01,644 INFO org.apache.hadoop.hbase.HRegionServer: Updating .META. with region split info 2008-01-15 14:53:01,653 DEBUG org.apache.hadoop.hbase.HRegionServer: Reporting region split to master 2008-01-15 14:53:01,653 INFO org.apache.hadoop.hbase.HRegionServer: region split, META updated, and report to master all successful. Old region=webdata,com.technorati/tag/potiron:http,1200430256772, new regions: webdata,com.technorati/tag/potiron:http,1200430376177, webdata,net.airmotive.www/air_rides.htm:http,1200430376197. Split took 5sec 2008-01-15 14:53:04,133 DEBUG org.apache.hadoop.hbase.HStore: moving 674087192/anchor/7806631982244771003 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 674087192/anchor/2470613383471636277 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 674087192/anchor 2008-01-15 14:53:04,242 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 674087192/last_seen 2008-01-15 14:53:04,248 INFO org.apache.hadoop.hbase.HRegionServer: MSG_REGION_OPEN : webdata,com.technorati/tag/potiron:http,1200430376177 2008-01-15 14:53:04,260 DEBUG org.apache.hadoop.hbase.HStore: starting 1438658724/anchor (no reconstruction log) 2008-01-15 14:53:04,260 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/anchor/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/anchor/mapfiles 2008-01-15 14:53:04,299 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1438658724/anchor is 1804607 2008-01-15 14:53:04,323 DEBUG org.apache.hadoop.hbase.HStore: starting 1438658724/first_seen (no reconstruction log) 2008-01-15 14:53:04,324 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/first_seen/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/first_seen/mapfiles 2008-01-15 14:53:04,357 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1438658724/first_seen is 1804607 2008-01-15 14:53:04,386 DEBUG org.apache.hadoop.hbase.HStore: starting 1438658724/in_rank (no reconstruction log) 2008-01-15 14:53:04,386 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/in_rank/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/in_rank/mapfiles 2008-01-15 14:53:04,420 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1438658724/in_rank is 1804607 2008-01-15 14:53:04,444 DEBUG org.apache.hadoop.hbase.HStore: starting 1438658724/last_seen (no reconstruction log) 2008-01-15 14:53:04,444 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/last_seen/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/last_seen/mapfiles 2008-01-15 14:53:04,471 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1438658724/last_seen is 1804607 2008-01-15 14:53:04,495 DEBUG org.apache.hadoop.hbase.HStore: starting 1438658724/rank_total (no reconstruction log) 2008-01-15 14:53:04,496 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/rank_total/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/rank_total/mapfiles 2008-01-15 14:53:04,523 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1438658724/rank_total is 1804607 2008-01-15 14:53:04,548 DEBUG org.apache.hadoop.hbase.HStore: starting 1438658724/rank_visual (no reconstruction log) 2008-01-15 14:53:04,549 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/rank_visual/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/rank_visual/mapfiles 2008-01-15 14:53:04,576 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1438658724/rank_visual is 1804607 2008-01-15 14:53:04,601 DEBUG org.apache.hadoop.hbase.HStore: starting 1438658724/size (no reconstruction log) 2008-01-15 14:53:04,601 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/size/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/size/mapfiles 2008-01-15 14:53:04,628 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1438658724/size is 1804607 2008-01-15 14:53:04,650 DEBUG org.apache.hadoop.hbase.HStore: starting 1438658724/source (no reconstruction log) 2008-01-15 14:53:04,650 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/source/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/source/mapfiles 2008-01-15 14:53:04,681 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1438658724/source is 1804607 2008-01-15 14:53:04,711 DEBUG org.apache.hadoop.hbase.HStore: starting 1438658724/stime (no reconstruction log) 2008-01-15 14:53:04,711 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/stime/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1438658724/stime/mapfiles 2008-01-15 14:53:04,736 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1438658724/stime is 1804607 2008-01-15 14:53:04,755 DEBUG org.apache.hadoop.hbase.HRegion: Next sequence id for region webdata,com.technorati/tag/potiron:http,1200430376177 is 1804608 2008-01-15 14:53:04,757 INFO org.apache.hadoop.hbase.HRegion: region webdata,com.technorati/tag/potiron:http,1200430376177 available 2008-01-15 14:53:04,757 INFO org.apache.hadoop.hbase.HRegionServer: MSG_REGION_OPEN : webdata,net.airmotive.www/air_rides.htm:http,1200430376197 2008-01-15 14:53:04,760 DEBUG org.apache.hadoop.hbase.HStore: starting 970354973/anchor (no reconstruction log) 2008-01-15 14:53:04,760 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/anchor/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/anchor/mapfiles 2008-01-15 14:53:04,787 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 970354973/anchor is 1804607 2008-01-15 14:53:04,809 DEBUG org.apache.hadoop.hbase.HStore: starting 970354973/first_seen (no reconstruction log) 2008-01-15 14:53:04,809 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/first_seen/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/first_seen/mapfiles 2008-01-15 14:53:04,835 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 970354973/first_seen is 1804607 2008-01-15 14:53:04,856 DEBUG org.apache.hadoop.hbase.HStore: starting 970354973/in_rank (no reconstruction log) 2008-01-15 14:53:04,857 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/in_rank/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/in_rank/mapfiles 2008-01-15 14:53:04,882 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 970354973/in_rank is 1804607 2008-01-15 14:53:04,904 DEBUG org.apache.hadoop.hbase.HStore: starting 970354973/last_seen (no reconstruction log) 2008-01-15 14:53:04,904 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/last_seen/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/last_seen/mapfiles 2008-01-15 14:53:04,931 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 970354973/last_seen is 1804607 2008-01-15 14:53:04,954 DEBUG org.apache.hadoop.hbase.HStore: starting 970354973/rank_total (no reconstruction log) 2008-01-15 14:53:04,954 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/rank_total/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/rank_total/mapfiles 2008-01-15 14:53:04,980 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 970354973/rank_total is 1804607 2008-01-15 14:53:05,002 DEBUG org.apache.hadoop.hbase.HStore: starting 970354973/rank_visual (no reconstruction log) 2008-01-15 14:53:05,002 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/rank_visual/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/rank_visual/mapfiles 2008-01-15 14:53:05,032 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 970354973/rank_visual is 1804607 2008-01-15 14:53:05,054 DEBUG org.apache.hadoop.hbase.HStore: starting 970354973/size (no reconstruction log) 2008-01-15 14:53:05,054 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/size/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/size/mapfiles 2008-01-15 14:53:05,079 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 970354973/size is 1804607 2008-01-15 14:53:05,101 DEBUG org.apache.hadoop.hbase.HStore: starting 970354973/source (no reconstruction log) 2008-01-15 14:53:05,101 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/source/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/source/mapfiles 2008-01-15 14:53:05,126 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 970354973/source is 1804607 2008-01-15 14:53:05,148 DEBUG org.apache.hadoop.hbase.HStore: starting 970354973/stime (no reconstruction log) 2008-01-15 14:53:05,149 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/stime/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/970354973/stime/mapfiles 2008-01-15 14:53:05,174 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 970354973/stime is 1804607 2008-01-15 14:53:05,196 DEBUG org.apache.hadoop.hbase.HRegion: Next sequence id for region webdata,net.airmotive.www/air_rides.htm:http,1200430376197 is 1804608 2008-01-15 14:53:05,197 INFO org.apache.hadoop.hbase.HRegion: region webdata,net.airmotive.www/air_rides.htm:http,1200430376197 available 2008-01-15 14:53:06,250 INFO org.apache.hadoop.ipc.Server: IPC Server handler 9 on 60020, call batchUpdate(webdata,com.technorati/tag/potiron:http,1200430256772, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@257f1b) from 10.0.0.2:49338: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:53:06,275 INFO org.apache.hadoop.ipc.Server: IPC Server handler 6 on 60020, call batchUpdate(webdata,com.technorati/tag/potiron:http,1200430256772, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@bcb23e) from 10.0.0.1:33467: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:53:06,282 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1 on 60020, call batchUpdate(webdata,com.technorati/tag/potiron:http,1200430256772, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@15d616e) from 10.0.0.3:43386: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:53:06,288 INFO org.apache.hadoop.ipc.Server: IPC Server handler 4 on 60020, call batchUpdate(webdata,com.technorati/tag/potiron:http,1200430256772, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@44f787) from 10.0.0.4:42166: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 org.apache.hadoop.hbase.NotServingRegionException: webdata,com.technorati/tag/potiron:http,1200430256772 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:53:10,741 DEBUG org.apache.hadoop.hbase.HStore: moving 674087192/last_seen/2642240155618544945 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 674087192/last_seen/6344284186030863154 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 674087192/last_seen 2008-01-15 14:53:10,823 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 674087192/source 2008-01-15 14:53:10,918 DEBUG org.apache.hadoop.hbase.HStore: moving 674087192/source/8355571015650343570 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 674087192/source/1363728299587752107 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 674087192/source 2008-01-15 14:53:10,966 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 674087192/stime 2008-01-15 14:53:11,346 DEBUG org.apache.hadoop.hbase.HStore: moving 674087192/stime/3728319264560538343 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 674087192/stime/5134088396182295 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 674087192/stime 2008-01-15 14:53:11,392 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 674087192/in_rank 2008-01-15 14:53:18,584 DEBUG org.apache.hadoop.hbase.HStore: moving 674087192/in_rank/7544356699686228961 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 674087192/in_rank/4987754386994330589 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 674087192/in_rank 2008-01-15 14:53:18,664 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 674087192/rank_visual 2008-01-15 14:53:18,852 DEBUG org.apache.hadoop.hbase.HStore: moving 674087192/rank_visual/8235714658717688895 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 674087192/rank_visual/8337983569144047360 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 674087192/rank_visual 2008-01-15 14:53:18,934 INFO org.apache.hadoop.hbase.HRegion: compaction completed on region webdata,,1200430256769. Took 22sec 2008-01-15 14:53:18,968 INFO org.apache.hadoop.hbase.HRegion: Splitting webdata,,1200430256769 because largest aggregate size is 26.1m and desired size is 16.0m 2008-01-15 14:53:18,989 DEBUG org.apache.hadoop.hbase.HRegion: compactions and cache flushes disabled for region webdata,,1200430256769 2008-01-15 14:53:18,989 DEBUG org.apache.hadoop.hbase.HRegion: new updates and scanners for region webdata,,1200430256769 disabled 2008-01-15 14:53:18,989 DEBUG org.apache.hadoop.hbase.HRegion: no more active scanners for region webdata,,1200430256769 2008-01-15 14:53:18,989 DEBUG org.apache.hadoop.hbase.HRegion: no more write locks outstanding on region webdata,,1200430256769 2008-01-15 14:53:18,990 DEBUG org.apache.hadoop.hbase.HRegionServer: webdata,,1200430256769 closing (Adding to retiringRegions) 2008-01-15 14:53:18,990 DEBUG org.apache.hadoop.hbase.HRegion: Started memcache flush for region webdata,,1200430256769. Size 9.9m 2008-01-15 14:53:18,992 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 60020, call batchUpdate(webdata,,1200430256769, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@11c0d60) from 10.0.0.3:43412: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200430256769 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200430256769 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:53:18,994 INFO org.apache.hadoop.ipc.Server: IPC Server handler 8 on 60020, call batchUpdate(webdata,,1200430256769, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@b23d12) from 10.0.0.3:43412: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200430256769 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200430256769 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:53:18,995 INFO org.apache.hadoop.ipc.Server: IPC Server handler 9 on 60020, call batchUpdate(webdata,,1200430256769, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1c783c5) from 10.0.0.1:33496: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200430256769 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200430256769 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:53:18,997 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 60020, call batchUpdate(webdata,,1200430256769, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@19c0bd6) from 10.0.0.2:49354: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200430256769 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200430256769 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:53:19,000 INFO org.apache.hadoop.ipc.Server: IPC Server handler 6 on 60020, call batchUpdate(webdata,,1200430256769, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1cd280b) from 10.0.0.1:33496: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200430256769 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200430256769 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:53:19,003 INFO org.apache.hadoop.ipc.Server: IPC Server handler 4 on 60020, call batchUpdate(webdata,,1200430256769, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@29ac) from 10.0.0.4:42241: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200430256769 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200430256769 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:53:19,008 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1 on 60020, call batchUpdate(webdata,,1200430256769, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@b0095d) from 10.0.0.4:42241: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200430256769 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200430256769 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:53:19,105 DEBUG org.apache.hadoop.hbase.HStore: Added 674087192/size/6830023775489535305 with 1441 entries, sequence id 1814671, and size 79.2k for 674087192/size 2008-01-15 14:53:19,166 DEBUG org.apache.hadoop.hbase.HStore: Added 674087192/rank_total/8675777251999555093 with 0 entries, sequence id 1814671, and size 110.0 for 674087192/rank_total 2008-01-15 14:53:19,224 DEBUG org.apache.hadoop.hbase.HStore: Added 674087192/first_seen/257444988722818194 with 0 entries, sequence id 1814671, and size 110.0 for 674087192/first_seen 2008-01-15 14:53:19,746 DEBUG org.apache.hadoop.hbase.HStore: Added 674087192/anchor/2021851767839711563 with 30700 entries, sequence id 1814671, and size 3.7m for 674087192/anchor 2008-01-15 14:53:20,256 DEBUG org.apache.hadoop.hbase.HStore: Added 674087192/last_seen/830600773895656648 with 30700 entries, sequence id 1814671, and size 3.7m for 674087192/last_seen 2008-01-15 14:53:20,310 DEBUG org.apache.hadoop.hbase.HStore: Added 674087192/source/8084934407534613520 with 0 entries, sequence id 1814671, and size 110.0 for 674087192/source 2008-01-15 14:53:20,386 DEBUG org.apache.hadoop.hbase.HStore: Added 674087192/stime/7521595721553673641 with 1441 entries, sequence id 1814671, and size 88.9k for 674087192/stime 2008-01-15 14:53:20,903 DEBUG org.apache.hadoop.hbase.HStore: Added 674087192/in_rank/8598987263788197086 with 30700 entries, sequence id 1814671, and size 3.8m for 674087192/in_rank 2008-01-15 14:53:20,969 DEBUG org.apache.hadoop.hbase.HStore: Added 674087192/rank_visual/33880999144899396 with 0 entries, sequence id 1814671, and size 110.0 for 674087192/rank_visual 2008-01-15 14:53:20,969 DEBUG org.apache.hadoop.hbase.HRegion: Finished memcache flush for region webdata,,1200430256769 in 1979ms, sequenceid=1814671 2008-01-15 14:53:20,969 DEBUG org.apache.hadoop.hbase.HStore: closed 674087192/size 2008-01-15 14:53:20,970 DEBUG org.apache.hadoop.hbase.HStore: closed 674087192/rank_total 2008-01-15 14:53:20,970 DEBUG org.apache.hadoop.hbase.HStore: closed 674087192/first_seen 2008-01-15 14:53:20,971 DEBUG org.apache.hadoop.hbase.HStore: closed 674087192/anchor 2008-01-15 14:53:20,972 DEBUG org.apache.hadoop.hbase.HStore: closed 674087192/last_seen 2008-01-15 14:53:20,972 DEBUG org.apache.hadoop.hbase.HStore: closed 674087192/source 2008-01-15 14:53:20,973 DEBUG org.apache.hadoop.hbase.HStore: closed 674087192/stime 2008-01-15 14:53:20,973 DEBUG org.apache.hadoop.hbase.HStore: closed 674087192/in_rank 2008-01-15 14:53:20,974 DEBUG org.apache.hadoop.hbase.HStore: closed 674087192/rank_visual 2008-01-15 14:53:20,974 DEBUG org.apache.hadoop.hbase.HRegionServer: webdata,,1200430256769 closed 2008-01-15 14:53:20,974 INFO org.apache.hadoop.hbase.HRegion: closed webdata,,1200430256769 2008-01-15 14:53:20,974 DEBUG org.apache.hadoop.hbase.HRegionServer: webdata,,1200430256769 closed 2008-01-15 14:53:22,463 DEBUG org.apache.hadoop.hbase.HStore: starting 1411621168/anchor (no reconstruction log) 2008-01-15 14:53:22,464 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1411621168/anchor/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1411621168/anchor/mapfiles 2008-01-15 14:53:22,490 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1411621168/anchor is 1814671 2008-01-15 14:53:22,513 DEBUG org.apache.hadoop.hbase.HStore: starting 1411621168/first_seen (no reconstruction log) 2008-01-15 14:53:22,513 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1411621168/first_seen/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1411621168/first_seen/mapfiles 2008-01-15 14:53:22,539 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1411621168/first_seen is 1814671 2008-01-15 14:53:22,561 DEBUG org.apache.hadoop.hbase.HStore: starting 1411621168/in_rank (no reconstruction log) 2008-01-15 14:53:22,562 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1411621168/in_rank/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1411621168/in_rank/mapfiles 2008-01-15 14:53:22,587 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1411621168/in_rank is 1814671 2008-01-15 14:53:22,609 DEBUG org.apache.hadoop.hbase.HStore: starting 1411621168/last_seen (no reconstruction log) 2008-01-15 14:53:22,609 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1411621168/last_seen/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1411621168/last_seen/mapfiles 2008-01-15 14:53:22,635 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1411621168/last_seen is 1814671 2008-01-15 14:53:22,658 DEBUG org.apache.hadoop.hbase.HStore: starting 1411621168/rank_total (no reconstruction log) 2008-01-15 14:53:22,658 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1411621168/rank_total/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1411621168/rank_total/mapfiles 2008-01-15 14:53:22,688 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1411621168/rank_total is 1814671 2008-01-15 14:53:22,710 DEBUG org.apache.hadoop.hbase.HStore: starting 1411621168/rank_visual (no reconstruction log) 2008-01-15 14:53:22,710 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1411621168/rank_visual/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1411621168/rank_visual/mapfiles 2008-01-15 14:53:22,738 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1411621168/rank_visual is 1814671 2008-01-15 14:53:22,762 DEBUG org.apache.hadoop.hbase.HStore: starting 1411621168/size (no reconstruction log) 2008-01-15 14:53:22,762 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1411621168/size/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1411621168/size/mapfiles 2008-01-15 14:53:22,801 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1411621168/size is 1814671 2008-01-15 14:53:22,861 DEBUG org.apache.hadoop.hbase.HStore: starting 1411621168/source (no reconstruction log) 2008-01-15 14:53:22,861 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1411621168/source/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1411621168/source/mapfiles 2008-01-15 14:53:22,928 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1411621168/source is 1814671 2008-01-15 14:53:22,951 DEBUG org.apache.hadoop.hbase.HStore: starting 1411621168/stime (no reconstruction log) 2008-01-15 14:53:22,951 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1411621168/stime/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1411621168/stime/mapfiles 2008-01-15 14:53:22,988 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 1411621168/stime is 1814671 2008-01-15 14:53:23,016 DEBUG org.apache.hadoop.hbase.HRegion: Next sequence id for region webdata,,1200430398982 is 1814672 2008-01-15 14:53:23,018 INFO org.apache.hadoop.hbase.HRegion: region webdata,,1200430398982 available 2008-01-15 14:53:23,019 DEBUG org.apache.hadoop.hbase.HRegion: compactions and cache flushes disabled for region webdata,,1200430398982 2008-01-15 14:53:23,019 DEBUG org.apache.hadoop.hbase.HRegion: new updates and scanners for region webdata,,1200430398982 disabled 2008-01-15 14:53:23,019 DEBUG org.apache.hadoop.hbase.HRegion: no more active scanners for region webdata,,1200430398982 2008-01-15 14:53:23,019 DEBUG org.apache.hadoop.hbase.HRegion: no more write locks outstanding on region webdata,,1200430398982 2008-01-15 14:53:23,020 DEBUG org.apache.hadoop.hbase.HStore: closed 1411621168/size 2008-01-15 14:53:23,020 DEBUG org.apache.hadoop.hbase.HStore: closed 1411621168/rank_total 2008-01-15 14:53:23,021 DEBUG org.apache.hadoop.hbase.HStore: closed 1411621168/first_seen 2008-01-15 14:53:23,021 DEBUG org.apache.hadoop.hbase.HStore: closed 1411621168/anchor 2008-01-15 14:53:23,022 DEBUG org.apache.hadoop.hbase.HStore: closed 1411621168/last_seen 2008-01-15 14:53:23,022 DEBUG org.apache.hadoop.hbase.HStore: closed 1411621168/source 2008-01-15 14:53:23,023 DEBUG org.apache.hadoop.hbase.HStore: closed 1411621168/stime 2008-01-15 14:53:23,026 DEBUG org.apache.hadoop.hbase.HStore: closed 1411621168/in_rank 2008-01-15 14:53:23,027 DEBUG org.apache.hadoop.hbase.HStore: closed 1411621168/rank_visual 2008-01-15 14:53:23,027 INFO org.apache.hadoop.hbase.HRegion: closed webdata,,1200430398982 2008-01-15 14:53:23,036 DEBUG org.apache.hadoop.hbase.HStore: starting 773939572/anchor (no reconstruction log) 2008-01-15 14:53:23,036 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/773939572/anchor/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/773939572/anchor/mapfiles 2008-01-15 14:53:23,077 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 773939572/anchor is 1814671 2008-01-15 14:53:23,107 DEBUG org.apache.hadoop.hbase.HStore: starting 773939572/first_seen (no reconstruction log) 2008-01-15 14:53:23,107 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/773939572/first_seen/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/773939572/first_seen/mapfiles 2008-01-15 14:53:23,145 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 773939572/first_seen is 1814671 2008-01-15 14:53:23,176 DEBUG org.apache.hadoop.hbase.HStore: starting 773939572/in_rank (no reconstruction log) 2008-01-15 14:53:23,176 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/773939572/in_rank/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/773939572/in_rank/mapfiles 2008-01-15 14:53:23,208 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 773939572/in_rank is 1814671 2008-01-15 14:53:23,238 DEBUG org.apache.hadoop.hbase.HStore: starting 773939572/last_seen (no reconstruction log) 2008-01-15 14:53:23,239 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/773939572/last_seen/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/773939572/last_seen/mapfiles 2008-01-15 14:53:23,285 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 773939572/last_seen is 1814671 2008-01-15 14:53:23,322 DEBUG org.apache.hadoop.hbase.HStore: starting 773939572/rank_total (no reconstruction log) 2008-01-15 14:53:23,322 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/773939572/rank_total/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/773939572/rank_total/mapfiles 2008-01-15 14:53:23,362 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 773939572/rank_total is 1814671 2008-01-15 14:53:23,384 DEBUG org.apache.hadoop.hbase.HStore: starting 773939572/rank_visual (no reconstruction log) 2008-01-15 14:53:23,384 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/773939572/rank_visual/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/773939572/rank_visual/mapfiles 2008-01-15 14:53:23,409 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 773939572/rank_visual is 1814671 2008-01-15 14:53:23,431 DEBUG org.apache.hadoop.hbase.HStore: starting 773939572/size (no reconstruction log) 2008-01-15 14:53:23,431 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/773939572/size/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/773939572/size/mapfiles 2008-01-15 14:53:23,456 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 773939572/size is 1814671 2008-01-15 14:53:23,479 DEBUG org.apache.hadoop.hbase.HStore: starting 773939572/source (no reconstruction log) 2008-01-15 14:53:23,479 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/773939572/source/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/773939572/source/mapfiles 2008-01-15 14:53:23,504 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 773939572/source is 1814671 2008-01-15 14:53:23,527 DEBUG org.apache.hadoop.hbase.HStore: starting 773939572/stime (no reconstruction log) 2008-01-15 14:53:23,527 DEBUG org.apache.hadoop.hbase.HStore: infodir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/773939572/stime/info mapdir: hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/773939572/stime/mapfiles 2008-01-15 14:53:23,553 DEBUG org.apache.hadoop.hbase.HStore: maximum sequence id for hstore 773939572/stime is 1814671 2008-01-15 14:53:23,583 DEBUG org.apache.hadoop.hbase.HRegion: Next sequence id for region webdata,com.animetique.www/blogcate.asp?cate=6:http,1200430398986 is 1814672 2008-01-15 14:53:23,585 INFO org.apache.hadoop.hbase.HRegion: region webdata,com.animetique.www/blogcate.asp?cate=6:http,1200430398986 available 2008-01-15 14:53:23,585 DEBUG org.apache.hadoop.hbase.HRegion: compactions and cache flushes disabled for region webdata,com.animetique.www/blogcate.asp?cate=6:http,1200430398986 2008-01-15 14:53:23,585 DEBUG org.apache.hadoop.hbase.HRegion: new updates and scanners for region webdata,com.animetique.www/blogcate.asp?cate=6:http,1200430398986 disabled 2008-01-15 14:53:23,585 DEBUG org.apache.hadoop.hbase.HRegion: no more active scanners for region webdata,com.animetique.www/blogcate.asp?cate=6:http,1200430398986 2008-01-15 14:53:23,585 DEBUG org.apache.hadoop.hbase.HRegion: no more write locks outstanding on region webdata,com.animetique.www/blogcate.asp?cate=6:http,1200430398986 2008-01-15 14:53:23,586 DEBUG org.apache.hadoop.hbase.HStore: closed 773939572/size 2008-01-15 14:53:23,586 DEBUG org.apache.hadoop.hbase.HStore: closed 773939572/rank_total 2008-01-15 14:53:23,587 DEBUG org.apache.hadoop.hbase.HStore: closed 773939572/first_seen 2008-01-15 14:53:23,587 DEBUG org.apache.hadoop.hbase.HStore: closed 773939572/anchor 2008-01-15 14:53:23,589 DEBUG org.apache.hadoop.hbase.HStore: closed 773939572/last_seen 2008-01-15 14:53:23,590 DEBUG org.apache.hadoop.hbase.HStore: closed 773939572/source 2008-01-15 14:53:23,591 DEBUG org.apache.hadoop.hbase.HStore: closed 773939572/stime 2008-01-15 14:53:23,591 DEBUG org.apache.hadoop.hbase.HStore: closed 773939572/in_rank 2008-01-15 14:53:23,592 DEBUG org.apache.hadoop.hbase.HStore: closed 773939572/rank_visual 2008-01-15 14:53:23,592 INFO org.apache.hadoop.hbase.HRegion: closed webdata,com.animetique.www/blogcate.asp?cate=6:http,1200430398986 2008-01-15 14:53:23,597 DEBUG org.apache.hadoop.hbase.HRegion: Cleaned up hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/674087192/splits true 2008-01-15 14:53:23,597 INFO org.apache.hadoop.hbase.HRegionServer: Updating .META. with region split info 2008-01-15 14:53:23,606 DEBUG org.apache.hadoop.hbase.HRegionServer: Reporting region split to master 2008-01-15 14:53:23,607 INFO org.apache.hadoop.hbase.HRegionServer: region split, META updated, and report to master all successful. Old region=webdata,,1200430256769, new regions: webdata,,1200430398982, webdata,com.animetique.www/blogcate.asp?cate=6:http,1200430398986. Split took 4sec 2008-01-15 14:53:39,086 INFO org.apache.hadoop.ipc.Server: IPC Server handler 4 on 60020, call batchUpdate(webdata,,1200430256769, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@1e1962d) from 10.0.0.2:50444: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200430256769 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200430256769 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:53:39,128 INFO org.apache.hadoop.ipc.Server: IPC Server handler 4 on 60020, call batchUpdate(webdata,,1200430256769, 9223372036854775807, org.apache.hadoop.hbase.io.BatchUpdate@e3570c) from 10.0.0.3:44366: error: org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200430256769 org.apache.hadoop.hbase.NotServingRegionException: webdata,,1200430256769 at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1674) at org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1646) at org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1495) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) 2008-01-15 14:54:04,759 DEBUG org.apache.hadoop.hbase.HRegion: Started memcache flush for region webdata,com.technorati/tag/potiron:http,1200430376177. Size 3.3m 2008-01-15 14:54:05,025 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/size/6412996654330128182 with 550 entries, sequence id 1871494, and size 30.7k for 1438658724/size 2008-01-15 14:54:05,147 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/rank_total/5553993868760697430 with 0 entries, sequence id 1871494, and size 110.0 for 1438658724/rank_total 2008-01-15 14:54:05,281 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/first_seen/492094796992802921 with 0 entries, sequence id 1871494, and size 110.0 for 1438658724/first_seen 2008-01-15 14:54:05,720 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/anchor/2472048381681129597 with 10409 entries, sequence id 1871494, and size 1.2m for 1438658724/anchor 2008-01-15 14:54:06,229 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/last_seen/8461695438694720149 with 10409 entries, sequence id 1871494, and size 1.2m for 1438658724/last_seen 2008-01-15 14:54:06,379 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/source/4985035311451131362 with 0 entries, sequence id 1871494, and size 110.0 for 1438658724/source 2008-01-15 14:54:06,685 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/stime/6114693803063844319 with 550 entries, sequence id 1871494, and size 34.4k for 1438658724/stime 2008-01-15 14:54:07,050 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/in_rank/7007327077376916964 with 10409 entries, sequence id 1871494, and size 1.3m for 1438658724/in_rank 2008-01-15 14:54:07,606 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/rank_visual/3758519342874707102 with 0 entries, sequence id 1871494, and size 110.0 for 1438658724/rank_visual 2008-01-15 14:54:07,606 DEBUG org.apache.hadoop.hbase.HRegion: Finished memcache flush for region webdata,com.technorati/tag/potiron:http,1200430376177 in 2847ms, sequenceid=1871494 2008-01-15 14:54:07,607 DEBUG org.apache.hadoop.hbase.HRegion: Started memcache flush for region webdata,net.airmotive.www/air_rides.htm:http,1200430376197. Size 3.0m 2008-01-15 14:54:07,609 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1438658724/size needed. 2008-01-15 14:54:07,611 DEBUG org.apache.hadoop.hbase.HRegion: 1438658724/size needs compaction 2008-01-15 14:54:07,612 INFO org.apache.hadoop.hbase.HRegion: starting compaction on region webdata,com.technorati/tag/potiron:http,1200430376177 2008-01-15 14:54:07,612 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1438658724/size 2008-01-15 14:54:07,837 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/size/5294551648295506861 with 407 entries, sequence id 1877573, and size 22.0k for 970354973/size 2008-01-15 14:54:08,014 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/rank_total/1575610884102099360 with 0 entries, sequence id 1877573, and size 110.0 for 970354973/rank_total 2008-01-15 14:54:08,206 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/first_seen/1409533276610174660 with 0 entries, sequence id 1877573, and size 110.0 for 970354973/first_seen 2008-01-15 14:54:08,387 DEBUG org.apache.hadoop.hbase.HStore: moving 1438658724/size/6597613693306299165 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1438658724/size/1388667424736629992 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1438658724/size 2008-01-15 14:54:08,536 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1438658724/rank_total 2008-01-15 14:54:08,668 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/anchor/3846233708607915933 with 9995 entries, sequence id 1877573, and size 1.1m for 970354973/anchor 2008-01-15 14:54:08,771 DEBUG org.apache.hadoop.hbase.HStore: moving 1438658724/rank_total/7097773731432298715 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1438658724/rank_total/845778897928453861 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1438658724/rank_total 2008-01-15 14:54:08,876 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1438658724/first_seen 2008-01-15 14:54:09,098 DEBUG org.apache.hadoop.hbase.HStore: moving 1438658724/first_seen/305068282380648336 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1438658724/first_seen/2335638589316248453 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1438658724/first_seen 2008-01-15 14:54:09,160 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/last_seen/5372474392119622911 with 9995 entries, sequence id 1877573, and size 1.1m for 970354973/last_seen 2008-01-15 14:54:09,226 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1438658724/anchor 2008-01-15 14:54:09,398 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/source/5565932793962983159 with 0 entries, sequence id 1877573, and size 110.0 for 970354973/source 2008-01-15 14:54:09,761 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/stime/5824941590958681125 with 407 entries, sequence id 1877573, and size 24.7k for 970354973/stime 2008-01-15 14:54:10,188 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/in_rank/2246968594153751583 with 9995 entries, sequence id 1877573, and size 1.2m for 970354973/in_rank 2008-01-15 14:54:10,404 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/rank_visual/549716445256495523 with 0 entries, sequence id 1877573, and size 110.0 for 970354973/rank_visual 2008-01-15 14:54:10,405 DEBUG org.apache.hadoop.hbase.HRegion: Finished memcache flush for region webdata,net.airmotive.www/air_rides.htm:http,1200430376197 in 2798ms, sequenceid=1877573 2008-01-15 14:54:15,829 DEBUG org.apache.hadoop.hbase.HStore: moving 1438658724/anchor/7888780736785264532 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1438658724/anchor/458646085887371527 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1438658724/anchor 2008-01-15 14:54:15,959 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1438658724/last_seen 2008-01-15 14:54:23,699 DEBUG org.apache.hadoop.hbase.HStore: moving 1438658724/last_seen/623793001322521871 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1438658724/last_seen/1167337783469170203 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1438658724/last_seen 2008-01-15 14:54:23,774 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1438658724/source 2008-01-15 14:54:23,987 DEBUG org.apache.hadoop.hbase.HStore: moving 1438658724/source/8883156779740182117 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1438658724/source/2212664621251765185 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1438658724/source 2008-01-15 14:54:24,074 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1438658724/stime 2008-01-15 14:54:24,678 DEBUG org.apache.hadoop.hbase.HStore: moving 1438658724/stime/4943654565262880613 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1438658724/stime/6888204399642428762 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1438658724/stime 2008-01-15 14:54:24,761 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1438658724/in_rank 2008-01-15 14:54:26,993 INFO org.apache.hadoop.hbase.HRegionServer: Rolling hlog. Number of entries: 250001 2008-01-15 14:54:29,702 DEBUG org.apache.hadoop.hbase.HLog: Closing current log writer hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.4_1200429714191_60020/hlog.dat.001 to get a new one 2008-01-15 14:54:29,720 INFO org.apache.hadoop.hbase.HLog: new log writer created at hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.4_1200429714191_60020/hlog.dat.002 2008-01-15 14:54:29,721 DEBUG org.apache.hadoop.hbase.HLog: Found 1 logs to remove using oldest outstanding seqnum of 1877555 from region webdata,com.technorati/tag/potiron:http,1200430376177 2008-01-15 14:54:29,721 INFO org.apache.hadoop.hbase.HLog: removing old log file hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.4_1200429714191_60020/hlog.dat.000 whose highest sequence/edit id is 1673763 2008-01-15 14:54:29,837 DEBUG org.apache.hadoop.hbase.HStore: moving 1438658724/in_rank/5770308147044451179 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1438658724/in_rank/8185231014316432928 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1438658724/in_rank 2008-01-15 14:54:29,935 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1438658724/rank_visual 2008-01-15 14:54:30,143 DEBUG org.apache.hadoop.hbase.HStore: moving 1438658724/rank_visual/1243497964155726905 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1438658724/rank_visual/3257953831123709578 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1438658724/rank_visual 2008-01-15 14:54:30,229 INFO org.apache.hadoop.hbase.HRegion: compaction completed on region webdata,com.technorati/tag/potiron:http,1200430376177. Took 22sec 2008-01-15 14:54:30,229 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 970354973/size needed. 2008-01-15 14:54:30,229 DEBUG org.apache.hadoop.hbase.HRegion: 970354973/size needs compaction 2008-01-15 14:54:30,230 INFO org.apache.hadoop.hbase.HRegion: starting compaction on region webdata,net.airmotive.www/air_rides.htm:http,1200430376197 2008-01-15 14:54:30,230 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 970354973/size 2008-01-15 14:54:30,737 DEBUG org.apache.hadoop.hbase.HStore: moving 970354973/size/2194866390471433953 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 970354973/size/3106412900255151193 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 970354973/size 2008-01-15 14:54:30,835 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 970354973/rank_total 2008-01-15 14:54:31,028 DEBUG org.apache.hadoop.hbase.HStore: moving 970354973/rank_total/711390705867843335 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 970354973/rank_total/2757646062087234343 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 970354973/rank_total 2008-01-15 14:54:31,118 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 970354973/first_seen 2008-01-15 14:54:31,325 DEBUG org.apache.hadoop.hbase.HStore: moving 970354973/first_seen/79320661681304855 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 970354973/first_seen/7040196060879914666 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 970354973/first_seen 2008-01-15 14:54:31,432 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 970354973/anchor 2008-01-15 14:54:36,338 ERROR org.apache.hadoop.hbase.HRegionServer: Compaction failed for region webdata,net.airmotive.www/air_rides.htm:http,1200430376197 org.apache.hadoop.dfs.LeaseExpiredException: org.apache.hadoop.dfs.LeaseExpiredException: No lease on /gfs_storage/hadoop-root/hbase/webdata/compaction.dir/970354973/anchor/mapfiles/1853109474951840018/data at org.apache.hadoop.dfs.FSNamesystem.checkLease(FSNamesystem.java:1123) at org.apache.hadoop.dfs.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1061) at org.apache.hadoop.dfs.NameNode.addBlock(NameNode.java:303) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:494) at org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:82) at org.apache.hadoop.hbase.RemoteExceptionHandler.checkIOException(RemoteExceptionHandler.java:48) at org.apache.hadoop.hbase.HRegionServer$Compactor.run(HRegionServer.java:418) 2008-01-15 14:55:07,608 DEBUG org.apache.hadoop.hbase.HRegion: Started memcache flush for region webdata,com.technorati/tag/potiron:http,1200430376177. Size 6.6m 2008-01-15 14:55:08,190 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/size/2062684922835033660 with 1143 entries, sequence id 2000423, and size 63.0k for 1438658724/size 2008-01-15 14:55:08,348 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/rank_total/8396614958624524470 with 0 entries, sequence id 2000423, and size 110.0 for 1438658724/rank_total 2008-01-15 14:55:08,487 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/first_seen/3246873245467263271 with 0 entries, sequence id 2000423, and size 110.0 for 1438658724/first_seen 2008-01-15 14:55:09,458 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/anchor/7356320329139163838 with 20753 entries, sequence id 2000423, and size 2.5m for 1438658724/anchor 2008-01-15 14:55:10,345 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/last_seen/1990478508033466392 with 20753 entries, sequence id 2000423, and size 2.4m for 1438658724/last_seen 2008-01-15 14:55:10,526 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/source/7088221338493527403 with 0 entries, sequence id 2000423, and size 110.0 for 1438658724/source 2008-01-15 14:55:10,883 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/stime/6846784853805591953 with 1143 entries, sequence id 2000423, and size 70.7k for 1438658724/stime 2008-01-15 14:55:12,439 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/in_rank/5820609371656240149 with 20753 entries, sequence id 2000423, and size 2.5m for 1438658724/in_rank 2008-01-15 14:55:12,586 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/rank_visual/7813540824212558553 with 0 entries, sequence id 2000423, and size 110.0 for 1438658724/rank_visual 2008-01-15 14:55:12,587 DEBUG org.apache.hadoop.hbase.HRegion: Finished memcache flush for region webdata,com.technorati/tag/potiron:http,1200430376177 in 4980ms, sequenceid=2000423 2008-01-15 14:55:12,587 DEBUG org.apache.hadoop.hbase.HRegion: Started memcache flush for region webdata,net.airmotive.www/air_rides.htm:http,1200430376197. Size 6.7m 2008-01-15 14:55:12,595 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1438658724/size not needed. 2008-01-15 14:55:12,595 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1438658724/rank_total not needed. 2008-01-15 14:55:12,595 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1438658724/first_seen not needed. 2008-01-15 14:55:12,595 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1438658724/anchor not needed. 2008-01-15 14:55:12,596 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1438658724/last_seen not needed. 2008-01-15 14:55:12,596 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1438658724/source not needed. 2008-01-15 14:55:12,596 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1438658724/stime not needed. 2008-01-15 14:55:12,596 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1438658724/in_rank not needed. 2008-01-15 14:55:12,596 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1438658724/rank_visual not needed. 2008-01-15 14:55:12,596 DEBUG org.apache.hadoop.hbase.HRegion: region webdata,com.technorati/tag/potiron:http,1200430376177 does not need compaction 2008-01-15 14:55:12,776 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/size/3046664709587729098 with 869 entries, sequence id 2009025, and size 46.9k for 970354973/size 2008-01-15 14:55:13,007 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/rank_total/2203620836441797369 with 0 entries, sequence id 2009025, and size 110.0 for 970354973/rank_total 2008-01-15 14:55:13,159 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/first_seen/7549008992638401619 with 0 entries, sequence id 2009025, and size 110.0 for 970354973/first_seen 2008-01-15 14:55:14,034 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/anchor/5171516441550806962 with 21315 entries, sequence id 2009025, and size 2.6m for 970354973/anchor 2008-01-15 14:55:14,735 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/last_seen/4804915113571653972 with 21315 entries, sequence id 2009025, and size 2.5m for 970354973/last_seen 2008-01-15 14:55:14,882 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/source/5433038998353922696 with 0 entries, sequence id 2009025, and size 110.0 for 970354973/source 2008-01-15 14:55:15,037 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/stime/3312082530663485360 with 869 entries, sequence id 2009025, and size 52.7k for 970354973/stime 2008-01-15 14:55:15,860 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/in_rank/8093409876529238454 with 21315 entries, sequence id 2009025, and size 2.6m for 970354973/in_rank 2008-01-15 14:55:16,062 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/rank_visual/8404931951245446516 with 0 entries, sequence id 2009025, and size 110.0 for 970354973/rank_visual 2008-01-15 14:55:16,063 DEBUG org.apache.hadoop.hbase.HRegion: Finished memcache flush for region webdata,net.airmotive.www/air_rides.htm:http,1200430376197 in 3476ms, sequenceid=2009025 2008-01-15 14:55:16,073 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 970354973/size not needed. 2008-01-15 14:55:16,073 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 970354973/rank_total not needed. 2008-01-15 14:55:16,074 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 970354973/first_seen not needed. 2008-01-15 14:55:16,074 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 970354973/anchor needed. 2008-01-15 14:55:16,075 DEBUG org.apache.hadoop.hbase.HRegion: 970354973/anchor needs compaction 2008-01-15 14:55:16,075 INFO org.apache.hadoop.hbase.HRegion: starting compaction on region webdata,net.airmotive.www/air_rides.htm:http,1200430376197 2008-01-15 14:55:16,075 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 2 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 970354973/size 2008-01-15 14:55:16,708 DEBUG org.apache.hadoop.hbase.HStore: moving 970354973/size/5152806583620962353 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 970354973/size/7275915543329662184 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 970354973/size 2008-01-15 14:55:16,764 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 2 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 970354973/rank_total 2008-01-15 14:55:16,879 DEBUG org.apache.hadoop.hbase.HStore: moving 970354973/rank_total/7992772917689381909 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 970354973/rank_total/7542756049838877435 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 970354973/rank_total 2008-01-15 14:55:16,941 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 2 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 970354973/first_seen 2008-01-15 14:55:17,070 DEBUG org.apache.hadoop.hbase.HStore: moving 970354973/first_seen/5871319052861783182 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 970354973/first_seen/1443347285659265923 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 970354973/first_seen 2008-01-15 14:55:17,151 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 4 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 970354973/anchor 2008-01-15 14:55:24,515 DEBUG org.apache.hadoop.hbase.HStore: moving 970354973/anchor/7476296410208592198 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 970354973/anchor/6985799792997164842 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 970354973/anchor 2008-01-15 14:55:24,646 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 4 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 970354973/last_seen 2008-01-15 14:55:32,859 DEBUG org.apache.hadoop.hbase.HStore: moving 970354973/last_seen/3718468501448328764 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 970354973/last_seen/7381122312007928364 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 970354973/last_seen 2008-01-15 14:55:32,963 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 4 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 970354973/source 2008-01-15 14:55:33,216 DEBUG org.apache.hadoop.hbase.HStore: moving 970354973/source/7171812620264733305 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 970354973/source/6350694294319890330 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 970354973/source 2008-01-15 14:55:33,319 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 4 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 970354973/stime 2008-01-15 14:55:34,033 DEBUG org.apache.hadoop.hbase.HStore: moving 970354973/stime/4477878994655972955 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 970354973/stime/3747297745740770736 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 970354973/stime 2008-01-15 14:55:34,138 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 4 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 970354973/in_rank 2008-01-15 14:55:39,775 ERROR org.apache.hadoop.hbase.HRegionServer: Compaction failed for region webdata,net.airmotive.www/air_rides.htm:http,1200430376197 org.apache.hadoop.dfs.LeaseExpiredException: org.apache.hadoop.dfs.LeaseExpiredException: No lease on /gfs_storage/hadoop-root/hbase/webdata/compaction.dir/970354973/in_rank/mapfiles/4267288961469623951/data at org.apache.hadoop.dfs.FSNamesystem.checkLease(FSNamesystem.java:1123) at org.apache.hadoop.dfs.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1061) at org.apache.hadoop.dfs.NameNode.addBlock(NameNode.java:303) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:494) at org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:82) at org.apache.hadoop.hbase.RemoteExceptionHandler.checkIOException(RemoteExceptionHandler.java:48) at org.apache.hadoop.hbase.HRegionServer$Compactor.run(HRegionServer.java:418) 2008-01-15 14:56:12,589 DEBUG org.apache.hadoop.hbase.HRegion: Started memcache flush for region webdata,com.technorati/tag/potiron:http,1200430376177. Size 7.0m 2008-01-15 14:56:13,286 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/size/7520659132271606165 with 1324 entries, sequence id 2158357, and size 72.3k for 1438658724/size 2008-01-15 14:56:13,425 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/rank_total/986909604944729361 with 0 entries, sequence id 2158357, and size 110.0 for 1438658724/rank_total 2008-01-15 14:56:13,540 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/first_seen/1200486945667323283 with 0 entries, sequence id 2158357, and size 110.0 for 1438658724/first_seen 2008-01-15 14:56:14,256 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/anchor/8202235399245030187 with 22437 entries, sequence id 2158357, and size 2.6m for 1438658724/anchor 2008-01-15 14:56:15,052 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/last_seen/2028698343971100348 with 22437 entries, sequence id 2158357, and size 2.6m for 1438658724/last_seen 2008-01-15 14:56:15,237 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/source/7351625028526444039 with 0 entries, sequence id 2158357, and size 110.0 for 1438658724/source 2008-01-15 14:56:15,424 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/stime/4277670508193498855 with 1324 entries, sequence id 2158357, and size 81.3k for 1438658724/stime 2008-01-15 14:56:16,179 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/in_rank/1378782854938340236 with 22437 entries, sequence id 2158357, and size 2.7m for 1438658724/in_rank 2008-01-15 14:56:16,312 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/rank_visual/6193555782300361850 with 0 entries, sequence id 2158357, and size 110.0 for 1438658724/rank_visual 2008-01-15 14:56:16,313 DEBUG org.apache.hadoop.hbase.HRegion: Finished memcache flush for region webdata,com.technorati/tag/potiron:http,1200430376177 in 3724ms, sequenceid=2158357 2008-01-15 14:56:16,314 DEBUG org.apache.hadoop.hbase.HRegion: Started memcache flush for region webdata,net.airmotive.www/air_rides.htm:http,1200430376197. Size 8.6m 2008-01-15 14:56:16,315 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1438658724/size needed. 2008-01-15 14:56:16,315 DEBUG org.apache.hadoop.hbase.HRegion: 1438658724/size needs compaction 2008-01-15 14:56:16,315 INFO org.apache.hadoop.hbase.HRegion: starting compaction on region webdata,com.technorati/tag/potiron:http,1200430376177 2008-01-15 14:56:16,316 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1438658724/size 2008-01-15 14:56:16,584 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/size/8642202480799559045 with 1257 entries, sequence id 2167624, and size 67.9k for 970354973/size 2008-01-15 14:56:16,821 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/rank_total/3062990260812230709 with 0 entries, sequence id 2167624, and size 110.0 for 970354973/rank_total 2008-01-15 14:56:17,004 DEBUG org.apache.hadoop.hbase.HStore: moving 1438658724/size/6553411184738241770 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1438658724/size/2726925128781938197 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1438658724/size 2008-01-15 14:56:17,042 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/first_seen/9093899370295873652 with 0 entries, sequence id 2167624, and size 110.0 for 970354973/first_seen 2008-01-15 14:56:17,118 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1438658724/rank_total 2008-01-15 14:56:17,392 DEBUG org.apache.hadoop.hbase.HStore: moving 1438658724/rank_total/2387712354271920978 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1438658724/rank_total/1095171083132054601 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1438658724/rank_total 2008-01-15 14:56:17,477 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1438658724/first_seen 2008-01-15 14:56:17,729 DEBUG org.apache.hadoop.hbase.HStore: moving 1438658724/first_seen/7642002971647690304 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1438658724/first_seen/296119993517031093 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1438658724/first_seen 2008-01-15 14:56:17,973 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/anchor/160221133755703869 with 29156 entries, sequence id 2167624, and size 3.3m for 970354973/anchor 2008-01-15 14:56:17,978 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1438658724/anchor 2008-01-15 14:56:18,534 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/last_seen/2248192099187708529 with 29156 entries, sequence id 2167624, and size 3.2m for 970354973/last_seen 2008-01-15 14:56:18,592 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/source/7280806916916053855 with 0 entries, sequence id 2167624, and size 110.0 for 970354973/source 2008-01-15 14:56:18,666 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/stime/5668996838192947234 with 1257 entries, sequence id 2167624, and size 76.3k for 970354973/stime 2008-01-15 14:56:19,254 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/in_rank/159032051122029999 with 29156 entries, sequence id 2167624, and size 3.3m for 970354973/in_rank 2008-01-15 14:56:19,368 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/rank_visual/8700682286321021134 with 0 entries, sequence id 2167624, and size 110.0 for 970354973/rank_visual 2008-01-15 14:56:19,368 DEBUG org.apache.hadoop.hbase.HRegion: Finished memcache flush for region webdata,net.airmotive.www/air_rides.htm:http,1200430376197 in 3055ms, sequenceid=2167624 2008-01-15 14:56:19,693 INFO org.apache.hadoop.hbase.HRegionServer: Rolling hlog. Number of entries: 250003 2008-01-15 14:56:21,628 DEBUG org.apache.hadoop.hbase.HLog: Closing current log writer hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.4_1200429714191_60020/hlog.dat.002 to get a new one 2008-01-15 14:56:21,632 INFO org.apache.hadoop.hbase.HLog: new log writer created at hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.4_1200429714191_60020/hlog.dat.003 2008-01-15 14:56:21,633 DEBUG org.apache.hadoop.hbase.HLog: Found 1 logs to remove using oldest outstanding seqnum of 2167588 from region webdata,com.technorati/tag/potiron:http,1200430376177 2008-01-15 14:56:21,633 INFO org.apache.hadoop.hbase.HLog: removing old log file hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/log_10.0.0.4_1200429714191_60020/hlog.dat.001 whose highest sequence/edit id is 1923764 2008-01-15 14:56:25,003 DEBUG org.apache.hadoop.hbase.HStore: moving 1438658724/anchor/4468413842966147546 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1438658724/anchor/4127934370040424907 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1438658724/anchor 2008-01-15 14:56:25,104 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1438658724/last_seen 2008-01-15 14:56:32,732 DEBUG org.apache.hadoop.hbase.HStore: moving 1438658724/last_seen/462003254791061817 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1438658724/last_seen/7184355328508806756 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1438658724/last_seen 2008-01-15 14:56:32,832 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1438658724/source 2008-01-15 14:56:33,072 DEBUG org.apache.hadoop.hbase.HStore: moving 1438658724/source/2637141316584433560 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1438658724/source/3994767041130571519 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1438658724/source 2008-01-15 14:56:33,159 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1438658724/stime 2008-01-15 14:56:33,873 DEBUG org.apache.hadoop.hbase.HStore: moving 1438658724/stime/3232046464120396541 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1438658724/stime/799002008424649947 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1438658724/stime 2008-01-15 14:56:33,937 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1438658724/in_rank 2008-01-15 14:56:40,246 ERROR org.apache.hadoop.hbase.HRegionServer: Compaction failed for region webdata,com.technorati/tag/potiron:http,1200430376177 org.apache.hadoop.dfs.LeaseExpiredException: org.apache.hadoop.dfs.LeaseExpiredException: No lease on /gfs_storage/hadoop-root/hbase/webdata/compaction.dir/1438658724/in_rank/mapfiles/7542498306710304034/data at org.apache.hadoop.dfs.FSNamesystem.checkLease(FSNamesystem.java:1123) at org.apache.hadoop.dfs.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1061) at org.apache.hadoop.dfs.NameNode.addBlock(NameNode.java:303) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:494) at org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:82) at org.apache.hadoop.hbase.RemoteExceptionHandler.checkIOException(RemoteExceptionHandler.java:48) at org.apache.hadoop.hbase.HRegionServer$Compactor.run(HRegionServer.java:418) 2008-01-15 14:56:40,250 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 970354973/size not needed. 2008-01-15 14:56:40,250 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 970354973/rank_total not needed. 2008-01-15 14:56:40,250 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 970354973/first_seen not needed. 2008-01-15 14:56:40,251 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 970354973/anchor not needed. 2008-01-15 14:56:40,251 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 970354973/last_seen not needed. 2008-01-15 14:56:40,251 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 970354973/source not needed. 2008-01-15 14:56:40,253 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 970354973/stime not needed. 2008-01-15 14:56:40,253 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 970354973/in_rank needed. 2008-01-15 14:56:40,253 DEBUG org.apache.hadoop.hbase.HRegion: 970354973/in_rank needs compaction 2008-01-15 14:56:40,255 INFO org.apache.hadoop.hbase.HRegion: starting compaction on region webdata,net.airmotive.www/air_rides.htm:http,1200430376197 2008-01-15 14:56:40,256 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 2 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 970354973/size 2008-01-15 14:56:40,580 ERROR org.apache.hadoop.hbase.HRegionServer: Compaction failed for region webdata,net.airmotive.www/air_rides.htm:http,1200430376197 org.apache.hadoop.dfs.LeaseExpiredException: org.apache.hadoop.dfs.LeaseExpiredException: No lease on /gfs_storage/hadoop-root/hbase/webdata/compaction.dir/970354973/size/mapfiles/3483738441247228038/data at org.apache.hadoop.dfs.FSNamesystem.checkLease(FSNamesystem.java:1123) at org.apache.hadoop.dfs.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1061) at org.apache.hadoop.dfs.NameNode.addBlock(NameNode.java:303) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:494) at org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:82) at org.apache.hadoop.hbase.RemoteExceptionHandler.checkIOException(RemoteExceptionHandler.java:48) at org.apache.hadoop.hbase.HRegionServer$Compactor.run(HRegionServer.java:418) 2008-01-15 14:57:16,320 DEBUG org.apache.hadoop.hbase.HRegion: Started memcache flush for region webdata,com.technorati/tag/potiron:http,1200430376177. Size 6.9m 2008-01-15 14:57:16,592 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/size/2713546815306084839 with 1249 entries, sequence id 2306369, and size 69.4k for 1438658724/size 2008-01-15 14:57:16,741 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/rank_total/9051709169446251310 with 0 entries, sequence id 2306369, and size 110.0 for 1438658724/rank_total 2008-01-15 14:57:16,898 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/first_seen/3221579712148689586 with 0 entries, sequence id 2306369, and size 110.0 for 1438658724/first_seen 2008-01-15 14:57:17,685 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/anchor/3641890931838979548 with 20951 entries, sequence id 2306369, and size 2.6m for 1438658724/anchor 2008-01-15 14:57:18,400 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/last_seen/7537670184838872794 with 20951 entries, sequence id 2306369, and size 2.5m for 1438658724/last_seen 2008-01-15 14:57:18,536 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/source/5762345699535988072 with 0 entries, sequence id 2306369, and size 110.0 for 1438658724/source 2008-01-15 14:57:18,687 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/stime/8609500857130033096 with 1249 entries, sequence id 2306369, and size 77.9k for 1438658724/stime 2008-01-15 14:57:19,525 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/in_rank/5408675111483229096 with 20951 entries, sequence id 2306369, and size 2.6m for 1438658724/in_rank 2008-01-15 14:57:19,655 DEBUG org.apache.hadoop.hbase.HStore: Added 1438658724/rank_visual/9105441584859668899 with 0 entries, sequence id 2306369, and size 110.0 for 1438658724/rank_visual 2008-01-15 14:57:19,656 DEBUG org.apache.hadoop.hbase.HRegion: Finished memcache flush for region webdata,com.technorati/tag/potiron:http,1200430376177 in 3337ms, sequenceid=2306369 2008-01-15 14:57:19,657 DEBUG org.apache.hadoop.hbase.HRegion: Started memcache flush for region webdata,net.airmotive.www/air_rides.htm:http,1200430376197. Size 8.1m 2008-01-15 14:57:19,657 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1438658724/size not needed. 2008-01-15 14:57:19,657 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1438658724/rank_total not needed. 2008-01-15 14:57:19,657 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1438658724/first_seen not needed. 2008-01-15 14:57:19,657 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1438658724/anchor not needed. 2008-01-15 14:57:19,658 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1438658724/last_seen not needed. 2008-01-15 14:57:19,658 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1438658724/source not needed. 2008-01-15 14:57:19,658 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1438658724/stime not needed. 2008-01-15 14:57:19,658 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 1438658724/in_rank needed. 2008-01-15 14:57:19,658 DEBUG org.apache.hadoop.hbase.HRegion: 1438658724/in_rank needs compaction 2008-01-15 14:57:20,011 INFO org.apache.hadoop.hbase.HRegion: starting compaction on region webdata,com.technorati/tag/potiron:http,1200430376177 2008-01-15 14:57:20,012 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 2 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1438658724/size 2008-01-15 14:57:20,224 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/size/7706755816298952706 with 1030 entries, sequence id 2311596, and size 56.0k for 970354973/size 2008-01-15 14:57:20,388 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/rank_total/4576674663291040925 with 0 entries, sequence id 2311596, and size 110.0 for 970354973/rank_total 2008-01-15 14:57:20,538 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/first_seen/1349049986091824904 with 0 entries, sequence id 2311596, and size 110.0 for 970354973/first_seen 2008-01-15 14:57:20,649 DEBUG org.apache.hadoop.hbase.HStore: moving 1438658724/size/4637174218241668249 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1438658724/size/6235016907979758229 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1438658724/size 2008-01-15 14:57:20,720 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 2 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1438658724/rank_total 2008-01-15 14:57:20,907 DEBUG org.apache.hadoop.hbase.HStore: moving 1438658724/rank_total/7933718246067655509 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1438658724/rank_total/2640020870203685371 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1438658724/rank_total 2008-01-15 14:57:21,002 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 2 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1438658724/first_seen 2008-01-15 14:57:21,381 DEBUG org.apache.hadoop.hbase.HStore: moving 1438658724/first_seen/9070531988461544788 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1438658724/first_seen/5810967246948876759 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1438658724/first_seen 2008-01-15 14:57:21,441 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/anchor/8702341859717050510 with 25998 entries, sequence id 2311596, and size 3.1m for 970354973/anchor 2008-01-15 14:57:21,539 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 2 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1438658724/anchor 2008-01-15 14:57:22,301 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/last_seen/8872425900760462424 with 25998 entries, sequence id 2311596, and size 3.0m for 970354973/last_seen 2008-01-15 14:57:22,453 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/source/2787474751204949102 with 0 entries, sequence id 2311596, and size 110.0 for 970354973/source 2008-01-15 14:57:22,627 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/stime/1956331443433499319 with 1030 entries, sequence id 2311596, and size 62.9k for 970354973/stime 2008-01-15 14:57:23,732 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/in_rank/193322258559023801 with 25998 entries, sequence id 2311596, and size 3.1m for 970354973/in_rank 2008-01-15 14:57:23,920 DEBUG org.apache.hadoop.hbase.HStore: Added 970354973/rank_visual/5469312010454453728 with 0 entries, sequence id 2311596, and size 110.0 for 970354973/rank_visual 2008-01-15 14:57:23,920 DEBUG org.apache.hadoop.hbase.HRegion: Finished memcache flush for region webdata,net.airmotive.www/air_rides.htm:http,1200430376197 in 4263ms, sequenceid=2311596 2008-01-15 14:57:29,806 DEBUG org.apache.hadoop.hbase.HStore: moving 1438658724/anchor/1362260325030631703 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1438658724/anchor/1584146854760633934 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1438658724/anchor 2008-01-15 14:57:29,921 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 2 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1438658724/last_seen 2008-01-15 14:57:42,331 DEBUG org.apache.hadoop.hbase.HStore: moving 1438658724/last_seen/3552298176760787904 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1438658724/last_seen/2389621651034510554 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1438658724/last_seen 2008-01-15 14:57:42,431 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 2 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1438658724/source 2008-01-15 14:57:42,702 DEBUG org.apache.hadoop.hbase.HStore: moving 1438658724/source/88766235007712969 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1438658724/source/3895659388605897889 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1438658724/source 2008-01-15 14:57:42,783 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 2 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1438658724/stime 2008-01-15 14:57:43,622 DEBUG org.apache.hadoop.hbase.HStore: moving 1438658724/stime/2730022041699533028 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir to 1438658724/stime/2373818138041710454 in hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata for 1438658724/stime 2008-01-15 14:57:43,698 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 4 files using hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/compaction.dir for 1438658724/in_rank 2008-01-15 14:57:53,002 ERROR org.apache.hadoop.hbase.HRegionServer: Compaction failed for region webdata,com.technorati/tag/potiron:http,1200430376177 org.apache.hadoop.dfs.LeaseExpiredException: org.apache.hadoop.dfs.LeaseExpiredException: No lease on /gfs_storage/hadoop-root/hbase/webdata/compaction.dir/1438658724/in_rank/mapfiles/8222904438849251562/data at org.apache.hadoop.dfs.FSNamesystem.checkLease(FSNamesystem.java:1123) at org.apache.hadoop.dfs.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1061) at org.apache.hadoop.dfs.NameNode.addBlock(NameNode.java:303) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:494) at org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:82) at org.apache.hadoop.hbase.RemoteExceptionHandler.checkIOException(RemoteExceptionHandler.java:48) at org.apache.hadoop.hbase.HRegionServer$Compactor.run(HRegionServer.java:418) 2008-01-15 14:57:53,006 DEBUG org.apache.hadoop.hbase.HStore: compaction for HStore 970354973/size needed. 2008-01-15 14:57:53,006 DEBUG org.apache.hadoop.hbase.HRegion: 970354973/size needs compaction 2008-01-15 14:57:53,006 INFO org.apache.hadoop.hbase.HRegion: starting compaction on region webdata,net.airmotive.www/air_rides.htm:http,1200430376197