Testsuite: org.apache.hadoop.hbase.util.TestMergeTool Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 15.817 sec ------------- Standard Output --------------- Starting DataNode 0 with dfs.data.dir: /usr/src/Hadoop/hbase-trunk/build/test/data/dfs/data/data1,/usr/src/Hadoop/hbase-trunk/build/test/data/dfs/data/data2 Starting DataNode 1 with dfs.data.dir: /usr/src/Hadoop/hbase-trunk/build/test/data/dfs/data/data3,/usr/src/Hadoop/hbase-trunk/build/test/data/dfs/data/data4 Shutting down the Mini HDFS Cluster Shutting down DataNode 1 Shutting down DataNode 0 ------------- ---------------- --------------- ------------- Standard Error ----------------- 2009-01-10 09:15:15,923 INFO [main] http.HttpServer(729): Version Jetty/5.1.4 2009-01-10 09:15:16,233 INFO [main] util.FileResource(60): Checking Resource aliases 2009-01-10 09:15:16,236 INFO [main] util.Container(74): Started org.mortbay.jetty.servlet.WebApplicationHandler@9ac5f13 2009-01-10 09:15:16,279 INFO [main] util.Container(74): Started WebApplicationContext[/static,/static] 2009-01-10 09:15:16,416 INFO [main] util.Container(74): Started org.mortbay.jetty.servlet.WebApplicationHandler@5c28305d 2009-01-10 09:15:16,420 INFO [main] util.Container(74): Started WebApplicationContext[/,/] 2009-01-10 09:15:16,423 INFO [main] http.SocketListener(204): Started SocketListener on 127.0.0.1:59548 2009-01-10 09:15:16,424 INFO [main] util.Container(74): Started org.mortbay.jetty.Server@774acfcd 2009-01-10 09:15:16,756 INFO [main] http.HttpServer(729): Version Jetty/5.1.4 2009-01-10 09:15:16,911 INFO [main] util.Container(74): Started org.mortbay.jetty.servlet.WebApplicationHandler@72e5355f 2009-01-10 09:15:16,914 INFO [main] util.Container(74): Started WebApplicationContext[/static,/static] 2009-01-10 09:15:17,046 INFO [main] util.Container(74): Started org.mortbay.jetty.servlet.WebApplicationHandler@ae0e515 2009-01-10 09:15:17,062 INFO [main] util.Container(74): Started WebApplicationContext[/,/] 2009-01-10 09:15:17,063 INFO [main] http.SocketListener(204): Started SocketListener on 127.0.0.1:59889 2009-01-10 09:15:17,063 INFO [main] util.Container(74): Started org.mortbay.jetty.Server@3e0d1329 2009-01-10 09:15:17,154 INFO [main] http.HttpServer(729): Version Jetty/5.1.4 2009-01-10 09:15:17,222 INFO [main] util.Container(74): Started org.mortbay.jetty.servlet.WebApplicationHandler@60c9630a 2009-01-10 09:15:17,223 INFO [main] util.Container(74): Started WebApplicationContext[/static,/static] 2009-01-10 09:15:17,310 INFO [main] util.Container(74): Started org.mortbay.jetty.servlet.WebApplicationHandler@3d8f1be9 2009-01-10 09:15:17,312 INFO [main] util.Container(74): Started WebApplicationContext[/,/] 2009-01-10 09:15:17,312 INFO [main] http.SocketListener(204): Started SocketListener on 127.0.0.1:47483 2009-01-10 09:15:17,313 INFO [main] util.Container(74): Started org.mortbay.jetty.Server@31f9338f 2009-01-10 09:15:17,576 INFO [main] regionserver.HLog(265): New log writer: /user/apurtell/-ROOT-/70236052/log/hlog.dat.1231578917562 2009-01-10 09:15:17,579 DEBUG [main] regionserver.HRegion(238): Opening region -ROOT-,,0/70236052 2009-01-10 09:15:17,618 DEBUG [main] regionserver.HRegion(299): Next sequence id for region -ROOT-,,0 is 0 2009-01-10 09:15:17,620 INFO [main] regionserver.HRegion(321): region -ROOT-,,0/70236052 available 2009-01-10 09:15:17,628 INFO [main] regionserver.HLog(265): New log writer: /user/apurtell/.META./1028785192/log/hlog.dat.1231578917625 2009-01-10 09:15:17,628 DEBUG [main] regionserver.HRegion(238): Opening region .META.,,1/1028785192 2009-01-10 09:15:17,647 DEBUG [main] regionserver.HRegion(299): Next sequence id for region .META.,,1 is 0 2009-01-10 09:15:17,649 INFO [main] regionserver.HRegion(321): region .META.,,1/1028785192 available 2009-01-10 09:15:17,657 INFO [main] regionserver.HLog(265): New log writer: /user/apurtell/TestMergeTool/1720306167/log/hlog.dat.1231578917655 2009-01-10 09:15:17,658 DEBUG [main] regionserver.HRegion(238): Opening region TestMergeTool,row_0200,1231578915517/1720306167 2009-01-10 09:15:17,666 DEBUG [main] regionserver.HRegion(299): Next sequence id for region TestMergeTool,row_0200,1231578915517 is 0 2009-01-10 09:15:17,667 INFO [main] regionserver.HRegion(321): region TestMergeTool,row_0200,1231578915517/1720306167 available 2009-01-10 09:15:17,676 INFO [main] regionserver.HLog(265): New log writer: /user/apurtell/TestMergeTool/351183197/log/hlog.dat.1231578917674 2009-01-10 09:15:17,677 DEBUG [main] regionserver.HRegion(238): Opening region TestMergeTool,row_0250,1231578915517/351183197 2009-01-10 09:15:17,685 DEBUG [main] regionserver.HRegion(299): Next sequence id for region TestMergeTool,row_0250,1231578915517 is 0 2009-01-10 09:15:17,687 INFO [main] regionserver.HRegion(321): region TestMergeTool,row_0250,1231578915517/351183197 available 2009-01-10 09:15:17,693 INFO [main] regionserver.HLog(265): New log writer: /user/apurtell/TestMergeTool/2108696795/log/hlog.dat.1231578917691 2009-01-10 09:15:17,693 DEBUG [main] regionserver.HRegion(238): Opening region TestMergeTool,row_0100,1231578915517/2108696795 2009-01-10 09:15:17,701 DEBUG [main] regionserver.HRegion(299): Next sequence id for region TestMergeTool,row_0100,1231578915517 is 0 2009-01-10 09:15:17,703 INFO [main] regionserver.HRegion(321): region TestMergeTool,row_0100,1231578915517/2108696795 available 2009-01-10 09:15:17,711 INFO [main] regionserver.HLog(265): New log writer: /user/apurtell/TestMergeTool/1669458906/log/hlog.dat.1231578917709 2009-01-10 09:15:17,712 DEBUG [main] regionserver.HRegion(238): Opening region TestMergeTool,row_0500,1231578915517/1669458906 2009-01-10 09:15:17,719 DEBUG [main] regionserver.HRegion(299): Next sequence id for region TestMergeTool,row_0500,1231578915517 is 0 2009-01-10 09:15:17,720 INFO [main] regionserver.HRegion(321): region TestMergeTool,row_0500,1231578915517/1669458906 available 2009-01-10 09:15:17,726 INFO [main] regionserver.HLog(265): New log writer: /user/apurtell/TestMergeTool/1885949095/log/hlog.dat.1231578917724 2009-01-10 09:15:17,726 DEBUG [main] regionserver.HRegion(238): Opening region TestMergeTool,,1231578915517/1885949095 2009-01-10 09:15:17,734 DEBUG [main] regionserver.HRegion(299): Next sequence id for region TestMergeTool,,1231578915517 is 0 2009-01-10 09:15:17,736 INFO [main] regionserver.HRegion(321): region TestMergeTool,,1231578915517/1885949095 available 2009-01-10 09:15:17,737 DEBUG [main] regionserver.HRegion(392): Closing .META.,,1: compactions & flushes disabled 2009-01-10 09:15:17,737 DEBUG [main] regionserver.HRegion(422): Updates disabled for region, no outstanding scanners on .META.,,1 2009-01-10 09:15:17,737 DEBUG [main] regionserver.HRegion(429): No more row locks outstanding on region .META.,,1 2009-01-10 09:15:17,738 DEBUG [main] regionserver.HRegion(844): Started memcache flush for region .META.,,1. Current region memcache size 2.4k 2009-01-10 09:15:17,762 WARN [main] util.NativeCodeLoader(52): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2009-01-10 09:15:17,819 DEBUG [main] regionserver.HStore(696): Added /user/apurtell/.META./1028785192/info/mapfiles/8095733044724918755 with 5 entries, sequence id 5, data size ~2.4k, file size 1.9k to .META.,,1 2009-01-10 09:15:17,819 DEBUG [main] regionserver.HRegion(921): Finished memcache flush of ~2.4k for region .META.,,1 in 82ms, sequence id=5, compaction requested=false 2009-01-10 09:15:17,819 DEBUG [main] regionserver.HStore(600): closed 1028785192/historian 2009-01-10 09:15:17,820 DEBUG [main] regionserver.HStore(600): closed 1028785192/info 2009-01-10 09:15:17,820 INFO [main] regionserver.HRegion(441): Closed .META.,,1 2009-01-10 09:15:17,820 DEBUG [main] regionserver.HLog(419): closing log writer in hdfs://localhost.localdomain:53096/user/apurtell/.META./1028785192/log 2009-01-10 09:15:17,829 DEBUG [main] regionserver.HRegion(392): Closing -ROOT-,,0: compactions & flushes disabled 2009-01-10 09:15:17,829 DEBUG [main] regionserver.HRegion(422): Updates disabled for region, no outstanding scanners on -ROOT-,,0 2009-01-10 09:15:17,830 DEBUG [main] regionserver.HRegion(429): No more row locks outstanding on region -ROOT-,,0 2009-01-10 09:15:17,830 DEBUG [main] regionserver.HRegion(844): Started memcache flush for region -ROOT-,,0. Current region memcache size 598.0 2009-01-10 09:15:17,867 DEBUG [main] regionserver.HStore(696): Added /user/apurtell/-ROOT-/70236052/info/mapfiles/8824810554225742090 with 1 entries, sequence id 1, data size ~598.0, file size 577.0 to -ROOT-,,0 2009-01-10 09:15:17,868 DEBUG [main] regionserver.HRegion(921): Finished memcache flush of ~598.0 for region -ROOT-,,0 in 38ms, sequence id=1, compaction requested=false 2009-01-10 09:15:17,868 DEBUG [main] regionserver.HStore(600): closed 70236052/info 2009-01-10 09:15:17,870 INFO [main] regionserver.HRegion(441): Closed -ROOT-,,0 2009-01-10 09:15:17,870 DEBUG [main] regionserver.HLog(419): closing log writer in hdfs://localhost.localdomain:53096/user/apurtell/-ROOT-/70236052/log 2009-01-10 09:15:17,881 DEBUG [main] regionserver.HRegion(392): Closing TestMergeTool,row_0200,1231578915517: compactions & flushes disabled 2009-01-10 09:15:17,881 DEBUG [main] regionserver.HRegion(422): Updates disabled for region, no outstanding scanners on TestMergeTool,row_0200,1231578915517 2009-01-10 09:15:17,882 DEBUG [main] regionserver.HRegion(429): No more row locks outstanding on region TestMergeTool,row_0200,1231578915517 2009-01-10 09:15:17,882 DEBUG [main] regionserver.HRegion(844): Started memcache flush for region TestMergeTool,row_0200,1231578915517. Current region memcache size 356.0 2009-01-10 09:15:17,925 DEBUG [main] regionserver.HStore(696): Added /user/apurtell/TestMergeTool/1720306167/contents/mapfiles/1602692123535894809 with 2 entries, sequence id 2, data size ~356.0, file size 204.0 to TestMergeTool,row_0200,1231578915517 2009-01-10 09:15:17,926 DEBUG [main] regionserver.HRegion(921): Finished memcache flush of ~356.0 for region TestMergeTool,row_0200,1231578915517 in 44ms, sequence id=2, compaction requested=false 2009-01-10 09:15:17,926 DEBUG [main] regionserver.HStore(600): closed 1720306167/contents 2009-01-10 09:15:17,926 INFO [main] regionserver.HRegion(441): Closed TestMergeTool,row_0200,1231578915517 2009-01-10 09:15:17,926 DEBUG [main] regionserver.HLog(419): closing log writer in hdfs://localhost.localdomain:53096/user/apurtell/TestMergeTool/1720306167/log 2009-01-10 09:15:17,934 DEBUG [main] regionserver.HRegion(392): Closing TestMergeTool,row_0250,1231578915517: compactions & flushes disabled 2009-01-10 09:15:17,934 DEBUG [main] regionserver.HRegion(422): Updates disabled for region, no outstanding scanners on TestMergeTool,row_0250,1231578915517 2009-01-10 09:15:17,935 DEBUG [main] regionserver.HRegion(429): No more row locks outstanding on region TestMergeTool,row_0250,1231578915517 2009-01-10 09:15:17,935 DEBUG [main] regionserver.HRegion(844): Started memcache flush for region TestMergeTool,row_0250,1231578915517. Current region memcache size 356.0 2009-01-10 09:15:17,973 DEBUG [main] regionserver.HStore(696): Added /user/apurtell/TestMergeTool/351183197/contents/mapfiles/7607624623349130512 with 2 entries, sequence id 2, data size ~356.0, file size 204.0 to TestMergeTool,row_0250,1231578915517 2009-01-10 09:15:17,975 DEBUG [main] regionserver.HRegion(921): Finished memcache flush of ~356.0 for region TestMergeTool,row_0250,1231578915517 in 40ms, sequence id=2, compaction requested=false 2009-01-10 09:15:17,975 DEBUG [main] regionserver.HStore(600): closed 351183197/contents 2009-01-10 09:15:17,975 INFO [main] regionserver.HRegion(441): Closed TestMergeTool,row_0250,1231578915517 2009-01-10 09:15:17,976 DEBUG [main] regionserver.HLog(419): closing log writer in hdfs://localhost.localdomain:53096/user/apurtell/TestMergeTool/351183197/log 2009-01-10 09:15:17,986 DEBUG [main] regionserver.HRegion(392): Closing TestMergeTool,row_0100,1231578915517: compactions & flushes disabled 2009-01-10 09:15:17,986 DEBUG [main] regionserver.HRegion(422): Updates disabled for region, no outstanding scanners on TestMergeTool,row_0100,1231578915517 2009-01-10 09:15:17,986 DEBUG [main] regionserver.HRegion(429): No more row locks outstanding on region TestMergeTool,row_0100,1231578915517 2009-01-10 09:15:17,986 DEBUG [main] regionserver.HRegion(844): Started memcache flush for region TestMergeTool,row_0100,1231578915517. Current region memcache size 356.0 2009-01-10 09:15:18,037 DEBUG [main] regionserver.HStore(696): Added /user/apurtell/TestMergeTool/2108696795/contents/mapfiles/8427906403274051044 with 2 entries, sequence id 2, data size ~356.0, file size 204.0 to TestMergeTool,row_0100,1231578915517 2009-01-10 09:15:18,037 DEBUG [main] regionserver.HRegion(921): Finished memcache flush of ~356.0 for region TestMergeTool,row_0100,1231578915517 in 51ms, sequence id=2, compaction requested=false 2009-01-10 09:15:18,037 DEBUG [main] regionserver.HStore(600): closed 2108696795/contents 2009-01-10 09:15:18,038 INFO [main] regionserver.HRegion(441): Closed TestMergeTool,row_0100,1231578915517 2009-01-10 09:15:18,038 DEBUG [main] regionserver.HLog(419): closing log writer in hdfs://localhost.localdomain:53096/user/apurtell/TestMergeTool/2108696795/log 2009-01-10 09:15:18,050 DEBUG [main] regionserver.HRegion(392): Closing TestMergeTool,row_0500,1231578915517: compactions & flushes disabled 2009-01-10 09:15:18,050 DEBUG [main] regionserver.HRegion(422): Updates disabled for region, no outstanding scanners on TestMergeTool,row_0500,1231578915517 2009-01-10 09:15:18,051 DEBUG [main] regionserver.HRegion(429): No more row locks outstanding on region TestMergeTool,row_0500,1231578915517 2009-01-10 09:15:18,051 DEBUG [main] regionserver.HRegion(844): Started memcache flush for region TestMergeTool,row_0500,1231578915517. Current region memcache size 356.0 2009-01-10 09:15:18,087 DEBUG [main] regionserver.HStore(696): Added /user/apurtell/TestMergeTool/1669458906/contents/mapfiles/2517718208291266182 with 2 entries, sequence id 2, data size ~356.0, file size 204.0 to TestMergeTool,row_0500,1231578915517 2009-01-10 09:15:18,088 DEBUG [main] regionserver.HRegion(921): Finished memcache flush of ~356.0 for region TestMergeTool,row_0500,1231578915517 in 37ms, sequence id=2, compaction requested=false 2009-01-10 09:15:18,088 DEBUG [main] regionserver.HStore(600): closed 1669458906/contents 2009-01-10 09:15:18,088 INFO [main] regionserver.HRegion(441): Closed TestMergeTool,row_0500,1231578915517 2009-01-10 09:15:18,088 DEBUG [main] regionserver.HLog(419): closing log writer in hdfs://localhost.localdomain:53096/user/apurtell/TestMergeTool/1669458906/log 2009-01-10 09:15:18,097 DEBUG [main] regionserver.HRegion(392): Closing TestMergeTool,,1231578915517: compactions & flushes disabled 2009-01-10 09:15:18,098 DEBUG [main] regionserver.HRegion(422): Updates disabled for region, no outstanding scanners on TestMergeTool,,1231578915517 2009-01-10 09:15:18,098 DEBUG [main] regionserver.HRegion(429): No more row locks outstanding on region TestMergeTool,,1231578915517 2009-01-10 09:15:18,098 DEBUG [main] regionserver.HRegion(844): Started memcache flush for region TestMergeTool,,1231578915517. Current region memcache size 356.0 2009-01-10 09:15:18,219 DEBUG [main] regionserver.HStore(696): Added /user/apurtell/TestMergeTool/1885949095/contents/mapfiles/1075741905475581829 with 2 entries, sequence id 2, data size ~356.0, file size 204.0 to TestMergeTool,,1231578915517 2009-01-10 09:15:18,219 DEBUG [main] regionserver.HRegion(921): Finished memcache flush of ~356.0 for region TestMergeTool,,1231578915517 in 121ms, sequence id=2, compaction requested=false 2009-01-10 09:15:18,219 DEBUG [main] regionserver.HStore(600): closed 1885949095/contents 2009-01-10 09:15:18,220 INFO [main] regionserver.HRegion(441): Closed TestMergeTool,,1231578915517 2009-01-10 09:15:18,220 DEBUG [main] regionserver.HLog(419): closing log writer in hdfs://localhost.localdomain:53096/user/apurtell/TestMergeTool/1885949095/log 2009-01-10 09:15:18,227 INFO [main] util.TestMergeTool(207): Creating log /tmp/log_1231578918227 2009-01-10 09:15:18,230 INFO [main] regionserver.HLog(265): New log writer: /tmp/log_1231578918227/hlog.dat.1231578918229 2009-01-10 09:15:18,233 INFO [main] util.TestMergeTool(158): merging regions 0 and 1 2009-01-10 09:15:18,240 INFO [main] util.Merge(80): Verifying that file system is available... 2009-01-10 09:15:18,241 INFO [main] util.Merge(89): Verifying that HBase is not running... 2009-01-10 09:15:28,383 INFO [main] util.Merge(190): Merging regions [B@fcdfd19 and [B@1ca37c6a in table [B@313d21d6 2009-01-10 09:15:28,391 INFO [main] regionserver.HLog(265): New log writer: /user/apurtell/log_1231578928384/hlog.dat.1231578928388 2009-01-10 09:15:28,392 DEBUG [main] regionserver.HRegion(2218): Opening region: REGION => {NAME => '-ROOT-,,0', STARTKEY => '', ENDKEY => '', ENCODED => 70236052, TABLE => {{NAME => '-ROOT-', IS_ROOT => 'true', IS_META => 'true', FAMILIES => [{NAME => 'info', BLOOMFILTER => 'false', COMPRESSION => 'NONE', VERSIONS => '10', LENGTH => '2147483647', TTL => '-1', IN_MEMORY => 'false', BLOCKCACHE => 'true'}], INDEXES => []}} 2009-01-10 09:15:28,393 DEBUG [main] regionserver.HRegion(238): Opening region -ROOT-,,0/70236052 2009-01-10 09:15:28,435 DEBUG [main] regionserver.HStore(494): loaded /user/apurtell/-ROOT-/70236052/info/info/8824810554225742090, isReference=false, sequence id=1, length=577, majorCompaction=false 2009-01-10 09:15:28,437 DEBUG [main] regionserver.HStore(232): Loaded 1 file(s) in hstore 70236052/info, max sequence id 1 2009-01-10 09:15:28,451 DEBUG [main] regionserver.HRegion(299): Next sequence id for region -ROOT-,,0 is 2 2009-01-10 09:15:28,454 INFO [main] regionserver.HRegion(321): region -ROOT-,,0/70236052 available 2009-01-10 09:15:28,454 DEBUG [main] regionserver.HLog(215): changing sequence number from 0 to 2 2009-01-10 09:15:28,454 INFO [main] regionserver.HRegion(719): starting compaction on region -ROOT-,,0 2009-01-10 09:15:28,458 INFO [main] regionserver.HRegion(734): compaction completed on region -ROOT-,,0 in 0sec 2009-01-10 09:15:28,474 INFO [main] util.Merge(204): Found meta for region1 [B@4cc5f20f, meta for region2 [B@4cc5f20f 2009-01-10 09:15:28,474 DEBUG [main] regionserver.HRegion(2218): Opening region: REGION => {NAME => '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED => 1028785192, TABLE => {{NAME => '.META.', IS_ROOT => 'false', IS_META => 'true', FAMILIES => [{NAME => 'info', BLOOMFILTER => 'false', VERSIONS => '10', COMPRESSION => 'NONE', LENGTH => '2147483647', TTL => '-1', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'historian', BLOOMFILTER => 'false', VERSIONS => '2147483647', COMPRESSION => 'NONE', LENGTH => '2147483647', TTL => '604800', IN_MEMORY => 'false', BLOCKCACHE => 'false'}], INDEXES => []}} 2009-01-10 09:15:28,475 DEBUG [main] regionserver.HRegion(238): Opening region .META.,,1/1028785192 2009-01-10 09:15:28,492 DEBUG [main] regionserver.HStore(494): loaded /user/apurtell/.META./1028785192/info/info/8095733044724918755, isReference=false, sequence id=5, length=1948, majorCompaction=false 2009-01-10 09:15:28,495 DEBUG [main] regionserver.HStore(232): Loaded 1 file(s) in hstore 1028785192/info, max sequence id 5 2009-01-10 09:15:28,515 DEBUG [main] regionserver.HRegion(299): Next sequence id for region .META.,,1 is 6 2009-01-10 09:15:28,517 INFO [main] regionserver.HRegion(321): region .META.,,1/1028785192 available 2009-01-10 09:15:28,518 DEBUG [main] regionserver.HLog(215): changing sequence number from 2 to 6 2009-01-10 09:15:28,518 INFO [main] regionserver.HRegion(719): starting compaction on region .META.,,1 2009-01-10 09:15:28,519 DEBUG [main] regionserver.HStore(828): 1028785192/historian: no store files to compact 2009-01-10 09:15:28,521 INFO [main] regionserver.HRegion(734): compaction completed on region .META.,,1 in 0sec 2009-01-10 09:15:28,523 DEBUG [main] regionserver.HRegion(2218): Opening region: REGION => {NAME => 'TestMergeTool,row_0200,1231578915517', STARTKEY => 'row_0200', ENDKEY => 'row_0300', ENCODED => 1720306167, TABLE => {{NAME => 'TestMergeTool', IS_ROOT => 'false', IS_META => 'false', FAMILIES => [{NAME => 'contents', BLOOMFILTER => 'false', VERSIONS => '3', COMPRESSION => 'NONE', LENGTH => '2147483647', TTL => '-1', IN_MEMORY => 'false', BLOCKCACHE => 'true'}], INDEXES => []}} 2009-01-10 09:15:28,524 DEBUG [main] regionserver.HRegion(238): Opening region TestMergeTool,row_0200,1231578915517/1720306167 2009-01-10 09:15:28,549 DEBUG [main] regionserver.HStore(494): loaded /user/apurtell/TestMergeTool/1720306167/contents/info/1602692123535894809, isReference=false, sequence id=2, length=204, majorCompaction=false 2009-01-10 09:15:28,551 DEBUG [main] regionserver.HStore(232): Loaded 1 file(s) in hstore 1720306167/contents, max sequence id 2 2009-01-10 09:15:28,572 DEBUG [main] regionserver.HRegion(299): Next sequence id for region TestMergeTool,row_0200,1231578915517 is 3 2009-01-10 09:15:28,574 INFO [main] regionserver.HRegion(321): region TestMergeTool,row_0200,1231578915517/1720306167 available 2009-01-10 09:15:28,575 DEBUG [main] regionserver.HRegion(2218): Opening region: REGION => {NAME => 'TestMergeTool,row_0250,1231578915517', STARTKEY => 'row_0250', ENDKEY => 'row_0400', ENCODED => 351183197, TABLE => {{NAME => 'TestMergeTool', IS_ROOT => 'false', IS_META => 'false', FAMILIES => [{NAME => 'contents', BLOOMFILTER => 'false', VERSIONS => '3', COMPRESSION => 'NONE', LENGTH => '2147483647', TTL => '-1', IN_MEMORY => 'false', BLOCKCACHE => 'true'}], INDEXES => []}} 2009-01-10 09:15:28,576 DEBUG [main] regionserver.HRegion(238): Opening region TestMergeTool,row_0250,1231578915517/351183197 2009-01-10 09:15:28,596 DEBUG [main] regionserver.HStore(494): loaded /user/apurtell/TestMergeTool/351183197/contents/info/7607624623349130512, isReference=false, sequence id=2, length=204, majorCompaction=false 2009-01-10 09:15:28,598 DEBUG [main] regionserver.HStore(232): Loaded 1 file(s) in hstore 351183197/contents, max sequence id 2 2009-01-10 09:15:28,612 DEBUG [main] regionserver.HRegion(299): Next sequence id for region TestMergeTool,row_0250,1231578915517 is 3 2009-01-10 09:15:28,614 INFO [main] regionserver.HRegion(321): region TestMergeTool,row_0250,1231578915517/351183197 available 2009-01-10 09:15:28,614 INFO [main] regionserver.HRegion(719): starting major compaction on region TestMergeTool,row_0200,1231578915517 2009-01-10 09:15:28,618 DEBUG [main] regionserver.HRegion(392): Closing TestMergeTool,row_0250,1231578915517: compactions & flushes disabled 2009-01-10 09:15:28,619 DEBUG [main] regionserver.HRegion(422): Updates disabled for region, no outstanding scanners on TestMergeTool,row_0250,1231578915517 2009-01-10 09:15:28,619 DEBUG [main] regionserver.HRegion(429): No more row locks outstanding on region TestMergeTool,row_0250,1231578915517 2009-01-10 09:15:28,619 DEBUG [main] regionserver.HStore(600): closed 351183197/contents 2009-01-10 09:15:28,620 INFO [main] regionserver.HRegion(441): Closed TestMergeTool,row_0250,1231578915517 2009-01-10 09:15:28,620 DEBUG [main] regionserver.HRegion(392): Closing TestMergeTool,row_0200,1231578915517: compactions & flushes disabled 2009-01-10 09:15:28,621 DEBUG [main] regionserver.HRegion(422): Updates disabled for region, no outstanding scanners on TestMergeTool,row_0200,1231578915517 2009-01-10 09:15:28,621 DEBUG [main] regionserver.HRegion(429): No more row locks outstanding on region TestMergeTool,row_0200,1231578915517 2009-01-10 09:15:28,621 DEBUG [main] regionserver.HStore(600): closed 1720306167/contents 2009-01-10 09:15:28,621 INFO [main] regionserver.HRegion(441): Closed TestMergeTool,row_0200,1231578915517 2009-01-10 09:15:28,622 FATAL [main] util.Merge(110): Merge failed java.lang.ArrayIndexOutOfBoundsException: 2 at org.apache.hadoop.hbase.regionserver.HStore.compact(HStore.java:872) at org.apache.hadoop.hbase.regionserver.HRegion.compactStores(HRegion.java:725) at org.apache.hadoop.hbase.regionserver.HRegion.merge(HRegion.java:2455) at org.apache.hadoop.hbase.util.Merge.merge(Merge.java:274) at org.apache.hadoop.hbase.util.Merge.mergeTwoRegions(Merge.java:225) at org.apache.hadoop.hbase.util.Merge.run(Merge.java:106) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79) at org.apache.hadoop.hbase.util.TestMergeTool.mergeAndVerify(TestMergeTool.java:159) at org.apache.hadoop.hbase.util.TestMergeTool.testMergeTool(TestMergeTool.java:211) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at junit.framework.TestCase.runTest(TestCase.java:154) at junit.framework.TestCase.runBare(TestCase.java:127) at junit.framework.TestResult$1.protect(TestResult.java:106) at junit.framework.TestResult.runProtected(TestResult.java:124) at junit.framework.TestResult.run(TestResult.java:109) at junit.framework.TestCase.run(TestCase.java:118) at junit.framework.TestSuite.runTest(TestSuite.java:208) at junit.framework.TestSuite.run(TestSuite.java:203) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:421) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:912) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:766) 2009-01-10 09:15:28,624 DEBUG [main] regionserver.HRegion(2218): Opening region: REGION => {NAME => '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED => 1028785192, TABLE => {{NAME => '.META.', IS_ROOT => 'false', IS_META => 'true', FAMILIES => [{NAME => 'info', BLOOMFILTER => 'false', COMPRESSION => 'NONE', VERSIONS => '10', LENGTH => '2147483647', TTL => '-1', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'historian', BLOOMFILTER => 'false', COMPRESSION => 'NONE', VERSIONS => '2147483647', LENGTH => '2147483647', TTL => '604800', IN_MEMORY => 'false', BLOCKCACHE => 'false'}], INDEXES => []}} 2009-01-10 09:15:28,625 DEBUG [main] regionserver.HRegion(238): Opening region .META.,,1/1028785192 2009-01-10 09:15:28,637 DEBUG [main] regionserver.HStore(494): loaded /user/apurtell/.META./1028785192/info/info/8095733044724918755, isReference=false, sequence id=5, length=1948, majorCompaction=false 2009-01-10 09:15:28,638 DEBUG [main] regionserver.HStore(232): Loaded 1 file(s) in hstore 1028785192/info, max sequence id 5 2009-01-10 09:15:28,652 DEBUG [main] regionserver.HRegion(299): Next sequence id for region .META.,,1 is 6 2009-01-10 09:15:28,653 INFO [main] regionserver.HRegion(321): region .META.,,1/1028785192 available 2009-01-10 09:15:28,653 INFO [main] regionserver.HRegion(719): starting compaction on region .META.,,1 2009-01-10 09:15:28,654 DEBUG [main] regionserver.HStore(828): 1028785192/historian: no store files to compact 2009-01-10 09:15:28,655 INFO [main] regionserver.HRegion(734): compaction completed on region .META.,,1 in 0sec REGION => {NAME => 'TestMergeTool,,1231578915517', STARTKEY => '', ENDKEY => '', ENCODED => 1885949095, TABLE => {{NAME => 'TestMergeTool', IS_ROOT => 'false', IS_META => 'false', FAMILIES => [{NAME => 'contents', BLOOMFILTER => 'false', VERSIONS => '3', COMPRESSION => 'NONE', LENGTH => '2147483647', TTL => '-1', IN_MEMORY => 'false', BLOCKCACHE => 'true'}], INDEXES => []}} REGION => {NAME => 'TestMergeTool,row_0100,1231578915517', STARTKEY => 'row_0100', ENDKEY => 'row_0200', ENCODED => 2108696795, TABLE => {{NAME => 'TestMergeTool', IS_ROOT => 'false', IS_META => 'false', FAMILIES => [{NAME => 'contents', BLOOMFILTER => 'false', VERSIONS => '3', COMPRESSION => 'NONE', LENGTH => '2147483647', TTL => '-1', IN_MEMORY => 'false', BLOCKCACHE => 'true'}], INDEXES => []}} REGION => {NAME => 'TestMergeTool,row_0200,1231578915517', STARTKEY => 'row_0200', ENDKEY => 'row_0300', ENCODED => 1720306167, TABLE => {{NAME => 'TestMergeTool', IS_ROOT => 'false', IS_META => 'false', FAMILIES => [{NAME => 'contents', BLOOMFILTER => 'false', VERSIONS => '3', COMPRESSION => 'NONE', LENGTH => '2147483647', TTL => '-1', IN_MEMORY => 'false', BLOCKCACHE => 'true'}], INDEXES => []}} REGION => {NAME => 'TestMergeTool,row_0250,1231578915517', STARTKEY => 'row_0250', ENDKEY => 'row_0400', ENCODED => 351183197, TABLE => {{NAME => 'TestMergeTool', IS_ROOT => 'false', IS_META => 'false', FAMILIES => [{NAME => 'contents', BLOOMFILTER => 'false', VERSIONS => '3', COMPRESSION => 'NONE', LENGTH => '2147483647', TTL => '-1', IN_MEMORY => 'false', BLOCKCACHE => 'true'}], INDEXES => []}} REGION => {NAME => 'TestMergeTool,row_0500,1231578915517', STARTKEY => 'row_0500', ENDKEY => 'row_0600', ENCODED => 1669458906, TABLE => {{NAME => 'TestMergeTool', IS_ROOT => 'false', IS_META => 'false', FAMILIES => [{NAME => 'contents', BLOOMFILTER => 'false', VERSIONS => '3', COMPRESSION => 'NONE', LENGTH => '2147483647', TTL => '-1', IN_MEMORY => 'false', BLOCKCACHE => 'true'}], INDEXES => []}} 2009-01-10 09:15:28,662 DEBUG [main] regionserver.HRegion(392): Closing -ROOT-,,0: compactions & flushes disabled 2009-01-10 09:15:28,662 DEBUG [main] regionserver.HRegion(422): Updates disabled for region, no outstanding scanners on -ROOT-,,0 2009-01-10 09:15:28,662 DEBUG [main] regionserver.HRegion(429): No more row locks outstanding on region -ROOT-,,0 2009-01-10 09:15:28,663 DEBUG [main] regionserver.HStore(600): closed 70236052/info 2009-01-10 09:15:28,663 INFO [main] regionserver.HRegion(441): Closed -ROOT-,,0 2009-01-10 09:15:28,663 DEBUG [main] regionserver.HRegion(392): Closing .META.,,1: compactions & flushes disabled 2009-01-10 09:15:28,663 DEBUG [main] regionserver.HRegion(422): Updates disabled for region, no outstanding scanners on .META.,,1 2009-01-10 09:15:28,663 DEBUG [main] regionserver.HRegion(429): No more row locks outstanding on region .META.,,1 2009-01-10 09:15:28,664 DEBUG [main] regionserver.HStore(600): closed 1028785192/historian 2009-01-10 09:15:28,664 DEBUG [main] regionserver.HStore(600): closed 1028785192/info 2009-01-10 09:15:28,664 INFO [main] regionserver.HRegion(441): Closed .META.,,1 2009-01-10 09:15:28,677 INFO [main] regionserver.HLog(265): Closed hdfs://localhost.localdomain:53096/user/apurtell/log_1231578928384/hlog.dat.0, entries=0. New log writer: /user/apurtell/log_1231578928384/hlog.dat.1231578928674 2009-01-10 09:15:28,678 DEBUG [main] regionserver.HLog(272): Last sequence written is empty. Deleting all old hlogs 2009-01-10 09:15:28,678 INFO [main] regionserver.HLog(383): removing old log file /user/apurtell/log_1231578928384/hlog.dat.0 whose highest sequence/edit id is 5 2009-01-10 09:15:28,679 DEBUG [main] regionserver.HLog(419): closing log writer in hdfs://localhost.localdomain:53096/user/apurtell/log_1231578928384 2009-01-10 09:15:28,687 DEBUG [main] regionserver.HLog(419): closing log writer in /tmp/log_1231578918227 2009-01-10 09:15:28,696 INFO [main] hbase.HBaseTestCase(600): Shutting down FileSystem 2009-01-10 09:15:28,697 INFO [main] hbase.HBaseTestCase(607): Shutting down Mini DFS 2009-01-10 09:15:28,697 INFO [Acceptor ServerSocket[addr=localhost.localdomain/127.0.0.1,port=0,localport=47483]] util.ThreadedServer$Acceptor(656): Stopping Acceptor ServerSocket[addr=localhost.localdomain/127.0.0.1,port=0,localport=47483] 2009-01-10 09:15:28,701 INFO [main] http.SocketListener(212): Stopped SocketListener on 127.0.0.1:47483 2009-01-10 09:15:28,702 INFO [main] util.Container(156): Stopped org.mortbay.jetty.servlet.WebApplicationHandler@60c9630a 2009-01-10 09:15:28,783 INFO [main] util.Container(156): Stopped WebApplicationContext[/static,/static] 2009-01-10 09:15:28,785 INFO [main] util.Container(156): Stopped org.mortbay.jetty.servlet.WebApplicationHandler@3d8f1be9 2009-01-10 09:15:28,875 INFO [main] util.Container(156): Stopped WebApplicationContext[/,/] 2009-01-10 09:15:28,875 INFO [main] util.Container(156): Stopped org.mortbay.jetty.Server@31f9338f 2009-01-10 09:15:28,876 WARN [org.apache.hadoop.hdfs.server.datanode.DataXceiverServer@ad72200] datanode.DataXceiverServer(134): DatanodeRegistration(127.0.0.1:55043, storageID=DS-682521903-10.30.94.2-55043-1231578917317, infoPort=47483, ipcPort=59143):DataXceiveServer: java.nio.channels.AsynchronousCloseException at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:152) at sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84) at org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:129) at java.lang.Thread.run(Thread.java:619) 2009-01-10 09:15:29,879 INFO [Acceptor ServerSocket[addr=localhost.localdomain/127.0.0.1,port=0,localport=59889]] util.ThreadedServer$Acceptor(656): Stopping Acceptor ServerSocket[addr=localhost.localdomain/127.0.0.1,port=0,localport=59889] 2009-01-10 09:15:29,879 INFO [main] http.SocketListener(212): Stopped SocketListener on 127.0.0.1:59889 2009-01-10 09:15:29,880 INFO [main] util.Container(156): Stopped org.mortbay.jetty.servlet.WebApplicationHandler@72e5355f 2009-01-10 09:15:29,944 INFO [main] util.Container(156): Stopped WebApplicationContext[/static,/static] 2009-01-10 09:15:29,945 INFO [main] util.Container(156): Stopped org.mortbay.jetty.servlet.WebApplicationHandler@ae0e515 2009-01-10 09:15:30,006 INFO [main] util.Container(156): Stopped WebApplicationContext[/,/] 2009-01-10 09:15:30,007 INFO [main] util.Container(156): Stopped org.mortbay.jetty.Server@3e0d1329 2009-01-10 09:15:30,008 WARN [org.apache.hadoop.hdfs.server.datanode.DataXceiverServer@6f57b46f] datanode.DataXceiverServer(134): DatanodeRegistration(127.0.0.1:58299, storageID=DS-975478263-10.30.94.2-58299-1231578917080, infoPort=59889, ipcPort=59695):DataXceiveServer: java.nio.channels.AsynchronousCloseException at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:152) at sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84) at org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:129) at java.lang.Thread.run(Thread.java:619) 2009-01-10 09:15:31,113 INFO [Acceptor ServerSocket[addr=localhost.localdomain/127.0.0.1,port=0,localport=59548]] util.ThreadedServer$Acceptor(656): Stopping Acceptor ServerSocket[addr=localhost.localdomain/127.0.0.1,port=0,localport=59548] 2009-01-10 09:15:31,113 INFO [main] http.SocketListener(212): Stopped SocketListener on 127.0.0.1:59548 2009-01-10 09:15:31,114 INFO [main] util.Container(156): Stopped org.mortbay.jetty.servlet.WebApplicationHandler@9ac5f13 2009-01-10 09:15:31,172 INFO [main] util.Container(156): Stopped WebApplicationContext[/static,/static] 2009-01-10 09:15:31,172 INFO [main] util.Container(156): Stopped org.mortbay.jetty.servlet.WebApplicationHandler@5c28305d 2009-01-10 09:15:31,230 INFO [main] util.Container(156): Stopped WebApplicationContext[/,/] 2009-01-10 09:15:31,230 INFO [main] util.Container(156): Stopped org.mortbay.jetty.Server@774acfcd 2009-01-10 09:15:31,231 WARN [org.apache.hadoop.hdfs.server.namenode.FSNamesystem$ReplicationMonitor@7eda18ac] namenode.FSNamesystem$ReplicationMonitor(2300): ReplicationMonitor thread received InterruptedException.java.lang.InterruptedException: sleep interrupted ------------- ---------------- --------------- Testcase: testMergeTool took 15.813 sec FAILED 'merging regions 0 and 1' failed junit.framework.AssertionFailedError: 'merging regions 0 and 1' failed at org.apache.hadoop.hbase.util.TestMergeTool.mergeAndVerify(TestMergeTool.java:162) at org.apache.hadoop.hbase.util.TestMergeTool.testMergeTool(TestMergeTool.java:211)