Testsuite: org.apache.hadoop.hbase.regionserver.TestCompaction Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 7.017 sec ------------- Standard Output --------------- Starting DataNode 0 with dfs.data.dir: /usr/src/Hadoop/hbase-trunk/build/test/data/dfs/data/data1,/usr/src/Hadoop/hbase-trunk/build/test/data/dfs/data/data2 Starting DataNode 1 with dfs.data.dir: /usr/src/Hadoop/hbase-trunk/build/test/data/dfs/data/data3,/usr/src/Hadoop/hbase-trunk/build/test/data/dfs/data/data4 Shutting down the Mini HDFS Cluster Shutting down DataNode 1 Shutting down DataNode 0 ------------- ---------------- --------------- ------------- Standard Error ----------------- 2009-01-10 09:09:36,007 INFO [main] http.HttpServer(729): Version Jetty/5.1.4 2009-01-10 09:09:36,330 INFO [main] util.FileResource(60): Checking Resource aliases 2009-01-10 09:09:36,334 INFO [main] util.Container(74): Started org.mortbay.jetty.servlet.WebApplicationHandler@68a0864f 2009-01-10 09:09:36,359 INFO [main] util.Container(74): Started WebApplicationContext[/static,/static] 2009-01-10 09:09:36,470 INFO [main] util.Container(74): Started org.mortbay.jetty.servlet.WebApplicationHandler@5d6ea269 2009-01-10 09:09:36,473 INFO [main] util.Container(74): Started WebApplicationContext[/,/] 2009-01-10 09:09:36,475 INFO [main] http.SocketListener(204): Started SocketListener on 127.0.0.1:45055 2009-01-10 09:09:36,476 INFO [main] util.Container(74): Started org.mortbay.jetty.Server@208a0544 2009-01-10 09:09:36,728 INFO [main] http.HttpServer(729): Version Jetty/5.1.4 2009-01-10 09:09:36,893 INFO [main] util.Container(74): Started org.mortbay.jetty.servlet.WebApplicationHandler@343a9d95 2009-01-10 09:09:36,898 INFO [main] util.Container(74): Started WebApplicationContext[/static,/static] 2009-01-10 09:09:37,015 INFO [main] util.Container(74): Started org.mortbay.jetty.servlet.WebApplicationHandler@ef894ce 2009-01-10 09:09:37,018 INFO [main] util.Container(74): Started WebApplicationContext[/,/] 2009-01-10 09:09:37,018 INFO [main] http.SocketListener(204): Started SocketListener on 127.0.0.1:47138 2009-01-10 09:09:37,018 INFO [main] util.Container(74): Started org.mortbay.jetty.Server@4d98defc 2009-01-10 09:09:37,128 INFO [main] http.HttpServer(729): Version Jetty/5.1.4 2009-01-10 09:09:37,198 INFO [main] util.Container(74): Started org.mortbay.jetty.servlet.WebApplicationHandler@a21d23b 2009-01-10 09:09:37,199 INFO [main] util.Container(74): Started WebApplicationContext[/static,/static] 2009-01-10 09:09:37,411 INFO [main] util.Container(74): Started org.mortbay.jetty.servlet.WebApplicationHandler@6c04ab2f 2009-01-10 09:09:37,420 INFO [main] util.Container(74): Started WebApplicationContext[/,/] 2009-01-10 09:09:37,421 INFO [main] http.SocketListener(204): Started SocketListener on 127.0.0.1:38395 2009-01-10 09:09:37,421 INFO [main] util.Container(74): Started org.mortbay.jetty.Server@1fbb9696 2009-01-10 09:09:37,519 INFO [main] regionserver.HLog(265): New log writer: /user/apurtell/testCompaction/2007628639/log/hlog.dat.1231578577491 2009-01-10 09:09:37,520 DEBUG [main] regionserver.HRegion(238): Opening region testCompaction,,1231578577476/2007628639 2009-01-10 09:09:37,569 DEBUG [main] regionserver.HRegion(299): Next sequence id for region testCompaction,,1231578577476 is 0 2009-01-10 09:09:37,571 INFO [main] regionserver.HRegion(321): region testCompaction,,1231578577476/2007628639 available 2009-01-10 09:09:38,908 DEBUG [main] regionserver.HRegion(844): Started memcache flush for region testCompaction,,1231578577476. Current region memcache size 3.8m 2009-01-10 09:09:38,939 WARN [main] util.NativeCodeLoader(52): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2009-01-10 09:09:39,262 DEBUG [main] regionserver.HStore(696): Added /user/apurtell/testCompaction/2007628639/colfamily1/mapfiles/4219162672303838329 with 17576 entries, sequence id 17576, data size ~3.8m, file size 1.6m to testCompaction,,1231578577476 2009-01-10 09:09:39,263 DEBUG [main] regionserver.HRegion(921): Finished memcache flush of ~3.8m for region testCompaction,,1231578577476 in 356ms, sequence id=17576, compaction requested=false 2009-01-10 09:09:39,600 DEBUG [main] regionserver.HRegion(844): Started memcache flush for region testCompaction,,1231578577476. Current region memcache size 3.8m 2009-01-10 09:09:39,729 DEBUG [main] regionserver.HStore(696): Added /user/apurtell/testCompaction/2007628639/colfamily1/mapfiles/1975889150441109933 with 17576 entries, sequence id 35153, data size ~3.8m, file size 1.6m to testCompaction,,1231578577476 2009-01-10 09:09:39,730 DEBUG [main] regionserver.HRegion(921): Finished memcache flush of ~3.8m for region testCompaction,,1231578577476 in 130ms, sequence id=35153, compaction requested=false 2009-01-10 09:09:39,949 DEBUG [main] regionserver.HRegion(844): Started memcache flush for region testCompaction,,1231578577476. Current region memcache size 3.8m 2009-01-10 09:09:40,095 DEBUG [main] regionserver.HStore(696): Added /user/apurtell/testCompaction/2007628639/colfamily1/mapfiles/5162146764355764469 with 17576 entries, sequence id 52730, data size ~3.8m, file size 1.6m to testCompaction,,1231578577476 2009-01-10 09:09:40,095 DEBUG [main] regionserver.HRegion(921): Finished memcache flush of ~3.8m for region testCompaction,,1231578577476 in 146ms, sequence id=52730, compaction requested=true 2009-01-10 09:09:40,378 DEBUG [main] regionserver.HRegion(844): Started memcache flush for region testCompaction,,1231578577476. Current region memcache size 3.8m 2009-01-10 09:09:40,505 DEBUG [main] regionserver.HStore(696): Added /user/apurtell/testCompaction/2007628639/colfamily1/mapfiles/1620140912503062429 with 17576 entries, sequence id 70307, data size ~3.8m, file size 1.6m to testCompaction,,1231578577476 2009-01-10 09:09:40,505 DEBUG [main] regionserver.HRegion(921): Finished memcache flush of ~3.8m for region testCompaction,,1231578577476 in 127ms, sequence id=70307, compaction requested=true 2009-01-10 09:09:40,788 DEBUG [main] regionserver.HRegion(844): Started memcache flush for region testCompaction,,1231578577476. Current region memcache size 3.8m 2009-01-10 09:09:40,968 DEBUG [main] regionserver.HStore(696): Added /user/apurtell/testCompaction/2007628639/colfamily1/mapfiles/3687292569522218339 with 17576 entries, sequence id 87884, data size ~3.8m, file size 1.6m to testCompaction,,1231578577476 2009-01-10 09:09:40,969 DEBUG [main] regionserver.HRegion(921): Finished memcache flush of ~3.8m for region testCompaction,,1231578577476 in 181ms, sequence id=87884, compaction requested=true 2009-01-10 09:09:40,969 INFO [main] regionserver.HRegion(719): starting compaction on region testCompaction,,1231578577476 2009-01-10 09:09:40,970 DEBUG [main] regionserver.HStore(828): 2007628639/colfamily2: no store files to compact 2009-01-10 09:09:40,977 DEBUG [main] regionserver.HRegion(392): Closing testCompaction,,1231578577476: compactions & flushes disabled 2009-01-10 09:09:40,977 DEBUG [main] regionserver.HRegion(422): Updates disabled for region, no outstanding scanners on testCompaction,,1231578577476 2009-01-10 09:09:40,978 DEBUG [main] regionserver.HRegion(429): No more row locks outstanding on region testCompaction,,1231578577476 2009-01-10 09:09:40,978 DEBUG [main] regionserver.HStore(600): closed 2007628639/colfamily2 2009-01-10 09:09:40,979 DEBUG [main] regionserver.HStore(600): closed 2007628639/colfamily1 2009-01-10 09:09:40,979 DEBUG [main] regionserver.HStore(600): closed 2007628639/colfamily3 2009-01-10 09:09:40,980 INFO [main] regionserver.HRegion(441): Closed testCompaction,,1231578577476 2009-01-10 09:09:40,980 DEBUG [main] regionserver.HLog(419): closing log writer in hdfs://localhost.localdomain:42700/user/apurtell/testCompaction/2007628639/log 2009-01-10 09:09:40,987 INFO [main] hbase.HBaseTestCase(600): Shutting down FileSystem 2009-01-10 09:09:40,987 INFO [main] hbase.HBaseTestCase(607): Shutting down Mini DFS 2009-01-10 09:09:40,988 INFO [Acceptor ServerSocket[addr=localhost.localdomain/127.0.0.1,port=0,localport=38395]] util.ThreadedServer$Acceptor(656): Stopping Acceptor ServerSocket[addr=localhost.localdomain/127.0.0.1,port=0,localport=38395] 2009-01-10 09:09:40,991 INFO [main] http.SocketListener(212): Stopped SocketListener on 127.0.0.1:38395 2009-01-10 09:09:40,992 INFO [main] util.Container(156): Stopped org.mortbay.jetty.servlet.WebApplicationHandler@a21d23b 2009-01-10 09:09:41,109 INFO [main] util.Container(156): Stopped WebApplicationContext[/static,/static] 2009-01-10 09:09:41,110 INFO [main] util.Container(156): Stopped org.mortbay.jetty.servlet.WebApplicationHandler@6c04ab2f 2009-01-10 09:09:41,180 INFO [main] util.Container(156): Stopped WebApplicationContext[/,/] 2009-01-10 09:09:41,181 INFO [main] util.Container(156): Stopped org.mortbay.jetty.Server@1fbb9696 2009-01-10 09:09:41,182 WARN [org.apache.hadoop.hdfs.server.datanode.DataXceiverServer@df82ab4] datanode.DataXceiverServer(134): DatanodeRegistration(127.0.0.1:53345, storageID=DS-225214018-10.30.94.2-53345-1231578577425, infoPort=38395, ipcPort=32869):DataXceiveServer: java.nio.channels.AsynchronousCloseException at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:152) at sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84) at org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:129) at java.lang.Thread.run(Thread.java:619) 2009-01-10 09:09:41,183 INFO [Acceptor ServerSocket[addr=localhost.localdomain/127.0.0.1,port=0,localport=47138]] util.ThreadedServer$Acceptor(656): Stopping Acceptor ServerSocket[addr=localhost.localdomain/127.0.0.1,port=0,localport=47138] 2009-01-10 09:09:41,184 INFO [main] http.SocketListener(212): Stopped SocketListener on 127.0.0.1:47138 2009-01-10 09:09:41,185 INFO [main] util.Container(156): Stopped org.mortbay.jetty.servlet.WebApplicationHandler@343a9d95 2009-01-10 09:09:41,248 INFO [main] util.Container(156): Stopped WebApplicationContext[/static,/static] 2009-01-10 09:09:41,249 INFO [main] util.Container(156): Stopped org.mortbay.jetty.servlet.WebApplicationHandler@ef894ce 2009-01-10 09:09:41,308 INFO [main] util.Container(156): Stopped WebApplicationContext[/,/] 2009-01-10 09:09:41,308 INFO [main] util.Container(156): Stopped org.mortbay.jetty.Server@4d98defc 2009-01-10 09:09:41,309 WARN [org.apache.hadoop.hdfs.server.datanode.DataXceiverServer@17353249] datanode.DataXceiverServer(134): DatanodeRegistration(127.0.0.1:59267, storageID=DS-1342388942-10.30.94.2-59267-1231578577036, infoPort=47138, ipcPort=53053):DataXceiveServer: java.nio.channels.AsynchronousCloseException at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:152) at sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84) at org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:129) at java.lang.Thread.run(Thread.java:619) 2009-01-10 09:09:42,415 INFO [Acceptor ServerSocket[addr=localhost.localdomain/127.0.0.1,port=0,localport=45055]] util.ThreadedServer$Acceptor(656): Stopping Acceptor ServerSocket[addr=localhost.localdomain/127.0.0.1,port=0,localport=45055] 2009-01-10 09:09:42,415 INFO [main] http.SocketListener(212): Stopped SocketListener on 127.0.0.1:45055 2009-01-10 09:09:42,416 INFO [main] util.Container(156): Stopped org.mortbay.jetty.servlet.WebApplicationHandler@68a0864f 2009-01-10 09:09:42,475 INFO [main] util.Container(156): Stopped WebApplicationContext[/static,/static] 2009-01-10 09:09:42,476 INFO [main] util.Container(156): Stopped org.mortbay.jetty.servlet.WebApplicationHandler@5d6ea269 2009-01-10 09:09:42,535 INFO [main] util.Container(156): Stopped WebApplicationContext[/,/] 2009-01-10 09:09:42,536 INFO [main] util.Container(156): Stopped org.mortbay.jetty.Server@208a0544 2009-01-10 09:09:42,536 WARN [org.apache.hadoop.hdfs.server.namenode.FSNamesystem$ReplicationMonitor@7c5b0668] namenode.FSNamesystem$ReplicationMonitor(2300): ReplicationMonitor thread received InterruptedException.java.lang.InterruptedException: sleep interrupted ------------- ---------------- --------------- Testcase: testCompaction took 7.009 sec Caused an ERROR 2 java.lang.ArrayIndexOutOfBoundsException: 2 at org.apache.hadoop.hbase.regionserver.HStore.compact(HStore.java:872) at org.apache.hadoop.hbase.regionserver.HRegion.compactStores(HRegion.java:725) at org.apache.hadoop.hbase.regionserver.HRegion.compactStores(HRegion.java:682) at org.apache.hadoop.hbase.regionserver.TestCompaction.testCompaction(TestCompaction.java:104)