[29/02/08 10:15:34] 0 [ main] INFO he.hadoop.hbase.master.HMaster - Root region dir: hdfs://localhost:53462/user/clint_morgan/-ROOT-/70236052 [29/02/08 10:15:34] 18 [ main] INFO he.hadoop.hbase.master.HMaster - bootstrap: creating ROOT and first META regions [29/02/08 10:15:34] 65 [ main] INFO hadoop.hbase.regionserver.HLog - new log writer created at hdfs://localhost:53462/user/clint_morgan/-ROOT-/70236052/log/hlog.dat.1204308934292 [29/02/08 10:15:34] 108 [ main] DEBUG doop.hbase.regionserver.HStore - starting 70236052/info (no reconstruction log) [29/02/08 10:15:34] 108 [ main] DEBUG doop.hbase.regionserver.HStore - infodir: hdfs://localhost:53462/user/clint_morgan/-ROOT-/70236052/info/info mapdir: hdfs://localhost:53462/user/clint_morgan/-ROOT-/70236052/info/mapfiles [29/02/08 10:15:34] 112 [ main] DEBUG doop.hbase.regionserver.HStore - maximum sequence id for hstore 70236052/info is -1 [29/02/08 10:15:34] 113 [ main] DEBUG oop.hbase.regionserver.HRegion - Next sequence id for region -ROOT-,,0 is 0 [29/02/08 10:15:34] 116 [ main] INFO oop.hbase.regionserver.HRegion - region -ROOT-,,0 available [29/02/08 10:15:34] 130 [ main] INFO hadoop.hbase.regionserver.HLog - new log writer created at hdfs://localhost:53462/user/clint_morgan/.META./1028785192/log/hlog.dat.1204308934382 [29/02/08 10:15:34] 146 [ main] DEBUG doop.hbase.regionserver.HStore - starting 1028785192/info (no reconstruction log) [29/02/08 10:15:34] 146 [ main] DEBUG doop.hbase.regionserver.HStore - infodir: hdfs://localhost:53462/user/clint_morgan/.META./1028785192/info/info mapdir: hdfs://localhost:53462/user/clint_morgan/.META./1028785192/info/mapfiles [29/02/08 10:15:34] 153 [ main] DEBUG doop.hbase.regionserver.HStore - maximum sequence id for hstore 1028785192/info is -1 [29/02/08 10:15:34] 154 [ main] DEBUG oop.hbase.regionserver.HRegion - Next sequence id for region .META.,,1 is 0 [29/02/08 10:15:34] 160 [ main] INFO oop.hbase.regionserver.HRegion - region .META.,,1 available [29/02/08 10:15:34] 169 [ main] DEBUG oop.hbase.regionserver.HRegion - compactions and cache flushes disabled for region -ROOT-,,0 [29/02/08 10:15:34] 169 [ main] DEBUG oop.hbase.regionserver.HRegion - new updates and scanners for region -ROOT-,,0 disabled [29/02/08 10:15:34] 169 [ main] DEBUG oop.hbase.regionserver.HRegion - no more active scanners for region -ROOT-,,0 [29/02/08 10:15:34] 169 [ main] DEBUG oop.hbase.regionserver.HRegion - no more row locks outstanding on region -ROOT-,,0 [29/02/08 10:15:34] 170 [ main] DEBUG oop.hbase.regionserver.HRegion - Started memcache flush for region -ROOT-,,0. Size 93.0 [29/02/08 10:15:34] 212 [ main] WARN e.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable [29/02/08 10:15:34] 335 [ main] DEBUG doop.hbase.regionserver.HStore - Added 70236052/info/3407629470412752928 with 1 entries, sequence id 1, and size 217.0 for 70236052/info [29/02/08 10:15:34] 335 [ main] DEBUG oop.hbase.regionserver.HRegion - Finished memcache flush for region -ROOT-,,0 in 166ms, sequenceid=1 [29/02/08 10:15:34] 337 [ main] DEBUG doop.hbase.regionserver.HStore - closed 70236052/info [29/02/08 10:15:34] 337 [ main] INFO oop.hbase.regionserver.HRegion - closed -ROOT-,,0 [29/02/08 10:15:34] 337 [ main] DEBUG hadoop.hbase.regionserver.HLog - closing log writer in hdfs://localhost:53462/user/clint_morgan/-ROOT-/70236052/log [29/02/08 10:15:34] 362 [ main] DEBUG oop.hbase.regionserver.HRegion - compactions and cache flushes disabled for region .META.,,1 [29/02/08 10:15:34] 362 [ main] DEBUG oop.hbase.regionserver.HRegion - new updates and scanners for region .META.,,1 disabled [29/02/08 10:15:34] 362 [ main] DEBUG oop.hbase.regionserver.HRegion - no more active scanners for region .META.,,1 [29/02/08 10:15:34] 363 [ main] DEBUG oop.hbase.regionserver.HRegion - no more row locks outstanding on region .META.,,1 [29/02/08 10:15:34] 363 [ main] DEBUG doop.hbase.regionserver.HStore - closed 1028785192/info [29/02/08 10:15:34] 363 [ main] INFO oop.hbase.regionserver.HRegion - closed .META.,,1 [29/02/08 10:15:34] 363 [ main] DEBUG hadoop.hbase.regionserver.HLog - closing log writer in hdfs://localhost:53462/user/clint_morgan/.META./1028785192/log [29/02/08 10:15:34] 473 [ main] INFO he.hadoop.hbase.master.HMaster - HMaster initialized on 0.0.0.0:60000 [29/02/08 10:15:34] 492 [ main] INFO apred.TestRowFilterAfterMapRed - Master is at 0.0.0.0:60000 [29/02/08 10:15:34] 492 [ RegionServer:0] DEBUG ase.regionserver.HRegionServer - Telling master at 0.0.0.0:60000 that we are up [29/02/08 10:15:34] 502 [ HMaster] DEBUG he.hadoop.hbase.master.HMaster - Started service threads [29/02/08 10:15:34] 502 [ HMaster] DEBUG he.hadoop.hbase.master.HMaster - Started service threads [29/02/08 10:15:34] 553 [dler 3 on 60000] INFO oop.hbase.master.ServerManager - received start message from: 10.0.1.199:53485 [29/02/08 10:15:34] 556 [ RegionServer:0] DEBUG ase.regionserver.HRegionServer - Done telling master we are up [29/02/08 10:15:34] 556 [ RegionServer:0] DEBUG ase.regionserver.HRegionServer - Config from master: fs.default.name=hdfs://localhost:53462/user/clint_morgan [29/02/08 10:15:34] 556 [ RegionServer:0] DEBUG ase.regionserver.HRegionServer - Config from master: hbase.rootdir=hdfs://localhost:53462/user/clint_morgan [29/02/08 10:15:34] 557 [ RegionServer:0] DEBUG ase.regionserver.HRegionServer - Log dir hdfs://localhost:53462/user/clint_morgan/log_10.0.1.199_1204308934747_53485 [29/02/08 10:15:34] 566 [ RegionServer:0] INFO hadoop.hbase.regionserver.HLog - new log writer created at hdfs://localhost:53462/user/clint_morgan/log_10.0.1.199_1204308934747_53485/hlog.dat.1204308934817 [29/02/08 10:15:34] 578 [ RegionServer:0] INFO ase.regionserver.HRegionServer - HRegionServer started at: 10.0.1.199:53485 [29/02/08 10:15:34] 585 [dler 0 on 60000] INFO oop.hbase.master.RegionManager - assigning region -ROOT-,,0 to the only server 10.0.1.199:53485 [29/02/08 10:15:34] 588 [Server:0.worker] INFO ase.regionserver.HRegionServer - MSG_REGION_OPEN : -ROOT-,,0 [29/02/08 10:15:34] 605 [Server:0.worker] DEBUG doop.hbase.regionserver.HStore - starting 70236052/info (no reconstruction log) [29/02/08 10:15:34] 605 [Server:0.worker] DEBUG doop.hbase.regionserver.HStore - infodir: hdfs://localhost:53462/user/clint_morgan/-ROOT-/70236052/info/info mapdir: hdfs://localhost:53462/user/clint_morgan/-ROOT-/70236052/info/mapfiles [29/02/08 10:15:34] 625 [Server:0.worker] DEBUG doop.hbase.regionserver.HStore - maximum sequence id for hstore 70236052/info is 1 [29/02/08 10:15:34] 642 [Server:0.worker] DEBUG oop.hbase.regionserver.HRegion - Next sequence id for region -ROOT-,,0 is 2 [29/02/08 10:15:34] 651 [Server:0.worker] INFO oop.hbase.regionserver.HRegion - region -ROOT-,,0 available [29/02/08 10:15:34] 653 [Server:0.worker] DEBUG hadoop.hbase.regionserver.HLog - changing sequence number from 0 to 2 [29/02/08 10:15:35] 1588 [dler 1 on 60000] DEBUG oop.hbase.master.ServerManager - Received MSG_REPORT_PROCESS_OPEN : -ROOT-,,0 from 10.0.1.199:53485 [29/02/08 10:15:35] 1588 [dler 1 on 60000] DEBUG oop.hbase.master.ServerManager - Received MSG_REPORT_OPEN : -ROOT-,,0 from 10.0.1.199:53485 [29/02/08 10:15:35] 1588 [dler 1 on 60000] INFO oop.hbase.master.ServerManager - 10.0.1.199:53485 serving -ROOT-,,0 [29/02/08 10:15:35] 1590 [ger.rootScanner] INFO adoop.hbase.master.BaseScanner - RegionManager.rootScanner scanning meta region {regionname: -ROOT-,,0, startKey: <>, server: 10.0.1.199:53485} [29/02/08 10:15:35] 1637 [ger.rootScanner] DEBUG adoop.hbase.master.BaseScanner - RegionManager.rootScanner regioninfo: {regionname: .META.,,1, startKey: <>, endKey: <>, encodedName: 1028785192, tableDesc: {name: .META., families: {info:={name: info, max versions: 1, compression: NONE, in memory: false, block cache enabled: false, max length: 2147483647, bloom filter: none}}}}, server: , startCode: -1 [29/02/08 10:15:35] 1637 [ger.rootScanner] DEBUG adoop.hbase.master.BaseScanner - Current assignment of .META.,,1 is not valid: storedInfo: null, startCode: -1, storedInfo.startCode: -1, unassignedRegions: false, pendingRegions: false [29/02/08 10:15:35] 1638 [ger.rootScanner] INFO adoop.hbase.master.BaseScanner - RegionManager.rootScanner scan of meta region {regionname: -ROOT-,,0, startKey: <>, server: 10.0.1.199:53485} complete [29/02/08 10:15:35] 1638 [ger.rootScanner] INFO adoop.hbase.master.BaseScanner - RegionManager.rootScanner scanning meta region {regionname: -ROOT-,,0, startKey: <>, server: 10.0.1.199:53485} [29/02/08 10:15:35] 1657 [ger.rootScanner] DEBUG adoop.hbase.master.BaseScanner - RegionManager.rootScanner regioninfo: {regionname: .META.,,1, startKey: <>, endKey: <>, encodedName: 1028785192, tableDesc: {name: .META., families: {info:={name: info, max versions: 1, compression: NONE, in memory: false, block cache enabled: false, max length: 2147483647, bloom filter: none}}}}, server: , startCode: -1 [29/02/08 10:15:35] 1660 [ger.rootScanner] INFO adoop.hbase.master.BaseScanner - RegionManager.rootScanner scan of meta region {regionname: -ROOT-,,0, startKey: <>, server: 10.0.1.199:53485} complete [29/02/08 10:15:36] 2592 [dler 2 on 60000] INFO oop.hbase.master.RegionManager - assigning region .META.,,1 to the only server 10.0.1.199:53485 [29/02/08 10:15:36] 2596 [Server:0.worker] INFO ase.regionserver.HRegionServer - MSG_REGION_OPEN : .META.,,1 [29/02/08 10:15:36] 2604 [Server:0.worker] DEBUG doop.hbase.regionserver.HStore - starting 1028785192/info (no reconstruction log) [29/02/08 10:15:36] 2604 [Server:0.worker] DEBUG doop.hbase.regionserver.HStore - infodir: hdfs://localhost:53462/user/clint_morgan/.META./1028785192/info/info mapdir: hdfs://localhost:53462/user/clint_morgan/.META./1028785192/info/mapfiles [29/02/08 10:15:36] 2606 [Server:0.worker] DEBUG doop.hbase.regionserver.HStore - maximum sequence id for hstore 1028785192/info is -1 [29/02/08 10:15:36] 2606 [Server:0.worker] DEBUG oop.hbase.regionserver.HRegion - Next sequence id for region .META.,,1 is 0 [29/02/08 10:15:36] 2607 [Server:0.worker] INFO oop.hbase.regionserver.HRegion - region .META.,,1 available [29/02/08 10:15:37] 3598 [dler 3 on 60000] DEBUG oop.hbase.master.ServerManager - Received MSG_REPORT_PROCESS_OPEN : .META.,,1 from 10.0.1.199:53485 [29/02/08 10:15:37] 3598 [dler 3 on 60000] DEBUG oop.hbase.master.ServerManager - Received MSG_REPORT_OPEN : .META.,,1 from 10.0.1.199:53485 [29/02/08 10:15:37] 3598 [dler 3 on 60000] INFO oop.hbase.master.ServerManager - 10.0.1.199:53485 serving .META.,,1 [29/02/08 10:15:37] 3602 [ HMaster] DEBUG he.hadoop.hbase.master.HMaster - Main processing loop: PendingOpenOperation from 10.0.1.199:53485 [29/02/08 10:15:37] 3603 [ HMaster] INFO e.master.RegionServerOperation - regionname: .META.,,1, startKey: <>, endKey: <>, encodedName: 1028785192, tableDesc: {name: .META., families: {info:={name: info, max versions: 1, compression: NONE, in memory: false, block cache enabled: false, max length: 2147483647, bloom filter: none}}} open on 10.0.1.199:53485 [29/02/08 10:15:37] 3603 [ HMaster] INFO e.master.RegionServerOperation - updating row .META.,,1 in table -ROOT-,,0 with startcode 1204308934747 and server 10.0.1.199:53485 [29/02/08 10:15:37] 3610 [ HMaster] DEBUG e.master.RegionServerOperation - Adding {regionname: .META.,,1, startKey: <>, server: 10.0.1.199:53485} to regions to scan [29/02/08 10:15:37] 3610 [ger.metaScanner] INFO adoop.hbase.master.BaseScanner - RegionManager.metaScanner scanning meta region {regionname: .META.,,1, startKey: <>, server: 10.0.1.199:53485} [29/02/08 10:15:37] 3613 [ger.metaScanner] INFO adoop.hbase.master.BaseScanner - RegionManager.metaScanner scan of meta region {regionname: .META.,,1, startKey: <>, server: 10.0.1.199:53485} complete [29/02/08 10:15:37] 3613 [ger.metaScanner] INFO adoop.hbase.master.BaseScanner - RegionManager.metaScanner scanning meta region {regionname: .META.,,1, startKey: <>, server: 10.0.1.199:53485} [29/02/08 10:15:37] 3617 [ger.metaScanner] INFO adoop.hbase.master.BaseScanner - RegionManager.metaScanner scan of meta region {regionname: .META.,,1, startKey: <>, server: 10.0.1.199:53485} complete [29/02/08 10:15:37] 3617 [ger.metaScanner] INFO adoop.hbase.master.BaseScanner - all meta regions scanned [29/02/08 10:15:37] 3644 [dler 4 on 60000] INFO hadoop.hbase.regionserver.HLog - new log writer created at hdfs://localhost:53462/user/clint_morgan/TestTable/490073220/log/hlog.dat.1204308937896 [29/02/08 10:15:37] 3661 [dler 4 on 60000] DEBUG doop.hbase.regionserver.HStore - starting 490073220/C (no reconstruction log) [29/02/08 10:15:37] 3661 [dler 4 on 60000] DEBUG doop.hbase.regionserver.HStore - infodir: hdfs://localhost:53462/user/clint_morgan/TestTable/490073220/C/info mapdir: hdfs://localhost:53462/user/clint_morgan/TestTable/490073220/C/mapfiles [29/02/08 10:15:37] 3663 [dler 4 on 60000] DEBUG doop.hbase.regionserver.HStore - maximum sequence id for hstore 490073220/C is -1 [29/02/08 10:15:37] 3664 [dler 4 on 60000] DEBUG oop.hbase.regionserver.HRegion - Next sequence id for region TestTable,,1204308934811 is 0 [29/02/08 10:15:37] 3667 [dler 4 on 60000] INFO oop.hbase.regionserver.HRegion - region TestTable,,1204308934811 available [29/02/08 10:15:37] 3668 [dler 4 on 60000] DEBUG oop.hbase.regionserver.HRegion - compactions and cache flushes disabled for region TestTable,,1204308934811 [29/02/08 10:15:37] 3668 [dler 4 on 60000] DEBUG oop.hbase.regionserver.HRegion - new updates and scanners for region TestTable,,1204308934811 disabled [29/02/08 10:15:37] 3668 [dler 4 on 60000] DEBUG oop.hbase.regionserver.HRegion - no more active scanners for region TestTable,,1204308934811 [29/02/08 10:15:37] 3668 [dler 4 on 60000] DEBUG oop.hbase.regionserver.HRegion - no more row locks outstanding on region TestTable,,1204308934811 [29/02/08 10:15:37] 3668 [dler 4 on 60000] DEBUG doop.hbase.regionserver.HStore - closed 490073220/C [29/02/08 10:15:37] 3669 [dler 4 on 60000] INFO oop.hbase.regionserver.HRegion - closed TestTable,,1204308934811 [29/02/08 10:15:37] 3669 [dler 4 on 60000] DEBUG hadoop.hbase.regionserver.HLog - closing log writer in hdfs://localhost:53462/user/clint_morgan/TestTable/490073220/log [29/02/08 10:15:37] 3688 [dler 4 on 60000] INFO he.hadoop.hbase.master.HMaster - created table TestTable [29/02/08 10:15:38] 4603 [dler 2 on 60000] INFO oop.hbase.master.RegionManager - assigning region TestTable,,1204308934811 to the only server 10.0.1.199:53485 [29/02/08 10:15:38] 4604 [Server:0.worker] INFO ase.regionserver.HRegionServer - MSG_REGION_OPEN : TestTable,,1204308934811 [29/02/08 10:15:38] 4612 [Server:0.worker] DEBUG doop.hbase.regionserver.HStore - starting 490073220/C (no reconstruction log) [29/02/08 10:15:38] 4612 [Server:0.worker] DEBUG doop.hbase.regionserver.HStore - infodir: hdfs://localhost:53462/user/clint_morgan/TestTable/490073220/C/info mapdir: hdfs://localhost:53462/user/clint_morgan/TestTable/490073220/C/mapfiles [29/02/08 10:15:38] 4615 [Server:0.worker] DEBUG doop.hbase.regionserver.HStore - maximum sequence id for hstore 490073220/C is -1 [29/02/08 10:15:38] 4618 [Server:0.worker] DEBUG oop.hbase.regionserver.HRegion - Next sequence id for region TestTable,,1204308934811 is 0 [29/02/08 10:15:38] 4619 [Server:0.worker] INFO oop.hbase.regionserver.HRegion - region TestTable,,1204308934811 available [29/02/08 10:15:39] 5606 [dler 3 on 60000] DEBUG oop.hbase.master.ServerManager - Received MSG_REPORT_PROCESS_OPEN : TestTable,,1204308934811 from 10.0.1.199:53485 [29/02/08 10:15:39] 5606 [dler 3 on 60000] DEBUG oop.hbase.master.ServerManager - Received MSG_REPORT_OPEN : TestTable,,1204308934811 from 10.0.1.199:53485 [29/02/08 10:15:39] 5607 [dler 3 on 60000] INFO oop.hbase.master.ServerManager - 10.0.1.199:53485 serving TestTable,,1204308934811 [29/02/08 10:15:39] 5608 [ HMaster] DEBUG he.hadoop.hbase.master.HMaster - Main processing loop: PendingOpenOperation from 10.0.1.199:53485 [29/02/08 10:15:39] 5608 [ HMaster] INFO e.master.RegionServerOperation - regionname: TestTable,,1204308934811, startKey: <>, endKey: <>, encodedName: 490073220, tableDesc: {name: TestTable, families: {C:={name: C, max versions: 3, compression: NONE, in memory: false, block cache enabled: false, max length: 2147483647, bloom filter: none}}} open on 10.0.1.199:53485 [29/02/08 10:15:39] 5608 [ HMaster] DEBUG e.master.RegionServerOperation - numberOfMetaRegions: 1, onlineMetaRegions.size(): 1 [29/02/08 10:15:39] 5609 [ HMaster] INFO e.master.RegionServerOperation - updating row TestTable,,1204308934811 in table .META.,,1 with startcode 1204308934747 and server 10.0.1.199:53485 [29/02/08 10:15:43] 8746 [ main] INFO apred.TestRowFilterAfterMapRed - Print table contents using scanner before map/reduce for TestTable [29/02/08 10:15:43] 8748 [ main] INFO che.hadoop.hbase.client.HTable - Creating scanner over TestTable starting at key [29/02/08 10:15:43] 8760 [ main] INFO apred.TestRowFilterAfterMapRed - Print table contents using scanner+filter before map/reduce for TestTable [29/02/08 10:15:43] 8762 [ main] INFO che.hadoop.hbase.client.HTable - Creating scanner over TestTable starting at key [29/02/08 10:15:43] 8831 [ main] DEBUG apache.hadoop.mapred.JobClient - default FileSystem: hdfs://localhost:53462 [29/02/08 10:15:43] 8835 [dler 0 on 53462] WARN .apache.hadoop.dfs.StateChange - DIR* FSDirectory.unprotectedDelete: failed to remove /tmp/hadoop-clint_morgan/mapred/system/job_local_1 because it does not exist [29/02/08 10:15:43] 8872 [ main] WARN apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). [29/02/08 10:15:43] 8923 [ main] DEBUG apache.hadoop.mapred.JobClient - Creating splits at hdfs://localhost:53462/tmp/hadoop-clint_morgan/mapred/system/job_local_1/job.split [29/02/08 10:15:43] 8969 [ main] DEBUG .hbase.mapred.TableInputFormat - split: 0->TestTable,, [29/02/08 10:15:43] 9193 [ main] INFO apache.hadoop.mapred.JobClient - Running job: job_local_1 [29/02/08 10:15:43] 9251 [ Thread-151] DEBUG .hbase.mapred.TableInputFormat - split: 0->TestTable,, [29/02/08 10:15:43] 9278 [ Thread-151] DEBUG g.apache.hadoop.mapred.MapTask - Writing local split to /tmp/hadoop-clint_morgan/mapred/system/job_local_1/split.dta [29/02/08 10:15:43] 9283 [ Thread-151] DEBUG pache.hadoop.mapred.TaskRunner - job_local_1_map_0000 Progress/ping thread started [29/02/08 10:15:43] 9283 [ Thread-151] INFO g.apache.hadoop.mapred.MapTask - numReduceTasks: 1 [29/02/08 10:15:43] 9299 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:43] 9300 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_OUTPUT_BYTES at 3 [29/02/08 10:15:43] 9307 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_OUTPUT_RECORDS at 1 [29/02/08 10:15:43] 9307 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding COMBINE_INPUT_RECORDS at 4 [29/02/08 10:15:43] 9307 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding COMBINE_OUTPUT_RECORDS at 5 [29/02/08 10:15:43] 9355 [ Thread-151] INFO che.hadoop.hbase.client.HTable - Creating scanner over TestTable starting at key [29/02/08 10:15:43] 9358 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_INPUT_RECORDS at 0 [29/02/08 10:15:43] 9358 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_INPUT_BYTES at 2 [29/02/08 10:15:43] 9451 [ Thread-151] DEBUG g.apache.hadoop.mapred.MapTask - opened spill0.out [29/02/08 10:15:43] 9479 [ Thread-151] INFO e.hadoop.mapred.LocalJobRunner - [29/02/08 10:15:43] 9479 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:43] 9480 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:43] 9480 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:43] 9480 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:43] 9480 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:43] 9480 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:43] 9480 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:43] 9480 [ Thread-151] INFO pache.hadoop.mapred.TaskRunner - Task 'job_local_1_map_0000' done. [29/02/08 10:15:43] 9488 [ Thread-151] INFO pache.hadoop.mapred.TaskRunner - Saved output of task 'job_local_1_map_0000' to hdfs://localhost:53462/user/clint_morgan/NEVER_REALLY_USED [29/02/08 10:15:43] 9488 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:43] 9488 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:43] 9488 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:43] 9489 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:43] 9489 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:43] 9489 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:43] 9489 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:43] 9505 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:43] 9506 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_INPUT_GROUPS at 6 [29/02/08 10:15:43] 9506 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_INPUT_RECORDS at 7 [29/02/08 10:15:43] 9506 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_OUTPUT_RECORDS at 8 [29/02/08 10:15:43] 9518 [ Thread-151] DEBUG pache.hadoop.mapred.TaskRunner - reduce_bs8pvk Progress/ping thread started [29/02/08 10:15:43] 9607 [ Thread-151] INFO e.hadoop.mapred.LocalJobRunner - reduce > reduce [29/02/08 10:15:43] 9607 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:43] 9607 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:43] 9607 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:43] 9607 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:43] 9607 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:43] 9607 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:43] 9607 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:43] 9607 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input groups at 6 [29/02/08 10:15:43] 9608 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input records at 7 [29/02/08 10:15:43] 9608 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce output records at 8 [29/02/08 10:15:43] 9608 [ Thread-151] INFO pache.hadoop.mapred.TaskRunner - Task 'reduce_bs8pvk' done. [29/02/08 10:15:43] 9616 [ Thread-151] INFO pache.hadoop.mapred.TaskRunner - Saved output of task 'reduce_bs8pvk' to hdfs://localhost:53462/user/clint_morgan/NEVER_REALLY_USED [29/02/08 10:15:43] 9616 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input groups at 6 [29/02/08 10:15:43] 9616 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input records at 7 [29/02/08 10:15:43] 9616 [ Thread-151] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce output records at 8 [29/02/08 10:15:44] 10196 [ main] INFO apache.hadoop.mapred.JobClient - Job complete: job_local_1 [29/02/08 10:15:44] 10196 [ main] INFO apache.hadoop.mapred.JobClient - Counters: 9 [29/02/08 10:15:44] 10196 [ main] INFO apache.hadoop.mapred.JobClient - Map-Reduce Framework [29/02/08 10:15:44] 10198 [ main] INFO apache.hadoop.mapred.JobClient - Map input records=10 [29/02/08 10:15:44] 10198 [ main] INFO apache.hadoop.mapred.JobClient - Map output records=10 [29/02/08 10:15:44] 10198 [ main] INFO apache.hadoop.mapred.JobClient - Map input bytes=0 [29/02/08 10:15:44] 10198 [ main] INFO apache.hadoop.mapred.JobClient - Map output bytes=850 [29/02/08 10:15:44] 10199 [ main] INFO apache.hadoop.mapred.JobClient - Combine input records=0 [29/02/08 10:15:44] 10199 [ main] INFO apache.hadoop.mapred.JobClient - Combine output records=0 [29/02/08 10:15:44] 10199 [ main] INFO apache.hadoop.mapred.JobClient - Reduce input groups=10 [29/02/08 10:15:44] 10199 [ main] INFO apache.hadoop.mapred.JobClient - Reduce input records=10 [29/02/08 10:15:44] 10199 [ main] INFO apache.hadoop.mapred.JobClient - Reduce output records=10 [29/02/08 10:15:44] 10290 [ main] DEBUG apache.hadoop.mapred.JobClient - default FileSystem: hdfs://localhost:53462 [29/02/08 10:15:44] 10295 [dler 6 on 53462] WARN .apache.hadoop.dfs.StateChange - DIR* FSDirectory.unprotectedDelete: failed to remove /tmp/hadoop-clint_morgan/mapred/system/job_local_2 because it does not exist [29/02/08 10:15:44] 10314 [ main] WARN apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). [29/02/08 10:15:44] 10363 [ main] DEBUG apache.hadoop.mapred.JobClient - Creating splits at hdfs://localhost:53462/tmp/hadoop-clint_morgan/mapred/system/job_local_2/job.split [29/02/08 10:15:44] 10392 [ main] DEBUG .hbase.mapred.TableInputFormat - split: 0->TestTable,, [29/02/08 10:15:44] 10516 [ main] INFO apache.hadoop.mapred.JobClient - Running job: job_local_2 [29/02/08 10:15:44] 10540 [ Thread-167] DEBUG .hbase.mapred.TableInputFormat - split: 0->TestTable,, [29/02/08 10:15:44] 10545 [ Thread-167] DEBUG g.apache.hadoop.mapred.MapTask - Writing local split to /tmp/hadoop-clint_morgan/mapred/system/job_local_2/split.dta [29/02/08 10:15:44] 10547 [ Thread-167] DEBUG pache.hadoop.mapred.TaskRunner - job_local_2_map_0000 Progress/ping thread started [29/02/08 10:15:44] 10548 [ Thread-167] INFO g.apache.hadoop.mapred.MapTask - numReduceTasks: 1 [29/02/08 10:15:44] 10548 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:44] 10548 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_OUTPUT_BYTES at 3 [29/02/08 10:15:44] 10548 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_OUTPUT_RECORDS at 1 [29/02/08 10:15:44] 10548 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding COMBINE_INPUT_RECORDS at 4 [29/02/08 10:15:44] 10549 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding COMBINE_OUTPUT_RECORDS at 5 [29/02/08 10:15:44] 10566 [ Thread-167] INFO che.hadoop.hbase.client.HTable - Creating scanner over TestTable starting at key [29/02/08 10:15:44] 10567 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_INPUT_RECORDS at 0 [29/02/08 10:15:44] 10567 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_INPUT_BYTES at 2 [29/02/08 10:15:44] 10588 [ Thread-167] DEBUG g.apache.hadoop.mapred.MapTask - opened spill0.out [29/02/08 10:15:44] 10600 [ Thread-167] INFO e.hadoop.mapred.LocalJobRunner - [29/02/08 10:15:44] 10601 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:44] 10601 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:44] 10604 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:44] 10604 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:44] 10605 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:44] 10605 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:44] 10605 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:44] 10605 [ Thread-167] INFO pache.hadoop.mapred.TaskRunner - Task 'job_local_2_map_0000' done. [29/02/08 10:15:44] 10613 [ Thread-167] INFO pache.hadoop.mapred.TaskRunner - Saved output of task 'job_local_2_map_0000' to hdfs://localhost:53462/user/clint_morgan/NEVER_REALLY_USED [29/02/08 10:15:44] 10613 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:44] 10613 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:44] 10613 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:44] 10613 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:44] 10613 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:44] 10614 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:44] 10614 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:44] 10630 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:44] 10630 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_INPUT_GROUPS at 6 [29/02/08 10:15:44] 10630 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_INPUT_RECORDS at 7 [29/02/08 10:15:44] 10630 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_OUTPUT_RECORDS at 8 [29/02/08 10:15:44] 10637 [ Thread-167] DEBUG pache.hadoop.mapred.TaskRunner - reduce_siyn2y Progress/ping thread started [29/02/08 10:15:44] 10690 [:0.cacheFlusher] DEBUG oop.hbase.regionserver.HRegion - Started memcache flush for region TestTable,,1204308934811. Size 1.0k [29/02/08 10:15:44] 10696 [ Thread-167] INFO e.hadoop.mapred.LocalJobRunner - reduce > reduce [29/02/08 10:15:44] 10696 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:44] 10696 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:44] 10696 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:44] 10696 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:44] 10696 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:44] 10696 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:44] 10697 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:44] 10702 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input groups at 6 [29/02/08 10:15:44] 10702 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input records at 7 [29/02/08 10:15:44] 10702 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce output records at 8 [29/02/08 10:15:44] 10703 [ Thread-167] INFO pache.hadoop.mapred.TaskRunner - Task 'reduce_siyn2y' done. [29/02/08 10:15:44] 10710 [ Thread-167] INFO pache.hadoop.mapred.TaskRunner - Saved output of task 'reduce_siyn2y' to hdfs://localhost:53462/user/clint_morgan/NEVER_REALLY_USED [29/02/08 10:15:44] 10711 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input groups at 6 [29/02/08 10:15:44] 10711 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input records at 7 [29/02/08 10:15:44] 10712 [ Thread-167] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce output records at 8 [29/02/08 10:15:45] 10826 [:0.cacheFlusher] DEBUG doop.hbase.regionserver.HStore - Added 490073220/C/5768610946762633373 with 36 entries, sequence id 43, and size 1.6k for 490073220/C [29/02/08 10:15:45] 10826 [:0.cacheFlusher] DEBUG oop.hbase.regionserver.HRegion - Finished memcache flush for region TestTable,,1204308934811 in 136ms, sequenceid=43 [29/02/08 10:15:45] 10826 [:0.cacheFlusher] DEBUG oop.hbase.regionserver.HRegion - Started memcache flush for region -ROOT-,,0. Size 89.0 [29/02/08 10:15:45] 10949 [:0.cacheFlusher] DEBUG doop.hbase.regionserver.HStore - Added 70236052/info/8309752010288932631 with 2 entries, sequence id 48, and size 227.0 for 70236052/info [29/02/08 10:15:45] 10949 [:0.cacheFlusher] DEBUG oop.hbase.regionserver.HRegion - Finished memcache flush for region -ROOT-,,0 in 123ms, sequenceid=48 [29/02/08 10:15:45] 11516 [ main] INFO apache.hadoop.mapred.JobClient - Job complete: job_local_2 [29/02/08 10:15:45] 11516 [ main] INFO apache.hadoop.mapred.JobClient - Counters: 9 [29/02/08 10:15:45] 11516 [ main] INFO apache.hadoop.mapred.JobClient - Map-Reduce Framework [29/02/08 10:15:45] 11516 [ main] INFO apache.hadoop.mapred.JobClient - Map input records=10 [29/02/08 10:15:45] 11517 [ main] INFO apache.hadoop.mapred.JobClient - Map output records=10 [29/02/08 10:15:45] 11517 [ main] INFO apache.hadoop.mapred.JobClient - Map input bytes=0 [29/02/08 10:15:45] 11517 [ main] INFO apache.hadoop.mapred.JobClient - Map output bytes=850 [29/02/08 10:15:45] 11517 [ main] INFO apache.hadoop.mapred.JobClient - Combine input records=0 [29/02/08 10:15:45] 11517 [ main] INFO apache.hadoop.mapred.JobClient - Combine output records=0 [29/02/08 10:15:45] 11517 [ main] INFO apache.hadoop.mapred.JobClient - Reduce input groups=10 [29/02/08 10:15:45] 11517 [ main] INFO apache.hadoop.mapred.JobClient - Reduce input records=10 [29/02/08 10:15:45] 11517 [ main] INFO apache.hadoop.mapred.JobClient - Reduce output records=10 [29/02/08 10:15:45] 11565 [ main] DEBUG apache.hadoop.mapred.JobClient - default FileSystem: hdfs://localhost:53462 [29/02/08 10:15:45] 11569 [dler 4 on 53462] WARN .apache.hadoop.dfs.StateChange - DIR* FSDirectory.unprotectedDelete: failed to remove /tmp/hadoop-clint_morgan/mapred/system/job_local_3 because it does not exist [29/02/08 10:15:45] 11586 [ main] WARN apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). [29/02/08 10:15:45] 11641 [ger.rootScanner] INFO adoop.hbase.master.BaseScanner - RegionManager.rootScanner scanning meta region {regionname: -ROOT-,,0, startKey: <>, server: 10.0.1.199:53485} [29/02/08 10:15:45] 11646 [ main] DEBUG apache.hadoop.mapred.JobClient - Creating splits at hdfs://localhost:53462/tmp/hadoop-clint_morgan/mapred/system/job_local_3/job.split [29/02/08 10:15:45] 11690 [ main] DEBUG .hbase.mapred.TableInputFormat - split: 0->TestTable,, [29/02/08 10:15:45] 11694 [ger.rootScanner] DEBUG adoop.hbase.master.BaseScanner - RegionManager.rootScanner regioninfo: {regionname: .META.,,1, startKey: <>, endKey: <>, encodedName: 1028785192, tableDesc: {name: .META., families: {info:={name: info, max versions: 1, compression: NONE, in memory: false, block cache enabled: false, max length: 2147483647, bloom filter: none}}}}, server: 10.0.1.199:53485, startCode: 1204308934747 [29/02/08 10:15:45] 11696 [ger.rootScanner] INFO adoop.hbase.master.BaseScanner - RegionManager.rootScanner scan of meta region {regionname: -ROOT-,,0, startKey: <>, server: 10.0.1.199:53485} complete [29/02/08 10:15:46] 11887 [ main] INFO apache.hadoop.mapred.JobClient - Running job: job_local_3 [29/02/08 10:15:46] 11916 [ Thread-228] DEBUG .hbase.mapred.TableInputFormat - split: 0->TestTable,, [29/02/08 10:15:46] 11925 [ Thread-228] DEBUG g.apache.hadoop.mapred.MapTask - Writing local split to /tmp/hadoop-clint_morgan/mapred/system/job_local_3/split.dta [29/02/08 10:15:46] 11930 [ Thread-228] DEBUG pache.hadoop.mapred.TaskRunner - job_local_3_map_0000 Progress/ping thread started [29/02/08 10:15:46] 11930 [ Thread-228] INFO g.apache.hadoop.mapred.MapTask - numReduceTasks: 1 [29/02/08 10:15:46] 11930 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:46] 11930 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_OUTPUT_BYTES at 3 [29/02/08 10:15:46] 11930 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_OUTPUT_RECORDS at 1 [29/02/08 10:15:46] 11930 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding COMBINE_INPUT_RECORDS at 4 [29/02/08 10:15:46] 11931 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding COMBINE_OUTPUT_RECORDS at 5 [29/02/08 10:15:46] 11979 [ Thread-228] INFO che.hadoop.hbase.client.HTable - Creating scanner over TestTable starting at key [29/02/08 10:15:46] 11990 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_INPUT_RECORDS at 0 [29/02/08 10:15:46] 11990 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_INPUT_BYTES at 2 [29/02/08 10:15:46] 12011 [ Thread-228] DEBUG g.apache.hadoop.mapred.MapTask - opened spill0.out [29/02/08 10:15:46] 12023 [ Thread-228] INFO e.hadoop.mapred.LocalJobRunner - [29/02/08 10:15:46] 12023 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:46] 12023 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:46] 12026 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:46] 12026 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:46] 12026 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:46] 12026 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:46] 12027 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:46] 12027 [ Thread-228] INFO pache.hadoop.mapred.TaskRunner - Task 'job_local_3_map_0000' done. [29/02/08 10:15:46] 12034 [ Thread-228] INFO pache.hadoop.mapred.TaskRunner - Saved output of task 'job_local_3_map_0000' to hdfs://localhost:53462/user/clint_morgan/NEVER_REALLY_USED [29/02/08 10:15:46] 12034 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:46] 12034 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:46] 12034 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:46] 12034 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:46] 12034 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:46] 12034 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:46] 12034 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:46] 12039 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:46] 12039 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_INPUT_GROUPS at 6 [29/02/08 10:15:46] 12039 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_INPUT_RECORDS at 7 [29/02/08 10:15:46] 12039 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_OUTPUT_RECORDS at 8 [29/02/08 10:15:46] 12044 [ Thread-228] DEBUG pache.hadoop.mapred.TaskRunner - reduce_vx1d9c Progress/ping thread started [29/02/08 10:15:46] 12081 [ Thread-228] INFO e.hadoop.mapred.LocalJobRunner - reduce > reduce [29/02/08 10:15:46] 12082 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:46] 12082 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:46] 12082 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:46] 12082 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:46] 12082 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:46] 12082 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:46] 12083 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:46] 12083 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input groups at 6 [29/02/08 10:15:46] 12083 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input records at 7 [29/02/08 10:15:46] 12083 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce output records at 8 [29/02/08 10:15:46] 12083 [ Thread-228] INFO pache.hadoop.mapred.TaskRunner - Task 'reduce_vx1d9c' done. [29/02/08 10:15:46] 12090 [ Thread-228] INFO pache.hadoop.mapred.TaskRunner - Saved output of task 'reduce_vx1d9c' to hdfs://localhost:53462/user/clint_morgan/NEVER_REALLY_USED [29/02/08 10:15:46] 12090 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input groups at 6 [29/02/08 10:15:46] 12091 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input records at 7 [29/02/08 10:15:46] 12091 [ Thread-228] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce output records at 8 [29/02/08 10:15:46] 12607 [:0.cacheFlusher] DEBUG oop.hbase.regionserver.HRegion - Started memcache flush for region .META.,,1. Size 242.0 [29/02/08 10:15:46] 12721 [:0.cacheFlusher] DEBUG doop.hbase.regionserver.HStore - Added 1028785192/info/675115605345832795 with 3 entries, sequence id 59, and size 394.0 for 1028785192/info [29/02/08 10:15:46] 12722 [:0.cacheFlusher] DEBUG oop.hbase.regionserver.HRegion - Finished memcache flush for region .META.,,1 in 115ms, sequenceid=59 [29/02/08 10:15:47] 12887 [ main] INFO apache.hadoop.mapred.JobClient - Job complete: job_local_3 [29/02/08 10:15:47] 12887 [ main] INFO apache.hadoop.mapred.JobClient - Counters: 9 [29/02/08 10:15:47] 12887 [ main] INFO apache.hadoop.mapred.JobClient - Map-Reduce Framework [29/02/08 10:15:47] 12888 [ main] INFO apache.hadoop.mapred.JobClient - Map input records=10 [29/02/08 10:15:47] 12888 [ main] INFO apache.hadoop.mapred.JobClient - Map output records=10 [29/02/08 10:15:47] 12888 [ main] INFO apache.hadoop.mapred.JobClient - Map input bytes=0 [29/02/08 10:15:47] 12888 [ main] INFO apache.hadoop.mapred.JobClient - Map output bytes=850 [29/02/08 10:15:47] 12888 [ main] INFO apache.hadoop.mapred.JobClient - Combine input records=0 [29/02/08 10:15:47] 12888 [ main] INFO apache.hadoop.mapred.JobClient - Combine output records=0 [29/02/08 10:15:47] 12888 [ main] INFO apache.hadoop.mapred.JobClient - Reduce input groups=10 [29/02/08 10:15:47] 12888 [ main] INFO apache.hadoop.mapred.JobClient - Reduce input records=10 [29/02/08 10:15:47] 12888 [ main] INFO apache.hadoop.mapred.JobClient - Reduce output records=10 [29/02/08 10:15:47] 12923 [ main] DEBUG apache.hadoop.mapred.JobClient - default FileSystem: hdfs://localhost:53462 [29/02/08 10:15:47] 12926 [dler 7 on 53462] WARN .apache.hadoop.dfs.StateChange - DIR* FSDirectory.unprotectedDelete: failed to remove /tmp/hadoop-clint_morgan/mapred/system/job_local_4 because it does not exist [29/02/08 10:15:47] 12933 [ main] WARN apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). [29/02/08 10:15:47] 12982 [ main] DEBUG apache.hadoop.mapred.JobClient - Creating splits at hdfs://localhost:53462/tmp/hadoop-clint_morgan/mapred/system/job_local_4/job.split [29/02/08 10:15:47] 13026 [ main] DEBUG .hbase.mapred.TableInputFormat - split: 0->TestTable,, [29/02/08 10:15:47] 13137 [ main] INFO apache.hadoop.mapred.JobClient - Running job: job_local_4 [29/02/08 10:15:47] 13173 [ Thread-268] DEBUG .hbase.mapred.TableInputFormat - split: 0->TestTable,, [29/02/08 10:15:47] 13185 [ Thread-268] DEBUG g.apache.hadoop.mapred.MapTask - Writing local split to /tmp/hadoop-clint_morgan/mapred/system/job_local_4/split.dta [29/02/08 10:15:47] 13187 [ Thread-268] DEBUG pache.hadoop.mapred.TaskRunner - job_local_4_map_0000 Progress/ping thread started [29/02/08 10:15:47] 13187 [ Thread-268] INFO g.apache.hadoop.mapred.MapTask - numReduceTasks: 1 [29/02/08 10:15:47] 13188 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:47] 13188 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_OUTPUT_BYTES at 3 [29/02/08 10:15:47] 13188 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_OUTPUT_RECORDS at 1 [29/02/08 10:15:47] 13188 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding COMBINE_INPUT_RECORDS at 4 [29/02/08 10:15:47] 13188 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding COMBINE_OUTPUT_RECORDS at 5 [29/02/08 10:15:47] 13231 [ Thread-268] INFO che.hadoop.hbase.client.HTable - Creating scanner over TestTable starting at key [29/02/08 10:15:47] 13255 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_INPUT_RECORDS at 0 [29/02/08 10:15:47] 13255 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_INPUT_BYTES at 2 [29/02/08 10:15:47] 13274 [ Thread-268] DEBUG g.apache.hadoop.mapred.MapTask - opened spill0.out [29/02/08 10:15:47] 13287 [ Thread-268] INFO e.hadoop.mapred.LocalJobRunner - [29/02/08 10:15:47] 13288 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:47] 13288 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:47] 13288 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:47] 13288 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:47] 13288 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:47] 13288 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:47] 13288 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:47] 13288 [ Thread-268] INFO pache.hadoop.mapred.TaskRunner - Task 'job_local_4_map_0000' done. [29/02/08 10:15:47] 13304 [ Thread-268] INFO pache.hadoop.mapred.TaskRunner - Saved output of task 'job_local_4_map_0000' to hdfs://localhost:53462/user/clint_morgan/NEVER_REALLY_USED [29/02/08 10:15:47] 13304 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:47] 13304 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:47] 13308 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:47] 13309 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:47] 13310 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:47] 13310 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:47] 13310 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:47] 13316 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:47] 13316 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_INPUT_GROUPS at 6 [29/02/08 10:15:47] 13316 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_INPUT_RECORDS at 7 [29/02/08 10:15:47] 13316 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_OUTPUT_RECORDS at 8 [29/02/08 10:15:47] 13321 [ Thread-268] DEBUG pache.hadoop.mapred.TaskRunner - reduce_37sbcp Progress/ping thread started [29/02/08 10:15:47] 13374 [ Thread-268] INFO e.hadoop.mapred.LocalJobRunner - reduce > reduce [29/02/08 10:15:47] 13374 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:47] 13374 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:47] 13377 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:47] 13377 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:47] 13377 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:47] 13378 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:47] 13378 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:47] 13378 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input groups at 6 [29/02/08 10:15:47] 13378 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input records at 7 [29/02/08 10:15:47] 13378 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce output records at 8 [29/02/08 10:15:47] 13378 [ Thread-268] INFO pache.hadoop.mapred.TaskRunner - Task 'reduce_37sbcp' done. [29/02/08 10:15:47] 13387 [ Thread-268] INFO pache.hadoop.mapred.TaskRunner - Saved output of task 'reduce_37sbcp' to hdfs://localhost:53462/user/clint_morgan/NEVER_REALLY_USED [29/02/08 10:15:47] 13387 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input groups at 6 [29/02/08 10:15:47] 13387 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input records at 7 [29/02/08 10:15:47] 13387 [ Thread-268] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce output records at 8 [29/02/08 10:15:47] 13613 [ger.metaScanner] INFO adoop.hbase.master.BaseScanner - RegionManager.metaScanner scanning meta region {regionname: .META.,,1, startKey: <>, server: 10.0.1.199:53485} [29/02/08 10:15:47] 13629 [ger.metaScanner] DEBUG adoop.hbase.master.BaseScanner - RegionManager.metaScanner regioninfo: {regionname: TestTable,,1204308934811, startKey: <>, endKey: <>, encodedName: 490073220, tableDesc: {name: TestTable, families: {C:={name: C, max versions: 3, compression: NONE, in memory: false, block cache enabled: false, max length: 2147483647, bloom filter: none}}}}, server: 10.0.1.199:53485, startCode: 1204308934747 [29/02/08 10:15:47] 13633 [ger.metaScanner] INFO adoop.hbase.master.BaseScanner - RegionManager.metaScanner scan of meta region {regionname: .META.,,1, startKey: <>, server: 10.0.1.199:53485} complete [29/02/08 10:15:47] 13633 [ger.metaScanner] INFO adoop.hbase.master.BaseScanner - all meta regions scanned [29/02/08 10:15:48] 14138 [ main] INFO apache.hadoop.mapred.JobClient - Job complete: job_local_4 [29/02/08 10:15:48] 14138 [ main] INFO apache.hadoop.mapred.JobClient - Counters: 9 [29/02/08 10:15:48] 14138 [ main] INFO apache.hadoop.mapred.JobClient - Map-Reduce Framework [29/02/08 10:15:48] 14138 [ main] INFO apache.hadoop.mapred.JobClient - Map input records=10 [29/02/08 10:15:48] 14138 [ main] INFO apache.hadoop.mapred.JobClient - Map output records=10 [29/02/08 10:15:48] 14138 [ main] INFO apache.hadoop.mapred.JobClient - Map input bytes=0 [29/02/08 10:15:48] 14138 [ main] INFO apache.hadoop.mapred.JobClient - Map output bytes=850 [29/02/08 10:15:48] 14138 [ main] INFO apache.hadoop.mapred.JobClient - Combine input records=0 [29/02/08 10:15:48] 14138 [ main] INFO apache.hadoop.mapred.JobClient - Combine output records=0 [29/02/08 10:15:48] 14138 [ main] INFO apache.hadoop.mapred.JobClient - Reduce input groups=10 [29/02/08 10:15:48] 14138 [ main] INFO apache.hadoop.mapred.JobClient - Reduce input records=10 [29/02/08 10:15:48] 14138 [ main] INFO apache.hadoop.mapred.JobClient - Reduce output records=10 [29/02/08 10:15:48] 14174 [ main] DEBUG apache.hadoop.mapred.JobClient - default FileSystem: hdfs://localhost:53462 [29/02/08 10:15:48] 14177 [dler 4 on 53462] WARN .apache.hadoop.dfs.StateChange - DIR* FSDirectory.unprotectedDelete: failed to remove /tmp/hadoop-clint_morgan/mapred/system/job_local_5 because it does not exist [29/02/08 10:15:48] 14181 [ main] WARN apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). [29/02/08 10:15:48] 14213 [ main] DEBUG apache.hadoop.mapred.JobClient - Creating splits at hdfs://localhost:53462/tmp/hadoop-clint_morgan/mapred/system/job_local_5/job.split [29/02/08 10:15:48] 14249 [ main] DEBUG .hbase.mapred.TableInputFormat - split: 0->TestTable,, [29/02/08 10:15:48] 14432 [ main] INFO apache.hadoop.mapred.JobClient - Running job: job_local_5 [29/02/08 10:15:48] 14471 [ Thread-291] DEBUG .hbase.mapred.TableInputFormat - split: 0->TestTable,, [29/02/08 10:15:48] 14481 [ Thread-291] DEBUG g.apache.hadoop.mapred.MapTask - Writing local split to /tmp/hadoop-clint_morgan/mapred/system/job_local_5/split.dta [29/02/08 10:15:48] 14485 [ Thread-291] DEBUG pache.hadoop.mapred.TaskRunner - job_local_5_map_0000 Progress/ping thread started [29/02/08 10:15:48] 14485 [ Thread-291] INFO g.apache.hadoop.mapred.MapTask - numReduceTasks: 1 [29/02/08 10:15:48] 14486 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:48] 14486 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_OUTPUT_BYTES at 3 [29/02/08 10:15:48] 14486 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_OUTPUT_RECORDS at 1 [29/02/08 10:15:48] 14486 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding COMBINE_INPUT_RECORDS at 4 [29/02/08 10:15:48] 14486 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding COMBINE_OUTPUT_RECORDS at 5 [29/02/08 10:15:48] 14526 [ Thread-291] INFO che.hadoop.hbase.client.HTable - Creating scanner over TestTable starting at key [29/02/08 10:15:48] 14543 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_INPUT_RECORDS at 0 [29/02/08 10:15:48] 14543 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_INPUT_BYTES at 2 [29/02/08 10:15:48] 14559 [ Thread-291] DEBUG g.apache.hadoop.mapred.MapTask - opened spill0.out [29/02/08 10:15:48] 14570 [ Thread-291] INFO e.hadoop.mapred.LocalJobRunner - [29/02/08 10:15:48] 14570 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:48] 14570 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:48] 14570 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:48] 14570 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:48] 14570 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:48] 14570 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:48] 14571 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:48] 14571 [ Thread-291] INFO pache.hadoop.mapred.TaskRunner - Task 'job_local_5_map_0000' done. [29/02/08 10:15:48] 14580 [ Thread-291] INFO pache.hadoop.mapred.TaskRunner - Saved output of task 'job_local_5_map_0000' to hdfs://localhost:53462/user/clint_morgan/NEVER_REALLY_USED [29/02/08 10:15:48] 14580 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:48] 14580 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:48] 14583 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:48] 14583 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:48] 14583 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:48] 14583 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:48] 14583 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:48] 14587 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:48] 14587 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_INPUT_GROUPS at 6 [29/02/08 10:15:48] 14587 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_INPUT_RECORDS at 7 [29/02/08 10:15:48] 14587 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_OUTPUT_RECORDS at 8 [29/02/08 10:15:48] 14593 [ Thread-291] DEBUG pache.hadoop.mapred.TaskRunner - reduce_noebbh Progress/ping thread started [29/02/08 10:15:48] 14635 [ Thread-291] INFO e.hadoop.mapred.LocalJobRunner - reduce > reduce [29/02/08 10:15:48] 14635 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:48] 14635 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:48] 14635 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:48] 14635 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:48] 14635 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:48] 14635 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:48] 14635 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:48] 14635 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input groups at 6 [29/02/08 10:15:48] 14636 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input records at 7 [29/02/08 10:15:48] 14636 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce output records at 8 [29/02/08 10:15:48] 14636 [ Thread-291] INFO pache.hadoop.mapred.TaskRunner - Task 'reduce_noebbh' done. [29/02/08 10:15:48] 14643 [ Thread-291] INFO pache.hadoop.mapred.TaskRunner - Saved output of task 'reduce_noebbh' to hdfs://localhost:53462/user/clint_morgan/NEVER_REALLY_USED [29/02/08 10:15:48] 14644 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input groups at 6 [29/02/08 10:15:48] 14646 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input records at 7 [29/02/08 10:15:48] 14646 [ Thread-291] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce output records at 8 [29/02/08 10:15:49] 15432 [ main] INFO apache.hadoop.mapred.JobClient - Job complete: job_local_5 [29/02/08 10:15:49] 15433 [ main] INFO apache.hadoop.mapred.JobClient - Counters: 9 [29/02/08 10:15:49] 15433 [ main] INFO apache.hadoop.mapred.JobClient - Map-Reduce Framework [29/02/08 10:15:49] 15433 [ main] INFO apache.hadoop.mapred.JobClient - Map input records=10 [29/02/08 10:15:49] 15433 [ main] INFO apache.hadoop.mapred.JobClient - Map output records=10 [29/02/08 10:15:49] 15433 [ main] INFO apache.hadoop.mapred.JobClient - Map input bytes=0 [29/02/08 10:15:49] 15433 [ main] INFO apache.hadoop.mapred.JobClient - Map output bytes=850 [29/02/08 10:15:49] 15433 [ main] INFO apache.hadoop.mapred.JobClient - Combine input records=0 [29/02/08 10:15:49] 15433 [ main] INFO apache.hadoop.mapred.JobClient - Combine output records=0 [29/02/08 10:15:49] 15433 [ main] INFO apache.hadoop.mapred.JobClient - Reduce input groups=10 [29/02/08 10:15:49] 15433 [ main] INFO apache.hadoop.mapred.JobClient - Reduce input records=10 [29/02/08 10:15:49] 15433 [ main] INFO apache.hadoop.mapred.JobClient - Reduce output records=10 [29/02/08 10:15:49] 15466 [ main] DEBUG apache.hadoop.mapred.JobClient - default FileSystem: hdfs://localhost:53462 [29/02/08 10:15:49] 15470 [dler 1 on 53462] WARN .apache.hadoop.dfs.StateChange - DIR* FSDirectory.unprotectedDelete: failed to remove /tmp/hadoop-clint_morgan/mapred/system/job_local_6 because it does not exist [29/02/08 10:15:49] 15490 [ main] WARN apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). [29/02/08 10:15:49] 15541 [ main] DEBUG apache.hadoop.mapred.JobClient - Creating splits at hdfs://localhost:53462/tmp/hadoop-clint_morgan/mapred/system/job_local_6/job.split [29/02/08 10:15:49] 15584 [ main] DEBUG .hbase.mapred.TableInputFormat - split: 0->TestTable,, [29/02/08 10:15:49] 15722 [ main] INFO apache.hadoop.mapred.JobClient - Running job: job_local_6 [29/02/08 10:15:50] 15774 [ Thread-312] DEBUG .hbase.mapred.TableInputFormat - split: 0->TestTable,, [29/02/08 10:15:50] 15780 [ Thread-312] DEBUG g.apache.hadoop.mapred.MapTask - Writing local split to /tmp/hadoop-clint_morgan/mapred/system/job_local_6/split.dta [29/02/08 10:15:50] 15784 [ Thread-312] DEBUG pache.hadoop.mapred.TaskRunner - job_local_6_map_0000 Progress/ping thread started [29/02/08 10:15:50] 15784 [ Thread-312] INFO g.apache.hadoop.mapred.MapTask - numReduceTasks: 1 [29/02/08 10:15:50] 15784 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:50] 15784 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_OUTPUT_BYTES at 3 [29/02/08 10:15:50] 15784 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_OUTPUT_RECORDS at 1 [29/02/08 10:15:50] 15785 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding COMBINE_INPUT_RECORDS at 4 [29/02/08 10:15:50] 15785 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding COMBINE_OUTPUT_RECORDS at 5 [29/02/08 10:15:50] 15808 [ Thread-312] INFO che.hadoop.hbase.client.HTable - Creating scanner over TestTable starting at key [29/02/08 10:15:50] 15884 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_INPUT_RECORDS at 0 [29/02/08 10:15:50] 15885 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_INPUT_BYTES at 2 [29/02/08 10:15:50] 15903 [ Thread-312] DEBUG g.apache.hadoop.mapred.MapTask - opened spill0.out [29/02/08 10:15:50] 15914 [ Thread-312] INFO e.hadoop.mapred.LocalJobRunner - [29/02/08 10:15:50] 15914 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:50] 15914 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:50] 15914 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:50] 15914 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:50] 15914 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:50] 15914 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:50] 15914 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:50] 15914 [ Thread-312] INFO pache.hadoop.mapred.TaskRunner - Task 'job_local_6_map_0000' done. [29/02/08 10:15:50] 15919 [ Thread-312] INFO pache.hadoop.mapred.TaskRunner - Saved output of task 'job_local_6_map_0000' to hdfs://localhost:53462/user/clint_morgan/NEVER_REALLY_USED [29/02/08 10:15:50] 15919 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:50] 15919 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:50] 15919 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:50] 15920 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:50] 15920 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:50] 15920 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:50] 15920 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:50] 15926 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:50] 15926 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_INPUT_GROUPS at 6 [29/02/08 10:15:50] 15926 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_INPUT_RECORDS at 7 [29/02/08 10:15:50] 15926 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_OUTPUT_RECORDS at 8 [29/02/08 10:15:50] 15929 [ Thread-312] DEBUG pache.hadoop.mapred.TaskRunner - reduce_eim06m Progress/ping thread started [29/02/08 10:15:50] 15956 [:0.cacheFlusher] DEBUG oop.hbase.regionserver.HRegion - Started memcache flush for region TestTable,,1204308934811. Size 1.0k [29/02/08 10:15:50] 15964 [ Thread-312] INFO e.hadoop.mapred.LocalJobRunner - reduce > reduce [29/02/08 10:15:50] 15964 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:50] 15965 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:50] 15965 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:50] 15965 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:50] 15965 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:50] 15965 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:50] 15965 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:50] 15965 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input groups at 6 [29/02/08 10:15:50] 15970 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input records at 7 [29/02/08 10:15:50] 15970 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce output records at 8 [29/02/08 10:15:50] 15970 [ Thread-312] INFO pache.hadoop.mapred.TaskRunner - Task 'reduce_eim06m' done. [29/02/08 10:15:50] 15978 [ Thread-312] INFO pache.hadoop.mapred.TaskRunner - Saved output of task 'reduce_eim06m' to hdfs://localhost:53462/user/clint_morgan/NEVER_REALLY_USED [29/02/08 10:15:50] 15978 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input groups at 6 [29/02/08 10:15:50] 15978 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input records at 7 [29/02/08 10:15:50] 15979 [ Thread-312] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce output records at 8 [29/02/08 10:15:50] 16091 [:0.cacheFlusher] DEBUG doop.hbase.regionserver.HStore - Added 490073220/C/1261571005769644222 with 37 entries, sequence id 83, and size 1.6k for 490073220/C [29/02/08 10:15:50] 16091 [:0.cacheFlusher] DEBUG oop.hbase.regionserver.HRegion - Finished memcache flush for region TestTable,,1204308934811 in 135ms, sequenceid=83 [29/02/08 10:15:50] 16722 [ main] INFO apache.hadoop.mapred.JobClient - Job complete: job_local_6 [29/02/08 10:15:50] 16722 [ main] INFO apache.hadoop.mapred.JobClient - Counters: 9 [29/02/08 10:15:50] 16722 [ main] INFO apache.hadoop.mapred.JobClient - Map-Reduce Framework [29/02/08 10:15:50] 16722 [ main] INFO apache.hadoop.mapred.JobClient - Map input records=10 [29/02/08 10:15:50] 16722 [ main] INFO apache.hadoop.mapred.JobClient - Map output records=10 [29/02/08 10:15:50] 16722 [ main] INFO apache.hadoop.mapred.JobClient - Map input bytes=0 [29/02/08 10:15:50] 16722 [ main] INFO apache.hadoop.mapred.JobClient - Map output bytes=850 [29/02/08 10:15:50] 16722 [ main] INFO apache.hadoop.mapred.JobClient - Combine input records=0 [29/02/08 10:15:50] 16723 [ main] INFO apache.hadoop.mapred.JobClient - Combine output records=0 [29/02/08 10:15:50] 16723 [ main] INFO apache.hadoop.mapred.JobClient - Reduce input groups=10 [29/02/08 10:15:50] 16723 [ main] INFO apache.hadoop.mapred.JobClient - Reduce input records=10 [29/02/08 10:15:50] 16723 [ main] INFO apache.hadoop.mapred.JobClient - Reduce output records=10 [29/02/08 10:15:51] 16755 [ main] DEBUG apache.hadoop.mapred.JobClient - default FileSystem: hdfs://localhost:53462 [29/02/08 10:15:51] 16761 [dler 5 on 53462] WARN .apache.hadoop.dfs.StateChange - DIR* FSDirectory.unprotectedDelete: failed to remove /tmp/hadoop-clint_morgan/mapred/system/job_local_7 because it does not exist [29/02/08 10:15:51] 16776 [ main] WARN apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). [29/02/08 10:15:51] 16817 [ main] DEBUG apache.hadoop.mapred.JobClient - Creating splits at hdfs://localhost:53462/tmp/hadoop-clint_morgan/mapred/system/job_local_7/job.split [29/02/08 10:15:51] 16852 [ main] DEBUG .hbase.mapred.TableInputFormat - split: 0->TestTable,, [29/02/08 10:15:51] 16967 [ main] INFO apache.hadoop.mapred.JobClient - Running job: job_local_7 [29/02/08 10:15:51] 17006 [ Thread-354] DEBUG .hbase.mapred.TableInputFormat - split: 0->TestTable,, [29/02/08 10:15:51] 17012 [ Thread-354] DEBUG g.apache.hadoop.mapred.MapTask - Writing local split to /tmp/hadoop-clint_morgan/mapred/system/job_local_7/split.dta [29/02/08 10:15:51] 17014 [ Thread-354] DEBUG pache.hadoop.mapred.TaskRunner - job_local_7_map_0000 Progress/ping thread started [29/02/08 10:15:51] 17014 [ Thread-354] INFO g.apache.hadoop.mapred.MapTask - numReduceTasks: 1 [29/02/08 10:15:51] 17014 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:51] 17014 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_OUTPUT_BYTES at 3 [29/02/08 10:15:51] 17014 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_OUTPUT_RECORDS at 1 [29/02/08 10:15:51] 17014 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding COMBINE_INPUT_RECORDS at 4 [29/02/08 10:15:51] 17014 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding COMBINE_OUTPUT_RECORDS at 5 [29/02/08 10:15:51] 17033 [ Thread-354] INFO che.hadoop.hbase.client.HTable - Creating scanner over TestTable starting at key [29/02/08 10:15:51] 17066 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_INPUT_RECORDS at 0 [29/02/08 10:15:51] 17066 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_INPUT_BYTES at 2 [29/02/08 10:15:51] 17090 [ Thread-354] DEBUG g.apache.hadoop.mapred.MapTask - opened spill0.out [29/02/08 10:15:51] 17100 [ Thread-354] INFO e.hadoop.mapred.LocalJobRunner - [29/02/08 10:15:51] 17100 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:51] 17101 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:51] 17111 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:51] 17111 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:51] 17111 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:51] 17111 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:51] 17112 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:51] 17112 [ Thread-354] INFO pache.hadoop.mapred.TaskRunner - Task 'job_local_7_map_0000' done. [29/02/08 10:15:51] 17133 [ Thread-354] INFO pache.hadoop.mapred.TaskRunner - Saved output of task 'job_local_7_map_0000' to hdfs://localhost:53462/user/clint_morgan/NEVER_REALLY_USED [29/02/08 10:15:51] 17134 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:51] 17134 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:51] 17134 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:51] 17134 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:51] 17134 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:51] 17134 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:51] 17134 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:51] 17141 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:51] 17141 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_INPUT_GROUPS at 6 [29/02/08 10:15:51] 17141 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_INPUT_RECORDS at 7 [29/02/08 10:15:51] 17141 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_OUTPUT_RECORDS at 8 [29/02/08 10:15:51] 17172 [ Thread-354] DEBUG pache.hadoop.mapred.TaskRunner - reduce_dc00xl Progress/ping thread started [29/02/08 10:15:51] 17209 [ Thread-354] INFO e.hadoop.mapred.LocalJobRunner - reduce > reduce [29/02/08 10:15:51] 17209 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:51] 17209 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:51] 17209 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:51] 17209 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:51] 17209 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:51] 17209 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:51] 17209 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:51] 17209 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input groups at 6 [29/02/08 10:15:51] 17209 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input records at 7 [29/02/08 10:15:51] 17209 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce output records at 8 [29/02/08 10:15:51] 17209 [ Thread-354] INFO pache.hadoop.mapred.TaskRunner - Task 'reduce_dc00xl' done. [29/02/08 10:15:51] 17261 [ Thread-354] INFO pache.hadoop.mapred.TaskRunner - Saved output of task 'reduce_dc00xl' to hdfs://localhost:53462/user/clint_morgan/NEVER_REALLY_USED [29/02/08 10:15:51] 17261 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input groups at 6 [29/02/08 10:15:51] 17261 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input records at 7 [29/02/08 10:15:51] 17261 [ Thread-354] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce output records at 8 [29/02/08 10:15:52] 17967 [ main] INFO apache.hadoop.mapred.JobClient - Job complete: job_local_7 [29/02/08 10:15:52] 17967 [ main] INFO apache.hadoop.mapred.JobClient - Counters: 9 [29/02/08 10:15:52] 17967 [ main] INFO apache.hadoop.mapred.JobClient - Map-Reduce Framework [29/02/08 10:15:52] 17967 [ main] INFO apache.hadoop.mapred.JobClient - Map input records=10 [29/02/08 10:15:52] 17967 [ main] INFO apache.hadoop.mapred.JobClient - Map output records=10 [29/02/08 10:15:52] 17967 [ main] INFO apache.hadoop.mapred.JobClient - Map input bytes=0 [29/02/08 10:15:52] 17968 [ main] INFO apache.hadoop.mapred.JobClient - Map output bytes=850 [29/02/08 10:15:52] 17968 [ main] INFO apache.hadoop.mapred.JobClient - Combine input records=0 [29/02/08 10:15:52] 17968 [ main] INFO apache.hadoop.mapred.JobClient - Combine output records=0 [29/02/08 10:15:52] 17968 [ main] INFO apache.hadoop.mapred.JobClient - Reduce input groups=10 [29/02/08 10:15:52] 17968 [ main] INFO apache.hadoop.mapred.JobClient - Reduce input records=10 [29/02/08 10:15:52] 17968 [ main] INFO apache.hadoop.mapred.JobClient - Reduce output records=10 [29/02/08 10:15:52] 18005 [ main] DEBUG apache.hadoop.mapred.JobClient - default FileSystem: hdfs://localhost:53462 [29/02/08 10:15:52] 18008 [dler 1 on 53462] WARN .apache.hadoop.dfs.StateChange - DIR* FSDirectory.unprotectedDelete: failed to remove /tmp/hadoop-clint_morgan/mapred/system/job_local_8 because it does not exist [29/02/08 10:15:52] 18013 [ main] WARN apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). [29/02/08 10:15:52] 18033 [ main] DEBUG apache.hadoop.mapred.JobClient - Creating splits at hdfs://localhost:53462/tmp/hadoop-clint_morgan/mapred/system/job_local_8/job.split [29/02/08 10:15:52] 18065 [ main] DEBUG .hbase.mapred.TableInputFormat - split: 0->TestTable,, [29/02/08 10:15:52] 18171 [ main] INFO apache.hadoop.mapred.JobClient - Running job: job_local_8 [29/02/08 10:15:52] 18198 [ Thread-377] DEBUG .hbase.mapred.TableInputFormat - split: 0->TestTable,, [29/02/08 10:15:52] 18206 [ Thread-377] DEBUG g.apache.hadoop.mapred.MapTask - Writing local split to /tmp/hadoop-clint_morgan/mapred/system/job_local_8/split.dta [29/02/08 10:15:52] 18208 [ Thread-377] DEBUG pache.hadoop.mapred.TaskRunner - job_local_8_map_0000 Progress/ping thread started [29/02/08 10:15:52] 18208 [ Thread-377] INFO g.apache.hadoop.mapred.MapTask - numReduceTasks: 1 [29/02/08 10:15:52] 18208 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:52] 18208 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_OUTPUT_BYTES at 3 [29/02/08 10:15:52] 18208 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_OUTPUT_RECORDS at 1 [29/02/08 10:15:52] 18208 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding COMBINE_INPUT_RECORDS at 4 [29/02/08 10:15:52] 18208 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding COMBINE_OUTPUT_RECORDS at 5 [29/02/08 10:15:52] 18227 [ Thread-377] INFO che.hadoop.hbase.client.HTable - Creating scanner over TestTable starting at key [29/02/08 10:15:52] 18253 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_INPUT_RECORDS at 0 [29/02/08 10:15:52] 18253 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_INPUT_BYTES at 2 [29/02/08 10:15:52] 18271 [ Thread-377] DEBUG g.apache.hadoop.mapred.MapTask - opened spill0.out [29/02/08 10:15:52] 18277 [ Thread-377] INFO e.hadoop.mapred.LocalJobRunner - [29/02/08 10:15:52] 18278 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:52] 18278 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:52] 18278 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:52] 18278 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:52] 18278 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:52] 18278 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:52] 18278 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:52] 18278 [ Thread-377] INFO pache.hadoop.mapred.TaskRunner - Task 'job_local_8_map_0000' done. [29/02/08 10:15:52] 18283 [ Thread-377] INFO pache.hadoop.mapred.TaskRunner - Saved output of task 'job_local_8_map_0000' to hdfs://localhost:53462/user/clint_morgan/NEVER_REALLY_USED [29/02/08 10:15:52] 18283 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:52] 18283 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:52] 18283 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:52] 18283 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:52] 18283 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:52] 18283 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:52] 18283 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:52] 18288 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:52] 18288 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_INPUT_GROUPS at 6 [29/02/08 10:15:52] 18288 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_INPUT_RECORDS at 7 [29/02/08 10:15:52] 18288 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_OUTPUT_RECORDS at 8 [29/02/08 10:15:52] 18291 [ Thread-377] DEBUG pache.hadoop.mapred.TaskRunner - reduce_auhzj6 Progress/ping thread started [29/02/08 10:15:52] 18345 [ Thread-377] INFO e.hadoop.mapred.LocalJobRunner - reduce > reduce [29/02/08 10:15:52] 18345 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:52] 18345 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:52] 18345 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:52] 18345 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:52] 18345 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:52] 18345 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:52] 18345 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:52] 18345 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input groups at 6 [29/02/08 10:15:52] 18345 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input records at 7 [29/02/08 10:15:52] 18345 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce output records at 8 [29/02/08 10:15:52] 18345 [ Thread-377] INFO pache.hadoop.mapred.TaskRunner - Task 'reduce_auhzj6' done. [29/02/08 10:15:52] 18350 [ Thread-377] INFO pache.hadoop.mapred.TaskRunner - Saved output of task 'reduce_auhzj6' to hdfs://localhost:53462/user/clint_morgan/NEVER_REALLY_USED [29/02/08 10:15:52] 18350 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input groups at 6 [29/02/08 10:15:52] 18350 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input records at 7 [29/02/08 10:15:52] 18350 [ Thread-377] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce output records at 8 [29/02/08 10:15:53] 19171 [ main] INFO apache.hadoop.mapred.JobClient - Job complete: job_local_8 [29/02/08 10:15:53] 19172 [ main] INFO apache.hadoop.mapred.JobClient - Counters: 9 [29/02/08 10:15:53] 19172 [ main] INFO apache.hadoop.mapred.JobClient - Map-Reduce Framework [29/02/08 10:15:53] 19173 [ main] INFO apache.hadoop.mapred.JobClient - Map input records=10 [29/02/08 10:15:53] 19173 [ main] INFO apache.hadoop.mapred.JobClient - Map output records=10 [29/02/08 10:15:53] 19173 [ main] INFO apache.hadoop.mapred.JobClient - Map input bytes=0 [29/02/08 10:15:53] 19173 [ main] INFO apache.hadoop.mapred.JobClient - Map output bytes=850 [29/02/08 10:15:53] 19173 [ main] INFO apache.hadoop.mapred.JobClient - Combine input records=0 [29/02/08 10:15:53] 19173 [ main] INFO apache.hadoop.mapred.JobClient - Combine output records=0 [29/02/08 10:15:53] 19173 [ main] INFO apache.hadoop.mapred.JobClient - Reduce input groups=10 [29/02/08 10:15:53] 19173 [ main] INFO apache.hadoop.mapred.JobClient - Reduce input records=10 [29/02/08 10:15:53] 19173 [ main] INFO apache.hadoop.mapred.JobClient - Reduce output records=10 [29/02/08 10:15:53] 19258 [ main] DEBUG apache.hadoop.mapred.JobClient - default FileSystem: hdfs://localhost:53462 [29/02/08 10:15:53] 19266 [dler 0 on 53462] WARN .apache.hadoop.dfs.StateChange - DIR* FSDirectory.unprotectedDelete: failed to remove /tmp/hadoop-clint_morgan/mapred/system/job_local_9 because it does not exist [29/02/08 10:15:53] 19275 [ main] WARN apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). [29/02/08 10:15:53] 19307 [ main] DEBUG apache.hadoop.mapred.JobClient - Creating splits at hdfs://localhost:53462/tmp/hadoop-clint_morgan/mapred/system/job_local_9/job.split [29/02/08 10:15:53] 19465 [ main] DEBUG .hbase.mapred.TableInputFormat - split: 0->TestTable,, [29/02/08 10:15:53] 19626 [ main] INFO apache.hadoop.mapred.JobClient - Running job: job_local_9 [29/02/08 10:15:53] 19703 [ Thread-400] DEBUG .hbase.mapred.TableInputFormat - split: 0->TestTable,, [29/02/08 10:15:53] 19714 [ Thread-400] DEBUG g.apache.hadoop.mapred.MapTask - Writing local split to /tmp/hadoop-clint_morgan/mapred/system/job_local_9/split.dta [29/02/08 10:15:53] 19716 [ Thread-400] DEBUG pache.hadoop.mapred.TaskRunner - job_local_9_map_0000 Progress/ping thread started [29/02/08 10:15:53] 19716 [ Thread-400] INFO g.apache.hadoop.mapred.MapTask - numReduceTasks: 1 [29/02/08 10:15:53] 19717 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:53] 19717 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_OUTPUT_BYTES at 3 [29/02/08 10:15:53] 19717 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_OUTPUT_RECORDS at 1 [29/02/08 10:15:53] 19717 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding COMBINE_INPUT_RECORDS at 4 [29/02/08 10:15:53] 19717 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding COMBINE_OUTPUT_RECORDS at 5 [29/02/08 10:15:54] 19743 [ Thread-400] INFO che.hadoop.hbase.client.HTable - Creating scanner over TestTable starting at key [29/02/08 10:15:54] 19799 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_INPUT_RECORDS at 0 [29/02/08 10:15:54] 19799 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_INPUT_BYTES at 2 [29/02/08 10:15:54] 19825 [ Thread-400] DEBUG g.apache.hadoop.mapred.MapTask - opened spill0.out [29/02/08 10:15:54] 19835 [ Thread-400] INFO e.hadoop.mapred.LocalJobRunner - [29/02/08 10:15:54] 19836 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:54] 19836 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:54] 19836 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:54] 19836 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:54] 19836 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:54] 19836 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:54] 19836 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:54] 19836 [ Thread-400] INFO pache.hadoop.mapred.TaskRunner - Task 'job_local_9_map_0000' done. [29/02/08 10:15:54] 19849 [ Thread-400] INFO pache.hadoop.mapred.TaskRunner - Saved output of task 'job_local_9_map_0000' to hdfs://localhost:53462/user/clint_morgan/NEVER_REALLY_USED [29/02/08 10:15:54] 19849 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:54] 19849 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:54] 19853 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:54] 19853 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:54] 19853 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:54] 19853 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:54] 19853 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:54] 19859 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:54] 19859 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_INPUT_GROUPS at 6 [29/02/08 10:15:54] 19859 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_INPUT_RECORDS at 7 [29/02/08 10:15:54] 19859 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_OUTPUT_RECORDS at 8 [29/02/08 10:15:54] 19863 [ Thread-400] DEBUG pache.hadoop.mapred.TaskRunner - reduce_tsrt4x Progress/ping thread started [29/02/08 10:15:54] 19954 [:0.cacheFlusher] DEBUG oop.hbase.regionserver.HRegion - Started memcache flush for region TestTable,,1204308934811. Size 1.0k [29/02/08 10:15:54] 19954 [ Thread-400] INFO e.hadoop.mapred.LocalJobRunner - reduce > reduce [29/02/08 10:15:54] 19954 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:54] 19954 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:54] 19955 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:54] 19955 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:54] 19955 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:54] 19955 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:54] 19955 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:54] 19955 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input groups at 6 [29/02/08 10:15:54] 19960 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input records at 7 [29/02/08 10:15:54] 19960 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce output records at 8 [29/02/08 10:15:54] 19960 [ Thread-400] INFO pache.hadoop.mapred.TaskRunner - Task 'reduce_tsrt4x' done. [29/02/08 10:15:54] 19968 [ Thread-400] INFO pache.hadoop.mapred.TaskRunner - Saved output of task 'reduce_tsrt4x' to hdfs://localhost:53462/user/clint_morgan/NEVER_REALLY_USED [29/02/08 10:15:54] 19968 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input groups at 6 [29/02/08 10:15:54] 19969 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input records at 7 [29/02/08 10:15:54] 19969 [ Thread-400] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce output records at 8 [29/02/08 10:15:54] 20071 [:0.cacheFlusher] DEBUG doop.hbase.regionserver.HStore - Added 490073220/C/1683480010897958023 with 37 entries, sequence id 121, and size 1.6k for 490073220/C [29/02/08 10:15:54] 20072 [:0.cacheFlusher] DEBUG oop.hbase.regionserver.HRegion - Finished memcache flush for region TestTable,,1204308934811 in 118ms, sequenceid=121 [29/02/08 10:15:54] 20627 [ main] INFO apache.hadoop.mapred.JobClient - Job complete: job_local_9 [29/02/08 10:15:54] 20627 [ main] INFO apache.hadoop.mapred.JobClient - Counters: 9 [29/02/08 10:15:54] 20627 [ main] INFO apache.hadoop.mapred.JobClient - Map-Reduce Framework [29/02/08 10:15:54] 20627 [ main] INFO apache.hadoop.mapred.JobClient - Map input records=10 [29/02/08 10:15:54] 20627 [ main] INFO apache.hadoop.mapred.JobClient - Map output records=10 [29/02/08 10:15:54] 20627 [ main] INFO apache.hadoop.mapred.JobClient - Map input bytes=0 [29/02/08 10:15:54] 20627 [ main] INFO apache.hadoop.mapred.JobClient - Map output bytes=850 [29/02/08 10:15:54] 20629 [ main] INFO apache.hadoop.mapred.JobClient - Combine input records=0 [29/02/08 10:15:54] 20629 [ main] INFO apache.hadoop.mapred.JobClient - Combine output records=0 [29/02/08 10:15:54] 20629 [ main] INFO apache.hadoop.mapred.JobClient - Reduce input groups=10 [29/02/08 10:15:54] 20629 [ main] INFO apache.hadoop.mapred.JobClient - Reduce input records=10 [29/02/08 10:15:54] 20629 [ main] INFO apache.hadoop.mapred.JobClient - Reduce output records=10 [29/02/08 10:15:54] 20667 [ main] DEBUG apache.hadoop.mapred.JobClient - default FileSystem: hdfs://localhost:53462 [29/02/08 10:15:54] 20668 [dler 0 on 53462] WARN .apache.hadoop.dfs.StateChange - DIR* FSDirectory.unprotectedDelete: failed to remove /tmp/hadoop-clint_morgan/mapred/system/job_local_10 because it does not exist [29/02/08 10:15:54] 20684 [ main] WARN apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). [29/02/08 10:15:54] 20706 [ main] DEBUG apache.hadoop.mapred.JobClient - Creating splits at hdfs://localhost:53462/tmp/hadoop-clint_morgan/mapred/system/job_local_10/job.split [29/02/08 10:15:55] 20745 [ main] DEBUG .hbase.mapred.TableInputFormat - split: 0->TestTable,, [29/02/08 10:15:55] 20836 [ main] INFO apache.hadoop.mapred.JobClient - Running job: job_local_10 [29/02/08 10:15:55] 20866 [ Thread-445] DEBUG .hbase.mapred.TableInputFormat - split: 0->TestTable,, [29/02/08 10:15:55] 20871 [ Thread-445] DEBUG g.apache.hadoop.mapred.MapTask - Writing local split to /tmp/hadoop-clint_morgan/mapred/system/job_local_10/split.dta [29/02/08 10:15:55] 20877 [ Thread-445] DEBUG pache.hadoop.mapred.TaskRunner - job_local_10_map_0000 Progress/ping thread started [29/02/08 10:15:55] 20877 [ Thread-445] INFO g.apache.hadoop.mapred.MapTask - numReduceTasks: 1 [29/02/08 10:15:55] 20877 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:55] 20877 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_OUTPUT_BYTES at 3 [29/02/08 10:15:55] 20877 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_OUTPUT_RECORDS at 1 [29/02/08 10:15:55] 20877 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding COMBINE_INPUT_RECORDS at 4 [29/02/08 10:15:55] 20877 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding COMBINE_OUTPUT_RECORDS at 5 [29/02/08 10:15:55] 20892 [ Thread-445] INFO che.hadoop.hbase.client.HTable - Creating scanner over TestTable starting at key [29/02/08 10:15:55] 20933 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_INPUT_RECORDS at 0 [29/02/08 10:15:55] 20933 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding MAP_INPUT_BYTES at 2 [29/02/08 10:15:55] 20953 [ Thread-445] DEBUG g.apache.hadoop.mapred.MapTask - opened spill0.out [29/02/08 10:15:55] 20960 [ Thread-445] INFO e.hadoop.mapred.LocalJobRunner - [29/02/08 10:15:55] 20960 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:55] 20961 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:55] 20963 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:55] 20963 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:55] 20963 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:55] 20963 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:55] 20963 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:55] 20963 [ Thread-445] INFO pache.hadoop.mapred.TaskRunner - Task 'job_local_10_map_0000' done. [29/02/08 10:15:55] 20967 [ Thread-445] INFO pache.hadoop.mapred.TaskRunner - Saved output of task 'job_local_10_map_0000' to hdfs://localhost:53462/user/clint_morgan/NEVER_REALLY_USED [29/02/08 10:15:55] 20967 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:55] 20967 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:55] 20967 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:55] 20968 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:55] 20968 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:55] 20968 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:55] 20968 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:55] 20973 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:55] 20973 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_INPUT_GROUPS at 6 [29/02/08 10:15:55] 20973 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_INPUT_RECORDS at 7 [29/02/08 10:15:55] 20973 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding REDUCE_OUTPUT_RECORDS at 8 [29/02/08 10:15:55] 20976 [ Thread-445] DEBUG pache.hadoop.mapred.TaskRunner - reduce_1qlf00 Progress/ping thread started [29/02/08 10:15:55] 21004 [ Thread-445] INFO e.hadoop.mapred.LocalJobRunner - reduce > reduce [29/02/08 10:15:55] 21005 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Creating group org.apache.hadoop.mapred.Task$Counter with bundle [29/02/08 10:15:55] 21005 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding Map input records at 0 [29/02/08 10:15:55] 21007 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding Map output records at 1 [29/02/08 10:15:55] 21007 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding Map input bytes at 2 [29/02/08 10:15:55] 21007 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding Map output bytes at 3 [29/02/08 10:15:55] 21007 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding Combine input records at 4 [29/02/08 10:15:55] 21007 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding Combine output records at 5 [29/02/08 10:15:55] 21007 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input groups at 6 [29/02/08 10:15:55] 21008 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input records at 7 [29/02/08 10:15:55] 21008 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce output records at 8 [29/02/08 10:15:55] 21008 [ Thread-445] INFO pache.hadoop.mapred.TaskRunner - Task 'reduce_1qlf00' done. [29/02/08 10:15:55] 21013 [ Thread-445] INFO pache.hadoop.mapred.TaskRunner - Saved output of task 'reduce_1qlf00' to hdfs://localhost:53462/user/clint_morgan/NEVER_REALLY_USED [29/02/08 10:15:55] 21013 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input groups at 6 [29/02/08 10:15:55] 21013 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce input records at 7 [29/02/08 10:15:55] 21013 [ Thread-445] DEBUG .apache.hadoop.mapred.Counters - Adding Reduce output records at 8 [29/02/08 10:15:55] 21641 [ger.rootScanner] INFO adoop.hbase.master.BaseScanner - RegionManager.rootScanner scanning meta region {regionname: -ROOT-,,0, startKey: <>, server: 10.0.1.199:53485} [29/02/08 10:15:55] 21661 [ger.rootScanner] DEBUG adoop.hbase.master.BaseScanner - RegionManager.rootScanner regioninfo: {regionname: .META.,,1, startKey: <>, endKey: <>, encodedName: 1028785192, tableDesc: {name: .META., families: {info:={name: info, max versions: 1, compression: NONE, in memory: false, block cache enabled: false, max length: 2147483647, bloom filter: none}}}}, server: 10.0.1.199:53485, startCode: 1204308934747 [29/02/08 10:15:55] 21665 [ger.rootScanner] INFO adoop.hbase.master.BaseScanner - RegionManager.rootScanner scan of meta region {regionname: -ROOT-,,0, startKey: <>, server: 10.0.1.199:53485} complete [29/02/08 10:15:56] 21836 [ main] INFO apache.hadoop.mapred.JobClient - Job complete: job_local_10 [29/02/08 10:15:56] 21836 [ main] INFO apache.hadoop.mapred.JobClient - Counters: 9 [29/02/08 10:15:56] 21836 [ main] INFO apache.hadoop.mapred.JobClient - Map-Reduce Framework [29/02/08 10:15:56] 21836 [ main] INFO apache.hadoop.mapred.JobClient - Map input records=10 [29/02/08 10:15:56] 21836 [ main] INFO apache.hadoop.mapred.JobClient - Map output records=10 [29/02/08 10:15:56] 21836 [ main] INFO apache.hadoop.mapred.JobClient - Map input bytes=0 [29/02/08 10:15:56] 21837 [ main] INFO apache.hadoop.mapred.JobClient - Map output bytes=850 [29/02/08 10:15:56] 21837 [ main] INFO apache.hadoop.mapred.JobClient - Combine input records=0 [29/02/08 10:15:56] 21837 [ main] INFO apache.hadoop.mapred.JobClient - Combine output records=0 [29/02/08 10:15:56] 21837 [ main] INFO apache.hadoop.mapred.JobClient - Reduce input groups=10 [29/02/08 10:15:56] 21837 [ main] INFO apache.hadoop.mapred.JobClient - Reduce input records=10 [29/02/08 10:15:56] 21837 [ main] INFO apache.hadoop.mapred.JobClient - Reduce output records=10 [29/02/08 10:15:56] 21837 [ main] INFO apred.TestRowFilterAfterMapRed - Print table contents using scanner after map/reduce for TestTable [29/02/08 10:15:56] 21837 [ main] INFO che.hadoop.hbase.client.HTable - Creating scanner over TestTable starting at key [29/02/08 10:15:56] 21883 [ main] INFO apred.TestRowFilterAfterMapRed - row: row_00000 [29/02/08 10:15:56] 21883 [ main] INFO apred.TestRowFilterAfterMapRed - column: C:col1 value: myValue [29/02/08 10:15:56] 21883 [ main] INFO apred.TestRowFilterAfterMapRed - column: C:col2 value: 00000 [29/02/08 10:15:56] 21884 [ main] INFO apred.TestRowFilterAfterMapRed - row: row_00001 [29/02/08 10:15:56] 21884 [ main] INFO apred.TestRowFilterAfterMapRed - column: C:col1 value: myValue [29/02/08 10:15:56] 21885 [ main] INFO apred.TestRowFilterAfterMapRed - column: C:col2 value: 00001 [29/02/08 10:15:56] 21885 [ main] INFO apred.TestRowFilterAfterMapRed - row: row_00002 [29/02/08 10:15:56] 21885 [ main] INFO apred.TestRowFilterAfterMapRed - column: C:col1 value: myValue [29/02/08 10:15:56] 21886 [ main] INFO apred.TestRowFilterAfterMapRed - column: C:col2 value: 00002 [29/02/08 10:15:56] 21886 [ main] INFO apred.TestRowFilterAfterMapRed - row: row_00003 [29/02/08 10:15:56] 21886 [ main] INFO apred.TestRowFilterAfterMapRed - column: C:col1 value: myValue [29/02/08 10:15:56] 21886 [ main] INFO apred.TestRowFilterAfterMapRed - column: C:col2 value: 00003 [29/02/08 10:15:56] 21887 [ main] INFO apred.TestRowFilterAfterMapRed - row: row_00004 [29/02/08 10:15:56] 21887 [ main] INFO apred.TestRowFilterAfterMapRed - column: C:col1 value: myValue [29/02/08 10:15:56] 21887 [ main] INFO apred.TestRowFilterAfterMapRed - column: C:col2 value: 00004 [29/02/08 10:15:56] 21888 [ main] INFO apred.TestRowFilterAfterMapRed - row: row_00005 [29/02/08 10:15:56] 21888 [ main] INFO apred.TestRowFilterAfterMapRed - column: C:col1 value: myValue [29/02/08 10:15:56] 21888 [ main] INFO apred.TestRowFilterAfterMapRed - column: C:col2 value: 00005 [29/02/08 10:15:56] 21888 [ main] INFO apred.TestRowFilterAfterMapRed - row: row_00006 [29/02/08 10:15:56] 21888 [ main] INFO apred.TestRowFilterAfterMapRed - column: C:col1 value: myValue [29/02/08 10:15:56] 21888 [ main] INFO apred.TestRowFilterAfterMapRed - column: C:col2 value: 00006 [29/02/08 10:15:56] 21890 [ main] INFO apred.TestRowFilterAfterMapRed - row: row_00007 [29/02/08 10:15:56] 21890 [ main] INFO apred.TestRowFilterAfterMapRed - column: C:col1 value: myValue [29/02/08 10:15:56] 21890 [ main] INFO apred.TestRowFilterAfterMapRed - column: C:col2 value: 00007 [29/02/08 10:15:56] 21891 [ main] INFO apred.TestRowFilterAfterMapRed - row: row_00008 [29/02/08 10:15:56] 21891 [ main] INFO apred.TestRowFilterAfterMapRed - column: C:col1 value: myValue [29/02/08 10:15:56] 21891 [ main] INFO apred.TestRowFilterAfterMapRed - column: C:col2 value: 00008 [29/02/08 10:15:56] 21891 [ main] INFO apred.TestRowFilterAfterMapRed - row: row_00009 [29/02/08 10:15:56] 21891 [ main] INFO apred.TestRowFilterAfterMapRed - column: C:col1 value: myValue [29/02/08 10:15:56] 21892 [ main] INFO apred.TestRowFilterAfterMapRed - column: C:col2 value: 00009 [29/02/08 10:15:56] 21894 [ main] INFO apred.TestRowFilterAfterMapRed - Print table contents using scanner+filter after map/reduce for TestTable [29/02/08 10:15:56] 21894 [ main] INFO che.hadoop.hbase.client.HTable - Creating scanner over TestTable starting at key [29/02/08 10:15:56] 21946 [ main] DEBUG hadoop.hbase.LocalHBaseCluster - Shutting down HBase Cluster [29/02/08 10:15:56] 21946 [ main] INFO he.hadoop.hbase.master.HMaster - Cluster shutdown requested. Starting to quiesce servers [29/02/08 10:15:56] 22670 [ RegionServer:0] INFO ase.regionserver.HRegionServer - Got quiesce server message [29/02/08 10:15:56] 22670 [Server:0.worker] INFO ase.regionserver.HRegionServer - MSG_REGIONSERVER_QUIESCE : [29/02/08 10:15:56] 22671 [Server:0.worker] DEBUG ase.regionserver.HRegionServer - closing region TestTable,,1204308934811 [29/02/08 10:15:56] 22671 [Server:0.worker] DEBUG oop.hbase.regionserver.HRegion - compactions and cache flushes disabled for region TestTable,,1204308934811 [29/02/08 10:15:56] 22671 [Server:0.worker] DEBUG oop.hbase.regionserver.HRegion - new updates and scanners for region TestTable,,1204308934811 disabled [29/02/08 10:15:56] 22671 [Server:0.worker] DEBUG oop.hbase.regionserver.HRegion - no more active scanners for region TestTable,,1204308934811 [29/02/08 10:15:56] 22671 [Server:0.worker] DEBUG oop.hbase.regionserver.HRegion - no more row locks outstanding on region TestTable,,1204308934811 [29/02/08 10:15:56] 22671 [Server:0.worker] DEBUG oop.hbase.regionserver.HRegion - Started memcache flush for region TestTable,,1204308934811. Size 280.0 [29/02/08 10:15:57] 22786 [Server:0.worker] DEBUG doop.hbase.regionserver.HStore - Added 490073220/C/9166096887298249111 with 10 entries, sequence id 132, and size 530.0 for 490073220/C [29/02/08 10:15:57] 22786 [Server:0.worker] DEBUG oop.hbase.regionserver.HRegion - Finished memcache flush for region TestTable,,1204308934811 in 115ms, sequenceid=132 [29/02/08 10:15:57] 22787 [Server:0.worker] DEBUG doop.hbase.regionserver.HStore - closed 490073220/C [29/02/08 10:15:57] 22787 [Server:0.worker] INFO oop.hbase.regionserver.HRegion - closed TestTable,,1204308934811 [29/02/08 10:15:57] 23613 [ger.metaScanner] INFO adoop.hbase.master.BaseScanner - RegionManager.metaScanner scanning meta region {regionname: .META.,,1, startKey: <>, server: 10.0.1.199:53485} [29/02/08 10:15:57] 23631 [ger.metaScanner] DEBUG adoop.hbase.master.BaseScanner - RegionManager.metaScanner regioninfo: {regionname: TestTable,,1204308934811, startKey: <>, endKey: <>, encodedName: 490073220, tableDesc: {name: TestTable, families: {C:={name: C, max versions: 3, compression: NONE, in memory: false, block cache enabled: false, max length: 2147483647, bloom filter: none}}}}, server: 10.0.1.199:53485, startCode: 1204308934747 [29/02/08 10:15:57] 23632 [ger.metaScanner] INFO adoop.hbase.master.BaseScanner - RegionManager.metaScanner scan of meta region {regionname: .META.,,1, startKey: <>, server: 10.0.1.199:53485} complete [29/02/08 10:15:57] 23632 [ger.metaScanner] INFO adoop.hbase.master.BaseScanner - all meta regions scanned [29/02/08 10:15:57] 23671 [dler 1 on 60000] INFO oop.hbase.master.ServerManager - Region server 10.0.1.199:53485 quiesced [29/02/08 10:15:57] 23671 [dler 1 on 60000] INFO oop.hbase.master.ServerManager - All user tables quiesced. Proceeding with shutdown [29/02/08 10:15:57] 23672 [dler 1 on 60000] DEBUG oop.hbase.master.RegionManager - telling root scanner to stop [29/02/08 10:15:57] 23672 [dler 1 on 60000] DEBUG oop.hbase.master.RegionManager - telling meta scanner to stop [29/02/08 10:15:57] 23672 [dler 1 on 60000] DEBUG oop.hbase.master.RegionManager - meta and root scanners notified [29/02/08 10:15:57] 23672 [ger.rootScanner] INFO adoop.hbase.master.RootScanner - RegionManager.rootScanner exiting [29/02/08 10:15:57] 23672 [ger.metaScanner] INFO adoop.hbase.master.MetaScanner - RegionManager.metaScanner exiting [29/02/08 10:15:57] 23672 [ RegionServer:0] INFO ase.regionserver.HRegionServer - Got regionserver stop message [29/02/08 10:15:57] 23676 [ RegionServer:0] DEBUG ase.regionserver.HRegionServer - closing region -ROOT-,,0 [29/02/08 10:15:57] 23676 [ RegionServer:0] DEBUG oop.hbase.regionserver.HRegion - compactions and cache flushes disabled for region -ROOT-,,0 [29/02/08 10:15:57] 23676 [ RegionServer:0] DEBUG oop.hbase.regionserver.HRegion - new updates and scanners for region -ROOT-,,0 disabled [29/02/08 10:15:57] 23676 [ RegionServer:0] DEBUG oop.hbase.regionserver.HRegion - no more active scanners for region -ROOT-,,0 [29/02/08 10:15:57] 23676 [ RegionServer:0] DEBUG oop.hbase.regionserver.HRegion - no more row locks outstanding on region -ROOT-,,0 [29/02/08 10:15:57] 23676 [ RegionServer:0] DEBUG doop.hbase.regionserver.HStore - closed 70236052/info [29/02/08 10:15:57] 23676 [ RegionServer:0] INFO oop.hbase.regionserver.HRegion - closed -ROOT-,,0 [29/02/08 10:15:57] 23676 [ RegionServer:0] DEBUG ase.regionserver.HRegionServer - closing region .META.,,1 [29/02/08 10:15:57] 23676 [ RegionServer:0] DEBUG oop.hbase.regionserver.HRegion - compactions and cache flushes disabled for region .META.,,1 [29/02/08 10:15:57] 23676 [ RegionServer:0] DEBUG oop.hbase.regionserver.HRegion - new updates and scanners for region .META.,,1 disabled [29/02/08 10:15:57] 23676 [ RegionServer:0] DEBUG oop.hbase.regionserver.HRegion - no more active scanners for region .META.,,1 [29/02/08 10:15:57] 23676 [ RegionServer:0] DEBUG oop.hbase.regionserver.HRegion - no more row locks outstanding on region .META.,,1 [29/02/08 10:15:57] 23677 [ RegionServer:0] DEBUG doop.hbase.regionserver.HStore - closed 1028785192/info [29/02/08 10:15:57] 23677 [ RegionServer:0] INFO oop.hbase.regionserver.HRegion - closed .META.,,1 [29/02/08 10:15:57] 23677 [ RegionServer:0] DEBUG hadoop.hbase.regionserver.HLog - closing log writer in hdfs://localhost:53462/user/clint_morgan/log_10.0.1.199_1204308934747_53485 [29/02/08 10:15:57] 23678 [:0.cacheFlusher] INFO oop.hbase.regionserver.Flusher - RegionServer:0.cacheFlusher exiting [29/02/08 10:15:57] 23681 [ver:0.compactor] INFO egionserver.CompactSplitThread - RegionServer:0.compactor exiting [29/02/08 10:15:57] 23738 [ RegionServer:0] INFO ase.regionserver.HRegionServer - telling master that region server is shutting down at: 10.0.1.199:53485 [29/02/08 10:15:57] 23739 [dler 2 on 60000] DEBUG oop.hbase.master.ServerManager - Region server 10.0.1.199:53485: MSG_REPORT_EXITING -- cancelling lease [29/02/08 10:15:57] 23739 [dler 2 on 60000] INFO oop.hbase.master.ServerManager - Cancelling lease for 10.0.1.199:53485 [29/02/08 10:15:57] 23739 [dler 2 on 60000] INFO oop.hbase.master.ServerManager - Region server 10.0.1.199:53485: MSG_REPORT_EXITING -- lease cancelled [29/02/08 10:15:58] 23743 [ RegionServer:0] INFO ase.regionserver.HRegionServer - stopping server at: 10.0.1.199:53485 [29/02/08 10:15:58] 23787 [Server:0.worker] INFO ase.regionserver.HRegionServer - worker thread exiting [29/02/08 10:15:58] 23788 [ RegionServer:0] INFO ase.regionserver.HRegionServer - RegionServer:0 exiting [29/02/08 10:15:58] 24587 [:0.leaseChecker] INFO org.apache.hadoop.hbase.Leases - RegionServer:0.leaseChecker closing leases [29/02/08 10:15:58] 24587 [:0.leaseChecker] INFO org.apache.hadoop.hbase.Leases - RegionServer:0.leaseChecker closed leases [29/02/08 10:15:58] 24622 [ HMaster] DEBUG oop.hbase.master.RegionManager - telling root scanner to stop [29/02/08 10:15:58] 24622 [ HMaster] DEBUG oop.hbase.master.RegionManager - telling meta scanner to stop [29/02/08 10:15:58] 24622 [ HMaster] DEBUG oop.hbase.master.RegionManager - meta and root scanners notified [29/02/08 10:15:58] 24623 [ HMaster] INFO org.apache.hadoop.hbase.Leases - HMaster closing leases [29/02/08 10:15:58] 24623 [ HMaster] INFO org.apache.hadoop.hbase.Leases - HMaster closed leases [29/02/08 10:15:58] 24623 [ HMaster] INFO he.hadoop.hbase.master.HMaster - HMaster main thread exiting [29/02/08 10:15:59] 24789 [ main] INFO hadoop.hbase.LocalHBaseCluster - Shutdown HMaster 1 region server(s) [29/02/08 10:15:59] 24789 [ main] INFO org.apache.hadoop.hbase - Shutting down FileSystem [29/02/08 10:15:59] 24937 [ main] INFO org.apache.hadoop.hbase - Shutting down Mini DFS [29/02/08 10:15:59] 25506 [er.leaseChecker] INFO org.apache.hadoop.hbase.Leases - ServerManager.leaseChecker closing leases [29/02/08 10:15:59] 25506 [er.leaseChecker] INFO org.apache.hadoop.hbase.Leases - ServerManager.leaseChecker closed leases [29/02/08 10:16:04] 29922 [ Thread-99] INFO ase.regionserver.HRegionServer - Starting shutdown thread. [29/02/08 10:16:04] 29950 [ Thread-99] INFO ase.regionserver.HRegionServer - Shutdown thread complete