| Regressionorg.apache.hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS.testEnd2End Failing for the past 1 build
(Since  #7274 )
Error MessageRebalancing expected avg utilization to become 0.2, but on datanode 127.0.0.1:57889 it remains at 0.08 after more than 40000 msec. Stacktracejava.util.concurrent.TimeoutException: Rebalancing expected avg utilization to become 0.2, but on datanode 127.0.0.1:57889 it remains at 0.08 after more than 40000 msec.
at org.apache.hadoop.hdfs.server.balancer.TestBalancer.waitForBalancer(TestBalancer.java:284)
at org.apache.hadoop.hdfs.server.balancer.TestBalancer.runBalancer(TestBalancer.java:382)
at org.apache.hadoop.hdfs.server.balancer.TestBalancer.doTest(TestBalancer.java:359)
at org.apache.hadoop.hdfs.server.balancer.TestBalancer.oneNodeTest(TestBalancer.java:403)
at org.apache.hadoop.hdfs.server.balancer.TestBalancer.integrationTest(TestBalancer.java:416)
at org.apache.hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS.testEnd2End(TestBlockTokenWithDFS.java:588)
Standard Output2014-07-02 21:23:23,032 INFO hdfs.TestBalancer (TestBalancer.java:doTest(326)) - capacities = [500]
2014-07-02 21:23:23,037 INFO hdfs.TestBalancer (TestBalancer.java:doTest(327)) - racks = [/rack0]
2014-07-02 21:23:23,037 INFO hdfs.TestBalancer (TestBalancer.java:doTest(328)) - newCapacity= 250
2014-07-02 21:23:23,037 INFO hdfs.TestBalancer (TestBalancer.java:doTest(329)) - newRack = /rack0
2014-07-02 21:23:23,037 INFO hdfs.TestBalancer (TestBalancer.java:doTest(330)) - useTool = false
2014-07-02 21:23:23,070 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:<init>(371)) - starting cluster: numNameNodes=1, numDataNodes=1
Formatting using clusterid: testClusterID
2014-07-02 21:23:23,464 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(750)) - fsLock is fair:true
2014-07-02 21:23:23,505 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1028)) - hadoop.configured.node.mapping is deprecated. Instead, use net.topology.configured.node.mapping
2014-07-02 21:23:23,505 INFO blockmanagement.DatanodeManager (DatanodeManager.java:<init>(229)) - dfs.block.invalidate.limit=1000
2014-07-02 21:23:23,505 INFO blockmanagement.DatanodeManager (DatanodeManager.java:<init>(235)) - dfs.namenode.datanode.registration.ip-hostname-check=true
2014-07-02 21:23:23,506 INFO blockmanagement.BlockManager (InvalidateBlocks.java:printBlockDeletionTime(70)) - dfs.namenode.startup.delay.block.deletion.ms is set to 0 ms.
2014-07-02 21:23:23,513 INFO blockmanagement.BlockManager (InvalidateBlocks.java:printBlockDeletionTime(75)) - The block deletion will start around 2014 Jul 02 21:23:23
2014-07-02 21:23:23,515 INFO util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map BlocksMap
2014-07-02 21:23:23,515 INFO util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type = 32-bit
2014-07-02 21:23:23,520 INFO util.GSet (LightWeightGSet.java:computeCapacity(356)) - 2.0% max memory 910.3 MB = 18.2 MB
2014-07-02 21:23:23,520 INFO util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity = 2^22 = 4194304 entries
2014-07-02 21:23:23,554 INFO blockmanagement.BlockManager (BlockManager.java:createBlockTokenSecretManager(354)) - dfs.block.access.token.enable=true
2014-07-02 21:23:23,555 INFO blockmanagement.BlockManager (BlockManager.java:createBlockTokenSecretManager(374)) - dfs.block.access.key.update.interval=600 min(s), dfs.block.access.token.lifetime=600 min(s), dfs.encrypt.data.transfer.algorithm=null
2014-07-02 21:23:23,860 INFO blockmanagement.BlockManager (BlockManager.java:<init>(339)) - defaultReplication = 1
2014-07-02 21:23:23,861 INFO blockmanagement.BlockManager (BlockManager.java:<init>(340)) - maxReplication = 512
2014-07-02 21:23:23,861 INFO blockmanagement.BlockManager (BlockManager.java:<init>(341)) - minReplication = 1
2014-07-02 21:23:23,861 INFO blockmanagement.BlockManager (BlockManager.java:<init>(342)) - maxReplicationStreams = 2
2014-07-02 21:23:23,861 INFO blockmanagement.BlockManager (BlockManager.java:<init>(343)) - shouldCheckForEnoughRacks = false
2014-07-02 21:23:23,861 INFO blockmanagement.BlockManager (BlockManager.java:<init>(344)) - replicationRecheckInterval = 3000
2014-07-02 21:23:23,862 INFO blockmanagement.BlockManager (BlockManager.java:<init>(345)) - encryptDataTransfer = false
2014-07-02 21:23:23,862 INFO blockmanagement.BlockManager (BlockManager.java:<init>(346)) - maxNumBlocksToLog = 1000
2014-07-02 21:23:23,867 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(769)) - fsOwner = jenkins (auth:SIMPLE)
2014-07-02 21:23:23,868 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(770)) - supergroup = supergroup
2014-07-02 21:23:23,868 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(771)) - isPermissionEnabled = true
2014-07-02 21:23:23,868 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(782)) - HA Enabled: false
2014-07-02 21:23:23,899 INFO util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map INodeMap
2014-07-02 21:23:23,900 INFO util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type = 32-bit
2014-07-02 21:23:23,900 INFO util.GSet (LightWeightGSet.java:computeCapacity(356)) - 1.0% max memory 910.3 MB = 9.1 MB
2014-07-02 21:23:23,900 INFO util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity = 2^21 = 2097152 entries
2014-07-02 21:23:23,905 INFO namenode.NameNode (FSDirectory.java:<init>(208)) - Caching file names occuring more than 10 times
2014-07-02 21:23:23,912 INFO util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map cachedBlocks
2014-07-02 21:23:23,912 INFO util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type = 32-bit
2014-07-02 21:23:23,913 INFO util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.25% max memory 910.3 MB = 2.3 MB
2014-07-02 21:23:23,913 INFO util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity = 2^19 = 524288 entries
2014-07-02 21:23:23,970 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(5081)) - dfs.namenode.safemode.threshold-pct = 0.9990000128746033
2014-07-02 21:23:23,970 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(5082)) - dfs.namenode.safemode.min.datanodes = 0
2014-07-02 21:23:23,970 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(5083)) - dfs.namenode.safemode.extension = 0
2014-07-02 21:23:23,972 INFO namenode.FSNamesystem (FSNamesystem.java:initRetryCache(901)) - Retry cache on namenode is enabled
2014-07-02 21:23:23,972 INFO namenode.FSNamesystem (FSNamesystem.java:initRetryCache(909)) - Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
2014-07-02 21:23:23,975 INFO util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map NameNodeRetryCache
2014-07-02 21:23:23,975 INFO util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type = 32-bit
2014-07-02 21:23:23,975 INFO util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.029999999329447746% max memory 910.3 MB = 279.6 KB
2014-07-02 21:23:23,975 INFO util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity = 2^16 = 65536 entries
2014-07-02 21:23:23,981 INFO namenode.NNConf (NNConf.java:<init>(62)) - ACLs enabled? false
2014-07-02 21:23:23,982 INFO namenode.NNConf (NNConf.java:<init>(66)) - XAttrs enabled? true
2014-07-02 21:23:23,982 INFO namenode.NNConf (NNConf.java:<init>(74)) - Maximum size of an xattr: 16384
2014-07-02 21:23:24,030 INFO namenode.FSImage (FSImage.java:format(145)) - Allocated new BlockPoolId: BP-300692236-67.195.138.20-1404336203992
2014-07-02 21:23:24,060 INFO common.Storage (NNStorage.java:format(550)) - Storage directory /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-hdfs-project/hadoop-hdfs/target/test/data/dfs/name1 has been successfully formatted.
2014-07-02 21:23:24,067 INFO common.Storage (NNStorage.java:format(550)) - Storage directory /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-hdfs-project/hadoop-hdfs/target/test/data/dfs/name2 has been successfully formatted.
2014-07-02 21:23:24,185 INFO namenode.NNStorageRetentionManager (NNStorageRetentionManager.java:getImageTxIdToRetain(203)) - Going to retain 1 images with txid >= 0
2014-07-02 21:23:24,187 INFO namenode.NameNode (NameNode.java:createNameNode(1343)) - createNameNode []
2014-07-02 21:23:24,233 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(123)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2014-07-02 21:23:24,283 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:startTimer(342)) - Scheduled snapshot period at 10 second(s).
2014-07-02 21:23:24,284 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:start(184)) - NameNode metrics system started
2014-07-02 21:23:24,286 INFO namenode.NameNode (NameNode.java:setClientNamenodeAddress(343)) - fs.defaultFS is hdfs://127.0.0.1:0
2014-07-02 21:23:24,319 INFO hdfs.DFSUtil (DFSUtil.java:httpServerTemplateForNNAndJN(1646)) - Starting web server as: ${dfs.web.authentication.kerberos.principal}
2014-07-02 21:23:24,320 INFO hdfs.DFSUtil (DFSUtil.java:httpServerTemplateForNNAndJN(1657)) - Starting Web-server for hdfs at: http://localhost:0
2014-07-02 21:23:24,373 INFO mortbay.log (Slf4jLog.java:info(67)) - Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2014-07-02 21:23:24,378 INFO http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.namenode is not defined
2014-07-02 21:23:24,403 INFO http.HttpServer2 (HttpServer2.java:addGlobalFilter(666)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2014-07-02 21:23:24,405 INFO http.HttpServer2 (HttpServer2.java:addFilter(644)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs
2014-07-02 21:23:24,406 INFO http.HttpServer2 (HttpServer2.java:addFilter(651)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2014-07-02 21:23:24,406 INFO http.HttpServer2 (HttpServer2.java:addFilter(651)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2014-07-02 21:23:24,428 INFO http.HttpServer2 (NameNodeHttpServer.java:initWebHdfs(86)) - Added filter 'org.apache.hadoop.hdfs.web.AuthFilter' (class=org.apache.hadoop.hdfs.web.AuthFilter)
2014-07-02 21:23:24,430 INFO http.HttpServer2 (HttpServer2.java:addJerseyResourcePackage(570)) - addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.namenode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
2014-07-02 21:23:24,441 INFO http.HttpServer2 (HttpServer2.java:openListeners(854)) - Jetty bound to port 54063
2014-07-02 21:23:24,442 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2014-07-02 21:23:24,496 INFO mortbay.log (Slf4jLog.java:info(67)) - NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
2014-07-02 21:23:24,511 WARN server.AuthenticationFilter (AuthenticationFilter.java:init(166)) - 'signature.secret' configuration not set, using a random value as secret
2014-07-02 21:23:24,531 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:54063
2014-07-02 21:23:24,534 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(750)) - fsLock is fair:true
2014-07-02 21:23:24,535 INFO blockmanagement.DatanodeManager (DatanodeManager.java:<init>(229)) - dfs.block.invalidate.limit=1000
2014-07-02 21:23:24,535 INFO blockmanagement.DatanodeManager (DatanodeManager.java:<init>(235)) - dfs.namenode.datanode.registration.ip-hostname-check=true
2014-07-02 21:23:24,535 INFO blockmanagement.BlockManager (InvalidateBlocks.java:printBlockDeletionTime(70)) - dfs.namenode.startup.delay.block.deletion.ms is set to 0 ms.
2014-07-02 21:23:24,535 INFO blockmanagement.BlockManager (InvalidateBlocks.java:printBlockDeletionTime(75)) - The block deletion will start around 2014 Jul 02 21:23:24
2014-07-02 21:23:24,536 INFO util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map BlocksMap
2014-07-02 21:23:24,536 INFO util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type = 32-bit
2014-07-02 21:23:24,536 INFO util.GSet (LightWeightGSet.java:computeCapacity(356)) - 2.0% max memory 910.3 MB = 18.2 MB
2014-07-02 21:23:24,536 INFO util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity = 2^22 = 4194304 entries
2014-07-02 21:23:24,547 INFO blockmanagement.BlockManager (BlockManager.java:createBlockTokenSecretManager(354)) - dfs.block.access.token.enable=true
2014-07-02 21:23:24,547 INFO blockmanagement.BlockManager (BlockManager.java:createBlockTokenSecretManager(374)) - dfs.block.access.key.update.interval=600 min(s), dfs.block.access.token.lifetime=600 min(s), dfs.encrypt.data.transfer.algorithm=null
2014-07-02 21:23:24,548 INFO blockmanagement.BlockManager (BlockManager.java:<init>(339)) - defaultReplication = 1
2014-07-02 21:23:24,548 INFO blockmanagement.BlockManager (BlockManager.java:<init>(340)) - maxReplication = 512
2014-07-02 21:23:24,548 INFO blockmanagement.BlockManager (BlockManager.java:<init>(341)) - minReplication = 1
2014-07-02 21:23:24,549 INFO blockmanagement.BlockManager (BlockManager.java:<init>(342)) - maxReplicationStreams = 2
2014-07-02 21:23:24,549 INFO blockmanagement.BlockManager (BlockManager.java:<init>(343)) - shouldCheckForEnoughRacks = false
2014-07-02 21:23:24,549 INFO blockmanagement.BlockManager (BlockManager.java:<init>(344)) - replicationRecheckInterval = 3000
2014-07-02 21:23:24,549 INFO blockmanagement.BlockManager (BlockManager.java:<init>(345)) - encryptDataTransfer = false
2014-07-02 21:23:24,549 INFO blockmanagement.BlockManager (BlockManager.java:<init>(346)) - maxNumBlocksToLog = 1000
2014-07-02 21:23:24,550 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(769)) - fsOwner = jenkins (auth:SIMPLE)
2014-07-02 21:23:24,550 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(770)) - supergroup = supergroup
2014-07-02 21:23:24,550 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(771)) - isPermissionEnabled = true
2014-07-02 21:23:24,550 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(782)) - HA Enabled: false
2014-07-02 21:23:24,551 INFO util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map INodeMap
2014-07-02 21:23:24,551 INFO util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type = 32-bit
2014-07-02 21:23:24,552 INFO util.GSet (LightWeightGSet.java:computeCapacity(356)) - 1.0% max memory 910.3 MB = 9.1 MB
2014-07-02 21:23:24,552 INFO util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity = 2^21 = 2097152 entries
2014-07-02 21:23:24,739 INFO namenode.NameNode (FSDirectory.java:<init>(208)) - Caching file names occuring more than 10 times
2014-07-02 21:23:24,740 INFO util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map cachedBlocks
2014-07-02 21:23:24,740 INFO util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type = 32-bit
2014-07-02 21:23:24,740 INFO util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.25% max memory 910.3 MB = 2.3 MB
2014-07-02 21:23:24,741 INFO util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity = 2^19 = 524288 entries
2014-07-02 21:23:24,742 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(5081)) - dfs.namenode.safemode.threshold-pct = 0.9990000128746033
2014-07-02 21:23:24,742 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(5082)) - dfs.namenode.safemode.min.datanodes = 0
2014-07-02 21:23:24,742 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(5083)) - dfs.namenode.safemode.extension = 0
2014-07-02 21:23:24,743 INFO namenode.FSNamesystem (FSNamesystem.java:initRetryCache(901)) - Retry cache on namenode is enabled
2014-07-02 21:23:24,743 INFO namenode.FSNamesystem (FSNamesystem.java:initRetryCache(909)) - Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
2014-07-02 21:23:24,743 INFO util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map NameNodeRetryCache
2014-07-02 21:23:24,744 INFO util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type = 32-bit
2014-07-02 21:23:24,744 INFO util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.029999999329447746% max memory 910.3 MB = 279.6 KB
2014-07-02 21:23:24,744 INFO util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity = 2^16 = 65536 entries
2014-07-02 21:23:24,747 INFO namenode.NNConf (NNConf.java:<init>(62)) - ACLs enabled? false
2014-07-02 21:23:24,747 INFO namenode.NNConf (NNConf.java:<init>(66)) - XAttrs enabled? true
2014-07-02 21:23:24,747 INFO namenode.NNConf (NNConf.java:<init>(74)) - Maximum size of an xattr: 16384
2014-07-02 21:23:24,758 INFO common.Storage (Storage.java:tryLock(706)) - Lock on /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-hdfs-project/hadoop-hdfs/target/test/data/dfs/name1/in_use.lock acquired by nodename 6886@asf011.sp2.ygridcore.net
2014-07-02 21:23:24,763 INFO common.Storage (Storage.java:tryLock(706)) - Lock on /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-hdfs-project/hadoop-hdfs/target/test/data/dfs/name2/in_use.lock acquired by nodename 6886@asf011.sp2.ygridcore.net
2014-07-02 21:23:24,766 INFO namenode.FileJournalManager (FileJournalManager.java:recoverUnfinalizedSegments(328)) - Recovering unfinalized segments in /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-hdfs-project/hadoop-hdfs/target/test/data/dfs/name1/current
2014-07-02 21:23:24,767 INFO namenode.FileJournalManager (FileJournalManager.java:recoverUnfinalizedSegments(328)) - Recovering unfinalized segments in /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-hdfs-project/hadoop-hdfs/target/test/data/dfs/name2/current
2014-07-02 21:23:24,768 INFO namenode.FSImage (FSImage.java:loadFSImage(653)) - No edit log streams selected.
2014-07-02 21:23:24,784 INFO namenode.FSImageFormatPBINode (FSImageFormatPBINode.java:loadINodeSection(208)) - Loading 1 INodes.
2014-07-02 21:23:24,790 INFO namenode.FSImageFormatProtobuf (FSImageFormatProtobuf.java:load(171)) - Loaded FSImage in 0 seconds.
2014-07-02 21:23:24,791 INFO namenode.FSImage (FSImage.java:loadFSImage(926)) - Loaded image for txid 0 from /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-hdfs-project/hadoop-hdfs/target/test/data/dfs/name1/current/fsimage_0000000000000000000
2014-07-02 21:23:24,795 INFO namenode.FSNamesystem (FSNamesystem.java:loadFSImage(970)) - Need to save fs image? false (staleImage=false, haEnabled=false, isRollingUpgrade=false)
2014-07-02 21:23:24,796 INFO namenode.FSEditLog (FSEditLog.java:startLogSegment(1172)) - Starting log segment at 1
2014-07-02 21:23:25,007 INFO namenode.NameCache (NameCache.java:initialized(143)) - initialized with 0 entries 0 lookups
2014-07-02 21:23:25,007 INFO namenode.FSNamesystem (FSNamesystem.java:loadFromDisk(718)) - Finished loading FSImage in 259 msecs
2014-07-02 21:23:25,172 INFO namenode.NameNode (NameNodeRpcServer.java:<init>(311)) - RPC server is binding to localhost:0
2014-07-02 21:23:25,180 INFO ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2014-07-02 21:23:25,195 INFO ipc.Server (Server.java:run(596)) - Starting Socket Reader #1 for port 33665
2014-07-02 21:23:25,225 INFO namenode.NameNode (NameNode.java:initialize(594)) - Clients are to use localhost:33665 to access this namenode/service.
2014-07-02 21:23:25,228 INFO namenode.FSNamesystem (FSNamesystem.java:registerMBean(6015)) - Registered FSNamesystemState MBean
2014-07-02 21:23:25,241 INFO namenode.FSNamesystem (FSNamesystem.java:getCompleteBlocksTotal(5668)) - Number of blocks under construction: 0
2014-07-02 21:23:25,242 INFO namenode.FSNamesystem (FSNamesystem.java:getCompleteBlocksTotal(5668)) - Number of blocks under construction: 0
2014-07-02 21:23:25,242 INFO namenode.FSNamesystem (FSNamesystem.java:initializeReplQueues(1145)) - initializing replication queues
2014-07-02 21:23:25,242 INFO hdfs.StateChange (FSNamesystem.java:leave(5155)) - STATE* Leaving safe mode after 0 secs
2014-07-02 21:23:25,242 INFO hdfs.StateChange (FSNamesystem.java:leave(5166)) - STATE* Network topology has 0 racks and 0 datanodes
2014-07-02 21:23:25,243 INFO hdfs.StateChange (FSNamesystem.java:leave(5169)) - STATE* UnderReplicatedBlocks has 0 blocks
2014-07-02 21:23:25,246 INFO block.BlockTokenSecretManager (BlockTokenSecretManager.java:updateKeys(222)) - Updating block keys
2014-07-02 21:23:25,302 INFO blockmanagement.BlockManager (BlockManager.java:processMisReplicatesAsync(2519)) - Total number of blocks = 0
2014-07-02 21:23:25,303 INFO blockmanagement.BlockManager (BlockManager.java:processMisReplicatesAsync(2520)) - Number of invalid blocks = 0
2014-07-02 21:23:25,303 INFO blockmanagement.BlockManager (BlockManager.java:processMisReplicatesAsync(2521)) - Number of under-replicated blocks = 0
2014-07-02 21:23:25,303 INFO blockmanagement.BlockManager (BlockManager.java:processMisReplicatesAsync(2522)) - Number of over-replicated blocks = 0
2014-07-02 21:23:25,303 INFO blockmanagement.BlockManager (BlockManager.java:processMisReplicatesAsync(2524)) - Number of blocks being written = 0
2014-07-02 21:23:25,303 INFO hdfs.StateChange (BlockManager.java:processMisReplicatesAsync(2525)) - STATE* Replication Queue initialization scan for invalid, over- and under-replicated blocks completed in 61 msec
2014-07-02 21:23:25,326 INFO ipc.Server (Server.java:run(818)) - IPC Server Responder: starting
2014-07-02 21:23:25,327 INFO ipc.Server (Server.java:run(665)) - IPC Server listener on 33665: starting
2014-07-02 21:23:25,329 INFO namenode.NameNode (NameNode.java:startCommonServices(637)) - NameNode RPC up at: localhost/127.0.0.1:33665
2014-07-02 21:23:25,329 INFO namenode.FSNamesystem (FSNamesystem.java:startActiveServices(1068)) - Starting services required for active state
2014-07-02 21:23:25,333 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(159)) - Starting CacheReplicationMonitor with interval 30000 milliseconds
2014-07-02 21:23:25,333 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(172)) - Rescanning because of pending operations
2014-07-02 21:23:25,335 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(202)) - Scanned 0 directive(s) and 0 block(s) in 2 millisecond(s).
2014-07-02 21:23:25,341 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1290)) - Starting DataNode 0 with dfs.datanode.data.dir: [DISK]file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-hdfs-project/hadoop-hdfs/target/test/data/dfs/data/data1,[DISK]file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-hdfs-project/hadoop-hdfs/target/test/data/dfs/data/data2
2014-07-02 21:23:25,342 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1295)) - Starting DataNode 0 with hostname set to: host0.foo.com
2014-07-02 21:23:25,342 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1300)) - Adding node with hostname : host0.foo.com to rack /rack0
2014-07-02 21:23:25,419 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(152)) - DataNode metrics system started (again)
2014-07-02 21:23:25,420 INFO datanode.DataNode (DataNode.java:<init>(288)) - Configured hostname is host0.foo.com
2014-07-02 21:23:25,421 INFO datanode.DataNode (DataNode.java:startDataNode(759)) - Starting DataNode with maxLockedMemory = 0
2014-07-02 21:23:25,426 INFO datanode.DataNode (DataNode.java:initDataXceiver(560)) - Opened streaming server at /127.0.0.1:55922
2014-07-02 21:23:25,428 INFO datanode.DataNode (DataXceiverServer.java:<init>(75)) - Balancing bandwith is 1048576 bytes/s
2014-07-02 21:23:25,428 INFO datanode.DataNode (DataXceiverServer.java:<init>(76)) - Number threads for balancing is 5
2014-07-02 21:23:25,438 INFO http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.datanode is not defined
2014-07-02 21:23:25,439 INFO http.HttpServer2 (HttpServer2.java:addGlobalFilter(666)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2014-07-02 21:23:25,440 INFO http.HttpServer2 (HttpServer2.java:addFilter(644)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2014-07-02 21:23:25,440 INFO http.HttpServer2 (HttpServer2.java:addFilter(651)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2014-07-02 21:23:25,440 INFO http.HttpServer2 (HttpServer2.java:addFilter(651)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2014-07-02 21:23:25,442 INFO http.HttpServer2 (HttpServer2.java:addJerseyResourcePackage(570)) - addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
2014-07-02 21:23:25,443 INFO http.HttpServer2 (HttpServer2.java:openListeners(854)) - Jetty bound to port 57879
2014-07-02 21:23:25,443 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2014-07-02 21:23:25,454 INFO mortbay.log (Slf4jLog.java:info(67)) - NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
2014-07-02 21:23:25,461 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:57879
2014-07-02 21:23:25,462 INFO datanode.DataNode (DataNode.java:startDataNode(776)) - dnUserName = jenkins
2014-07-02 21:23:25,462 INFO datanode.DataNode (DataNode.java:startDataNode(777)) - supergroup = supergroup
2014-07-02 21:23:25,471 INFO ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2014-07-02 21:23:25,472 INFO ipc.Server (Server.java:run(596)) - Starting Socket Reader #1 for port 38883
2014-07-02 21:23:25,478 INFO datanode.DataNode (DataNode.java:initIpcServer(435)) - Opened IPC server at /127.0.0.1:38883
2014-07-02 21:23:25,485 INFO datanode.DataNode (BlockPoolManager.java:refreshNamenodes(152)) - Refresh request received for nameservices: null
2014-07-02 21:23:25,488 INFO datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(197)) - Starting BPOfferServices for nameservices: <default>
2014-07-02 21:23:25,497 INFO datanode.DataNode (BPServiceActor.java:run(805)) - Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:33665 starting to offer service
2014-07-02 21:23:25,506 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1328)) - Adding node with service : 127.0.0.1:55922 to rack /rack0
2014-07-02 21:23:25,507 INFO ipc.Server (Server.java:run(818)) - IPC Server Responder: starting
2014-07-02 21:23:25,508 INFO ipc.Server (Server.java:run(665)) - IPC Server listener on 38883: starting
2014-07-02 21:23:25,883 INFO datanode.DataNode (DataNode.java:checkDatanodeUuid(805)) - Generated and persisted new Datanode UUID 9fa6616c-20cd-44e6-8b90-ac1acb4d65de
2014-07-02 21:23:25,885 INFO datanode.DataNode (SimulatedFSDataset.java:registerMBean(968)) - Registered FSDatasetState MBean
2014-07-02 21:23:25,886 INFO datanode.DataNode (DataNode.java:initDataBlockScanner(510)) - Periodic Block Verification scan disabled because verifcation is not supported by SimulatedFSDataset
2014-07-02 21:23:25,887 INFO datanode.DataNode (DataNode.java:initDirectoryScanner(538)) - Periodic Directory Tree Verification scan is disabled because verifcation is not supported by SimulatedFSDataset
2014-07-02 21:23:25,890 INFO datanode.DataNode (BPServiceActor.java:register(765)) - Block pool BP-300692236-67.195.138.20-1404336203992 (Datanode Uuid null) service to localhost/127.0.0.1:33665 beginning handshake with NN
2014-07-02 21:23:25,899 INFO hdfs.StateChange (DatanodeManager.java:registerDatanode(889)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, datanodeUuid=9fa6616c-20cd-44e6-8b90-ac1acb4d65de, infoPort=57879, ipcPort=38883, storageInfo=lv=-55;cid=testClusterID;nsid=1369169098;c=0) storage 9fa6616c-20cd-44e6-8b90-ac1acb4d65de
2014-07-02 21:23:25,904 INFO net.NetworkTopology (NetworkTopology.java:add(417)) - Adding a new node: /rack0/127.0.0.1:55922
2014-07-02 21:23:25,908 INFO datanode.DataNode (BPServiceActor.java:register(778)) - Block pool Block pool BP-300692236-67.195.138.20-1404336203992 (Datanode Uuid null) service to localhost/127.0.0.1:33665 successfully registered with NN
2014-07-02 21:23:25,909 INFO datanode.DataNode (DataNode.java:registerBlockPoolWithSecretManager(877)) - Block token params received from NN: for block pool BP-300692236-67.195.138.20-1404336203992 keyUpdateInterval=600 min(s), tokenLifetime=600 min(s)
2014-07-02 21:23:25,909 INFO block.BlockTokenSecretManager (BlockTokenSecretManager.java:addKeys(193)) - Setting block keys
2014-07-02 21:23:25,909 INFO datanode.DataNode (BPServiceActor.java:offerService(637)) - For namenode localhost/127.0.0.1:33665 using DELETEREPORT_INTERVAL of 100000 msec BLOCKREPORT_INTERVAL of 21600000msec CACHEREPORT_INTERVAL of 10000msec Initial delay: 0msec; heartBeatInterval=1000
2014-07-02 21:23:25,923 INFO blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(665)) - Adding new storage ID SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080 for DN 127.0.0.1:55922
2014-07-02 21:23:25,932 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(438)) - Namenode Block pool BP-300692236-67.195.138.20-1404336203992 (Datanode Uuid 9fa6616c-20cd-44e6-8b90-ac1acb4d65de) service to localhost/127.0.0.1:33665 trying to claim ACTIVE state with txid=1
2014-07-02 21:23:25,932 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(450)) - Acknowledging ACTIVE Namenode Block pool BP-300692236-67.195.138.20-1404336203992 (Datanode Uuid 9fa6616c-20cd-44e6-8b90-ac1acb4d65de) service to localhost/127.0.0.1:33665
2014-07-02 21:23:25,943 INFO blockmanagement.BlockManager (BlockManager.java:processReport(1734)) - BLOCK* processReport: Received first block report from DatanodeStorage[SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080,DISK,NORMAL] after starting up or becoming active. Its block contents are no longer considered stale
2014-07-02 21:23:25,943 INFO BlockStateChange (BlockManager.java:processReport(1750)) - BLOCK* processReport: from storage SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080 node DatanodeRegistration(127.0.0.1, datanodeUuid=9fa6616c-20cd-44e6-8b90-ac1acb4d65de, infoPort=57879, ipcPort=38883, storageInfo=lv=-55;cid=testClusterID;nsid=1369169098;c=0), blocks: 0, hasStaleStorages: false, processing time: 1 msecs
2014-07-02 21:23:25,946 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:waitActive(2023)) - Cluster is active
2014-07-02 21:23:25,956 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:waitActive(2023)) - Cluster is active
2014-07-02 21:23:25,960 DEBUG hdfs.DFSClient (DFSClient.java:primitiveMkdir(2566)) - /: masked=rwxr-xr-x
2014-07-02 21:23:25,961 INFO datanode.DataNode (BPServiceActor.java:blockReport(498)) - Sent 1 blockreports 0 blocks total. Took 2 msec to generate and 27 msecs for RPC and NN processing. Got back commands org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@86359
2014-07-02 21:23:25,962 INFO datanode.DataNode (BPOfferService.java:processCommandFromActive(617)) - Got finalize command for block pool BP-300692236-67.195.138.20-1404336203992
2014-07-02 21:23:25,965 INFO namenode.EditLogFileOutputStream (EditLogFileOutputStream.java:flushAndSync(200)) - Nothing to flush
2014-07-02 21:23:25,965 INFO namenode.EditLogFileOutputStream (EditLogFileOutputStream.java:flushAndSync(200)) - Nothing to flush
2014-07-02 21:23:25,970 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(8414)) - allowed=true ugi=jenkins (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/ dst=null perm=jenkins:supergroup:rwxr-xr-x proto=rpc
2014-07-02 21:23:25,974 DEBUG hdfs.DFSClient (DFSClient.java:create(1459)) - /tmp.txt: masked=rw-r--r--
2014-07-02 21:23:26,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(8414)) - allowed=true ugi=jenkins (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp.txt dst=null perm=jenkins:supergroup:rw-r--r-- proto=rpc
2014-07-02 21:23:26,010 DEBUG hdfs.DFSClient (DFSOutputStream.java:computePacketChunkSize(1669)) - computePacketChunkSize: src=/tmp.txt, chunkSize=14, chunksPerPacket=4681, packetSize=65534
2014-07-02 21:23:26,022 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1739)) - DFSClient writeChunk allocating new packet seqno=0, src=/tmp.txt, packetSize=65534, chunksPerPacket=4681, bytesCurBlock=0
2014-07-02 21:23:26,023 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1758)) - DFSClient writeChunk packet full seqno=0, src=/tmp.txt, bytesCurBlock=10, blockSize=10, appendChunk=false
2014-07-02 21:23:26,023 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 0
2014-07-02 21:23:26,023 DEBUG hdfs.DFSClient (DFSOutputStream.java:computePacketChunkSize(1669)) - computePacketChunkSize: src=/tmp.txt, chunkSize=14, chunksPerPacket=1, packetSize=14
2014-07-02 21:23:26,023 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 1
2014-07-02 21:23:26,024 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1739)) - DFSClient writeChunk allocating new packet seqno=2, src=/tmp.txt, packetSize=14, chunksPerPacket=1, bytesCurBlock=0
2014-07-02 21:23:26,023 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(517)) - Allocating new block
2014-07-02 21:23:26,025 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1758)) - DFSClient writeChunk packet full seqno=2, src=/tmp.txt, bytesCurBlock=10, blockSize=10, appendChunk=false
2014-07-02 21:23:26,025 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 2
2014-07-02 21:23:26,026 DEBUG hdfs.DFSClient (DFSOutputStream.java:computePacketChunkSize(1669)) - computePacketChunkSize: src=/tmp.txt, chunkSize=14, chunksPerPacket=1, packetSize=14
2014-07-02 21:23:26,026 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 3
2014-07-02 21:23:26,027 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1739)) - DFSClient writeChunk allocating new packet seqno=4, src=/tmp.txt, packetSize=14, chunksPerPacket=1, bytesCurBlock=0
2014-07-02 21:23:26,027 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1758)) - DFSClient writeChunk packet full seqno=4, src=/tmp.txt, bytesCurBlock=10, blockSize=10, appendChunk=false
2014-07-02 21:23:26,027 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 4
2014-07-02 21:23:26,027 DEBUG hdfs.DFSClient (DFSOutputStream.java:computePacketChunkSize(1669)) - computePacketChunkSize: src=/tmp.txt, chunkSize=14, chunksPerPacket=1, packetSize=14
2014-07-02 21:23:26,028 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 5
2014-07-02 21:23:26,028 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1739)) - DFSClient writeChunk allocating new packet seqno=6, src=/tmp.txt, packetSize=14, chunksPerPacket=1, bytesCurBlock=0
2014-07-02 21:23:26,028 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1758)) - DFSClient writeChunk packet full seqno=6, src=/tmp.txt, bytesCurBlock=10, blockSize=10, appendChunk=false
2014-07-02 21:23:26,029 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 6
2014-07-02 21:23:26,029 DEBUG hdfs.DFSClient (DFSOutputStream.java:computePacketChunkSize(1669)) - computePacketChunkSize: src=/tmp.txt, chunkSize=14, chunksPerPacket=1, packetSize=14
2014-07-02 21:23:26,029 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 7
2014-07-02 21:23:26,029 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1739)) - DFSClient writeChunk allocating new packet seqno=8, src=/tmp.txt, packetSize=14, chunksPerPacket=1, bytesCurBlock=0
2014-07-02 21:23:26,030 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1758)) - DFSClient writeChunk packet full seqno=8, src=/tmp.txt, bytesCurBlock=10, blockSize=10, appendChunk=false
2014-07-02 21:23:26,030 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 8
2014-07-02 21:23:26,030 DEBUG hdfs.DFSClient (DFSOutputStream.java:computePacketChunkSize(1669)) - computePacketChunkSize: src=/tmp.txt, chunkSize=14, chunksPerPacket=1, packetSize=14
2014-07-02 21:23:26,030 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 9
2014-07-02 21:23:26,031 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1739)) - DFSClient writeChunk allocating new packet seqno=10, src=/tmp.txt, packetSize=14, chunksPerPacket=1, bytesCurBlock=0
2014-07-02 21:23:26,031 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1758)) - DFSClient writeChunk packet full seqno=10, src=/tmp.txt, bytesCurBlock=10, blockSize=10, appendChunk=false
2014-07-02 21:23:26,032 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 10
2014-07-02 21:23:26,032 DEBUG hdfs.DFSClient (DFSOutputStream.java:computePacketChunkSize(1669)) - computePacketChunkSize: src=/tmp.txt, chunkSize=14, chunksPerPacket=1, packetSize=14
2014-07-02 21:23:26,032 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 11
2014-07-02 21:23:26,032 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1739)) - DFSClient writeChunk allocating new packet seqno=12, src=/tmp.txt, packetSize=14, chunksPerPacket=1, bytesCurBlock=0
2014-07-02 21:23:26,033 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1758)) - DFSClient writeChunk packet full seqno=12, src=/tmp.txt, bytesCurBlock=10, blockSize=10, appendChunk=false
2014-07-02 21:23:26,033 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 12
2014-07-02 21:23:26,033 DEBUG hdfs.DFSClient (DFSOutputStream.java:computePacketChunkSize(1669)) - computePacketChunkSize: src=/tmp.txt, chunkSize=14, chunksPerPacket=1, packetSize=14
2014-07-02 21:23:26,033 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 13
2014-07-02 21:23:26,033 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1739)) - DFSClient writeChunk allocating new packet seqno=14, src=/tmp.txt, packetSize=14, chunksPerPacket=1, bytesCurBlock=0
2014-07-02 21:23:26,034 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1758)) - DFSClient writeChunk packet full seqno=14, src=/tmp.txt, bytesCurBlock=10, blockSize=10, appendChunk=false
2014-07-02 21:23:26,034 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 14
2014-07-02 21:23:26,034 DEBUG hdfs.DFSClient (DFSOutputStream.java:computePacketChunkSize(1669)) - computePacketChunkSize: src=/tmp.txt, chunkSize=14, chunksPerPacket=1, packetSize=14
2014-07-02 21:23:26,034 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3215)) - BLOCK* allocateBlock: /tmp.txt. BP-300692236-67.195.138.20-1404336203992 blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]}
2014-07-02 21:23:26,034 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 15
2014-07-02 21:23:26,035 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1739)) - DFSClient writeChunk allocating new packet seqno=16, src=/tmp.txt, packetSize=14, chunksPerPacket=1, bytesCurBlock=0
2014-07-02 21:23:26,035 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1758)) - DFSClient writeChunk packet full seqno=16, src=/tmp.txt, bytesCurBlock=10, blockSize=10, appendChunk=false
2014-07-02 21:23:26,035 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 16
2014-07-02 21:23:26,035 DEBUG hdfs.DFSClient (DFSOutputStream.java:computePacketChunkSize(1669)) - computePacketChunkSize: src=/tmp.txt, chunkSize=14, chunksPerPacket=1, packetSize=14
2014-07-02 21:23:26,036 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 17
2014-07-02 21:23:26,036 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1739)) - DFSClient writeChunk allocating new packet seqno=18, src=/tmp.txt, packetSize=14, chunksPerPacket=1, bytesCurBlock=0
2014-07-02 21:23:26,036 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1758)) - DFSClient writeChunk packet full seqno=18, src=/tmp.txt, bytesCurBlock=10, blockSize=10, appendChunk=false
2014-07-02 21:23:26,036 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 18
2014-07-02 21:23:26,036 DEBUG hdfs.DFSClient (DFSOutputStream.java:computePacketChunkSize(1669)) - computePacketChunkSize: src=/tmp.txt, chunkSize=14, chunksPerPacket=1, packetSize=14
2014-07-02 21:23:26,037 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 19
2014-07-02 21:23:26,037 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1739)) - DFSClient writeChunk allocating new packet seqno=20, src=/tmp.txt, packetSize=14, chunksPerPacket=1, bytesCurBlock=0
2014-07-02 21:23:26,037 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1758)) - DFSClient writeChunk packet full seqno=20, src=/tmp.txt, bytesCurBlock=10, blockSize=10, appendChunk=false
2014-07-02 21:23:26,037 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 20
2014-07-02 21:23:26,037 DEBUG hdfs.DFSClient (DFSOutputStream.java:computePacketChunkSize(1669)) - computePacketChunkSize: src=/tmp.txt, chunkSize=14, chunksPerPacket=1, packetSize=14
2014-07-02 21:23:26,038 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 21
2014-07-02 21:23:26,038 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1739)) - DFSClient writeChunk allocating new packet seqno=22, src=/tmp.txt, packetSize=14, chunksPerPacket=1, bytesCurBlock=0
2014-07-02 21:23:26,038 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1758)) - DFSClient writeChunk packet full seqno=22, src=/tmp.txt, bytesCurBlock=10, blockSize=10, appendChunk=false
2014-07-02 21:23:26,038 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 22
2014-07-02 21:23:26,039 DEBUG hdfs.DFSClient (DFSOutputStream.java:computePacketChunkSize(1669)) - computePacketChunkSize: src=/tmp.txt, chunkSize=14, chunksPerPacket=1, packetSize=14
2014-07-02 21:23:26,039 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 23
2014-07-02 21:23:26,039 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1739)) - DFSClient writeChunk allocating new packet seqno=24, src=/tmp.txt, packetSize=14, chunksPerPacket=1, bytesCurBlock=0
2014-07-02 21:23:26,039 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1758)) - DFSClient writeChunk packet full seqno=24, src=/tmp.txt, bytesCurBlock=10, blockSize=10, appendChunk=false
2014-07-02 21:23:26,039 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 24
2014-07-02 21:23:26,040 DEBUG hdfs.DFSClient (DFSOutputStream.java:computePacketChunkSize(1669)) - computePacketChunkSize: src=/tmp.txt, chunkSize=14, chunksPerPacket=1, packetSize=14
2014-07-02 21:23:26,040 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 25
2014-07-02 21:23:26,040 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1739)) - DFSClient writeChunk allocating new packet seqno=26, src=/tmp.txt, packetSize=14, chunksPerPacket=1, bytesCurBlock=0
2014-07-02 21:23:26,040 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1758)) - DFSClient writeChunk packet full seqno=26, src=/tmp.txt, bytesCurBlock=10, blockSize=10, appendChunk=false
2014-07-02 21:23:26,040 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 26
2014-07-02 21:23:26,041 DEBUG hdfs.DFSClient (DFSOutputStream.java:computePacketChunkSize(1669)) - computePacketChunkSize: src=/tmp.txt, chunkSize=14, chunksPerPacket=1, packetSize=14
2014-07-02 21:23:26,041 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 27
2014-07-02 21:23:26,041 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1739)) - DFSClient writeChunk allocating new packet seqno=28, src=/tmp.txt, packetSize=14, chunksPerPacket=1, bytesCurBlock=0
2014-07-02 21:23:26,055 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1758)) - DFSClient writeChunk packet full seqno=28, src=/tmp.txt, bytesCurBlock=10, blockSize=10, appendChunk=false
2014-07-02 21:23:26,055 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 28
2014-07-02 21:23:26,056 DEBUG hdfs.DFSClient (DFSOutputStream.java:computePacketChunkSize(1669)) - computePacketChunkSize: src=/tmp.txt, chunkSize=14, chunksPerPacket=1, packetSize=14
2014-07-02 21:23:26,056 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 29
2014-07-02 21:23:26,056 DEBUG hdfs.DFSClient (DFSOutputStream.java:waitForAckedSeqno(2013)) - Waiting for ack for: 29
2014-07-02 21:23:26,064 DEBUG hdfs.DFSClient (DFSOutputStream.java:createBlockOutputStream(1309)) - pipeline = 127.0.0.1:55922
2014-07-02 21:23:26,064 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1517)) - Connecting to datanode 127.0.0.1:55922
2014-07-02 21:23:26,065 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1526)) - Send buf size 131071
2014-07-02 21:23:26,094 INFO datanode.DataNode (DataXceiver.java:writeBlock(600)) - Receiving BP-300692236-67.195.138.20-1404336203992:blk_1073741825_1001 src: /127.0.0.1:35057 dest: /127.0.0.1:55922
2014-07-02 21:23:26,100 WARN datanode.DataNode (BlockReceiver.java:<init>(230)) - Could not get file descriptor for outputstream of class class org.apache.hadoop.hdfs.server.datanode.SimulatedFSDataset$SimulatedOutputStream
2014-07-02 21:23:26,143 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741825_1001 sending packet packet seqno:0 offsetInBlock:0 lastPacketInBlock:false lastByteOffsetInBlock: 10
2014-07-02 21:23:26,158 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 0 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,159 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741825_1001 sending packet packet seqno:1 offsetInBlock:10 lastPacketInBlock:true lastByteOffsetInBlock: 10
2014-07-02 21:23:26,160 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1243)) - src: /127.0.0.1:35057, dest: /127.0.0.1:55922, bytes: 10, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1332513431_1, offset: 0, srvID: 9fa6616c-20cd-44e6-8b90-ac1acb4d65de, blockid: BP-300692236-67.195.138.20-1404336203992:blk_1073741825_1001, duration: 39196568
2014-07-02 21:23:26,160 INFO datanode.DataNode (BlockReceiver.java:run(1224)) - PacketResponder: BP-300692236-67.195.138.20-1404336203992:blk_1073741825_1001, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2014-07-02 21:23:26,161 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 1 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,161 DEBUG hdfs.DFSClient (DFSOutputStream.java:endBlock(445)) - Closing old block BP-300692236-67.195.138.20-1404336203992:blk_1073741825_1001
2014-07-02 21:23:26,161 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2380)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55922 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]} size 0
2014-07-02 21:23:26,161 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(517)) - Allocating new block
2014-07-02 21:23:26,167 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3215)) - BLOCK* allocateBlock: /tmp.txt. BP-300692236-67.195.138.20-1404336203992 blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]}
2014-07-02 21:23:26,169 DEBUG hdfs.DFSClient (DFSOutputStream.java:createBlockOutputStream(1309)) - pipeline = 127.0.0.1:55922
2014-07-02 21:23:26,169 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1517)) - Connecting to datanode 127.0.0.1:55922
2014-07-02 21:23:26,170 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1526)) - Send buf size 131071
2014-07-02 21:23:26,172 INFO datanode.DataNode (DataXceiver.java:writeBlock(600)) - Receiving BP-300692236-67.195.138.20-1404336203992:blk_1073741826_1002 src: /127.0.0.1:35058 dest: /127.0.0.1:55922
2014-07-02 21:23:26,172 WARN datanode.DataNode (BlockReceiver.java:<init>(230)) - Could not get file descriptor for outputstream of class class org.apache.hadoop.hdfs.server.datanode.SimulatedFSDataset$SimulatedOutputStream
2014-07-02 21:23:26,173 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741826_1002 sending packet packet seqno:2 offsetInBlock:0 lastPacketInBlock:false lastByteOffsetInBlock: 10
2014-07-02 21:23:26,174 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 2 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,174 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741826_1002 sending packet packet seqno:3 offsetInBlock:10 lastPacketInBlock:true lastByteOffsetInBlock: 10
2014-07-02 21:23:26,174 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1243)) - src: /127.0.0.1:35058, dest: /127.0.0.1:55922, bytes: 10, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1332513431_1, offset: 0, srvID: 9fa6616c-20cd-44e6-8b90-ac1acb4d65de, blockid: BP-300692236-67.195.138.20-1404336203992:blk_1073741826_1002, duration: 1534670
2014-07-02 21:23:26,174 INFO datanode.DataNode (BlockReceiver.java:run(1224)) - PacketResponder: BP-300692236-67.195.138.20-1404336203992:blk_1073741826_1002, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2014-07-02 21:23:26,175 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 3 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,175 DEBUG hdfs.DFSClient (DFSOutputStream.java:endBlock(445)) - Closing old block BP-300692236-67.195.138.20-1404336203992:blk_1073741826_1002
2014-07-02 21:23:26,175 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(517)) - Allocating new block
2014-07-02 21:23:26,176 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2380)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55922 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]} size 0
2014-07-02 21:23:26,178 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3215)) - BLOCK* allocateBlock: /tmp.txt. BP-300692236-67.195.138.20-1404336203992 blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]}
2014-07-02 21:23:26,181 DEBUG hdfs.DFSClient (DFSOutputStream.java:createBlockOutputStream(1309)) - pipeline = 127.0.0.1:55922
2014-07-02 21:23:26,181 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1517)) - Connecting to datanode 127.0.0.1:55922
2014-07-02 21:23:26,181 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1526)) - Send buf size 131071
2014-07-02 21:23:26,182 INFO datanode.DataNode (DataXceiver.java:writeBlock(600)) - Receiving BP-300692236-67.195.138.20-1404336203992:blk_1073741827_1003 src: /127.0.0.1:35059 dest: /127.0.0.1:55922
2014-07-02 21:23:26,183 WARN datanode.DataNode (BlockReceiver.java:<init>(230)) - Could not get file descriptor for outputstream of class class org.apache.hadoop.hdfs.server.datanode.SimulatedFSDataset$SimulatedOutputStream
2014-07-02 21:23:26,183 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741827_1003 sending packet packet seqno:4 offsetInBlock:0 lastPacketInBlock:false lastByteOffsetInBlock: 10
2014-07-02 21:23:26,184 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 4 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,184 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741827_1003 sending packet packet seqno:5 offsetInBlock:10 lastPacketInBlock:true lastByteOffsetInBlock: 10
2014-07-02 21:23:26,185 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1243)) - src: /127.0.0.1:35059, dest: /127.0.0.1:55922, bytes: 10, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1332513431_1, offset: 0, srvID: 9fa6616c-20cd-44e6-8b90-ac1acb4d65de, blockid: BP-300692236-67.195.138.20-1404336203992:blk_1073741827_1003, duration: 865703
2014-07-02 21:23:26,185 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 5 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,185 INFO datanode.DataNode (BlockReceiver.java:run(1224)) - PacketResponder: BP-300692236-67.195.138.20-1404336203992:blk_1073741827_1003, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2014-07-02 21:23:26,186 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2380)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55922 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]} size 0
2014-07-02 21:23:26,186 DEBUG hdfs.DFSClient (DFSOutputStream.java:endBlock(445)) - Closing old block BP-300692236-67.195.138.20-1404336203992:blk_1073741827_1003
2014-07-02 21:23:26,186 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(517)) - Allocating new block
2014-07-02 21:23:26,188 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3215)) - BLOCK* allocateBlock: /tmp.txt. BP-300692236-67.195.138.20-1404336203992 blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]}
2014-07-02 21:23:26,190 DEBUG hdfs.DFSClient (DFSOutputStream.java:createBlockOutputStream(1309)) - pipeline = 127.0.0.1:55922
2014-07-02 21:23:26,190 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1517)) - Connecting to datanode 127.0.0.1:55922
2014-07-02 21:23:26,191 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1526)) - Send buf size 131071
2014-07-02 21:23:26,191 INFO datanode.DataNode (DataXceiver.java:writeBlock(600)) - Receiving BP-300692236-67.195.138.20-1404336203992:blk_1073741828_1004 src: /127.0.0.1:35060 dest: /127.0.0.1:55922
2014-07-02 21:23:26,192 WARN datanode.DataNode (BlockReceiver.java:<init>(230)) - Could not get file descriptor for outputstream of class class org.apache.hadoop.hdfs.server.datanode.SimulatedFSDataset$SimulatedOutputStream
2014-07-02 21:23:26,192 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741828_1004 sending packet packet seqno:6 offsetInBlock:0 lastPacketInBlock:false lastByteOffsetInBlock: 10
2014-07-02 21:23:26,193 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 6 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,193 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741828_1004 sending packet packet seqno:7 offsetInBlock:10 lastPacketInBlock:true lastByteOffsetInBlock: 10
2014-07-02 21:23:26,194 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1243)) - src: /127.0.0.1:35060, dest: /127.0.0.1:55922, bytes: 10, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1332513431_1, offset: 0, srvID: 9fa6616c-20cd-44e6-8b90-ac1acb4d65de, blockid: BP-300692236-67.195.138.20-1404336203992:blk_1073741828_1004, duration: 1125756
2014-07-02 21:23:26,194 INFO datanode.DataNode (BlockReceiver.java:run(1224)) - PacketResponder: BP-300692236-67.195.138.20-1404336203992:blk_1073741828_1004, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2014-07-02 21:23:26,194 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 7 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,194 DEBUG hdfs.DFSClient (DFSOutputStream.java:endBlock(445)) - Closing old block BP-300692236-67.195.138.20-1404336203992:blk_1073741828_1004
2014-07-02 21:23:26,194 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(517)) - Allocating new block
2014-07-02 21:23:26,195 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2380)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55922 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]} size 0
2014-07-02 21:23:26,196 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3215)) - BLOCK* allocateBlock: /tmp.txt. BP-300692236-67.195.138.20-1404336203992 blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]}
2014-07-02 21:23:26,198 DEBUG hdfs.DFSClient (DFSOutputStream.java:createBlockOutputStream(1309)) - pipeline = 127.0.0.1:55922
2014-07-02 21:23:26,198 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1517)) - Connecting to datanode 127.0.0.1:55922
2014-07-02 21:23:26,199 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1526)) - Send buf size 131071
2014-07-02 21:23:26,199 INFO datanode.DataNode (DataXceiver.java:writeBlock(600)) - Receiving BP-300692236-67.195.138.20-1404336203992:blk_1073741829_1005 src: /127.0.0.1:35061 dest: /127.0.0.1:55922
2014-07-02 21:23:26,200 WARN datanode.DataNode (BlockReceiver.java:<init>(230)) - Could not get file descriptor for outputstream of class class org.apache.hadoop.hdfs.server.datanode.SimulatedFSDataset$SimulatedOutputStream
2014-07-02 21:23:26,201 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741829_1005 sending packet packet seqno:8 offsetInBlock:0 lastPacketInBlock:false lastByteOffsetInBlock: 10
2014-07-02 21:23:26,202 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 8 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,202 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741829_1005 sending packet packet seqno:9 offsetInBlock:10 lastPacketInBlock:true lastByteOffsetInBlock: 10
2014-07-02 21:23:26,203 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1243)) - src: /127.0.0.1:35061, dest: /127.0.0.1:55922, bytes: 10, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1332513431_1, offset: 0, srvID: 9fa6616c-20cd-44e6-8b90-ac1acb4d65de, blockid: BP-300692236-67.195.138.20-1404336203992:blk_1073741829_1005, duration: 1883392
2014-07-02 21:23:26,203 INFO datanode.DataNode (BlockReceiver.java:run(1224)) - PacketResponder: BP-300692236-67.195.138.20-1404336203992:blk_1073741829_1005, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2014-07-02 21:23:26,203 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 9 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,203 DEBUG hdfs.DFSClient (DFSOutputStream.java:endBlock(445)) - Closing old block BP-300692236-67.195.138.20-1404336203992:blk_1073741829_1005
2014-07-02 21:23:26,203 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(517)) - Allocating new block
2014-07-02 21:23:26,204 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2380)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55922 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]} size 0
2014-07-02 21:23:26,205 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3215)) - BLOCK* allocateBlock: /tmp.txt. BP-300692236-67.195.138.20-1404336203992 blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]}
2014-07-02 21:23:26,207 DEBUG hdfs.DFSClient (DFSOutputStream.java:createBlockOutputStream(1309)) - pipeline = 127.0.0.1:55922
2014-07-02 21:23:26,207 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1517)) - Connecting to datanode 127.0.0.1:55922
2014-07-02 21:23:26,207 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1526)) - Send buf size 131071
2014-07-02 21:23:26,208 INFO datanode.DataNode (DataXceiver.java:writeBlock(600)) - Receiving BP-300692236-67.195.138.20-1404336203992:blk_1073741830_1006 src: /127.0.0.1:35062 dest: /127.0.0.1:55922
2014-07-02 21:23:26,208 WARN datanode.DataNode (BlockReceiver.java:<init>(230)) - Could not get file descriptor for outputstream of class class org.apache.hadoop.hdfs.server.datanode.SimulatedFSDataset$SimulatedOutputStream
2014-07-02 21:23:26,209 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741830_1006 sending packet packet seqno:10 offsetInBlock:0 lastPacketInBlock:false lastByteOffsetInBlock: 10
2014-07-02 21:23:26,210 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 10 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,210 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741830_1006 sending packet packet seqno:11 offsetInBlock:10 lastPacketInBlock:true lastByteOffsetInBlock: 10
2014-07-02 21:23:26,211 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1243)) - src: /127.0.0.1:35062, dest: /127.0.0.1:55922, bytes: 10, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1332513431_1, offset: 0, srvID: 9fa6616c-20cd-44e6-8b90-ac1acb4d65de, blockid: BP-300692236-67.195.138.20-1404336203992:blk_1073741830_1006, duration: 1411554
2014-07-02 21:23:26,211 INFO datanode.DataNode (BlockReceiver.java:run(1224)) - PacketResponder: BP-300692236-67.195.138.20-1404336203992:blk_1073741830_1006, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2014-07-02 21:23:26,211 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 11 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,212 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2380)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55922 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]} size 0
2014-07-02 21:23:26,212 DEBUG hdfs.DFSClient (DFSOutputStream.java:endBlock(445)) - Closing old block BP-300692236-67.195.138.20-1404336203992:blk_1073741830_1006
2014-07-02 21:23:26,212 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(517)) - Allocating new block
2014-07-02 21:23:26,213 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3215)) - BLOCK* allocateBlock: /tmp.txt. BP-300692236-67.195.138.20-1404336203992 blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]}
2014-07-02 21:23:26,216 DEBUG hdfs.DFSClient (DFSOutputStream.java:createBlockOutputStream(1309)) - pipeline = 127.0.0.1:55922
2014-07-02 21:23:26,216 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1517)) - Connecting to datanode 127.0.0.1:55922
2014-07-02 21:23:26,216 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1526)) - Send buf size 131071
2014-07-02 21:23:26,217 INFO datanode.DataNode (DataXceiver.java:writeBlock(600)) - Receiving BP-300692236-67.195.138.20-1404336203992:blk_1073741831_1007 src: /127.0.0.1:35063 dest: /127.0.0.1:55922
2014-07-02 21:23:26,218 WARN datanode.DataNode (BlockReceiver.java:<init>(230)) - Could not get file descriptor for outputstream of class class org.apache.hadoop.hdfs.server.datanode.SimulatedFSDataset$SimulatedOutputStream
2014-07-02 21:23:26,218 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741831_1007 sending packet packet seqno:12 offsetInBlock:0 lastPacketInBlock:false lastByteOffsetInBlock: 10
2014-07-02 21:23:26,219 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 12 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,219 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741831_1007 sending packet packet seqno:13 offsetInBlock:10 lastPacketInBlock:true lastByteOffsetInBlock: 10
2014-07-02 21:23:26,220 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1243)) - src: /127.0.0.1:35063, dest: /127.0.0.1:55922, bytes: 10, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1332513431_1, offset: 0, srvID: 9fa6616c-20cd-44e6-8b90-ac1acb4d65de, blockid: BP-300692236-67.195.138.20-1404336203992:blk_1073741831_1007, duration: 1312628
2014-07-02 21:23:26,220 INFO datanode.DataNode (BlockReceiver.java:run(1224)) - PacketResponder: BP-300692236-67.195.138.20-1404336203992:blk_1073741831_1007, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2014-07-02 21:23:26,220 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 13 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,220 DEBUG hdfs.DFSClient (DFSOutputStream.java:endBlock(445)) - Closing old block BP-300692236-67.195.138.20-1404336203992:blk_1073741831_1007
2014-07-02 21:23:26,221 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2380)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55922 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]} size 0
2014-07-02 21:23:26,221 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(517)) - Allocating new block
2014-07-02 21:23:26,222 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3215)) - BLOCK* allocateBlock: /tmp.txt. BP-300692236-67.195.138.20-1404336203992 blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]}
2014-07-02 21:23:26,224 DEBUG hdfs.DFSClient (DFSOutputStream.java:createBlockOutputStream(1309)) - pipeline = 127.0.0.1:55922
2014-07-02 21:23:26,224 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1517)) - Connecting to datanode 127.0.0.1:55922
2014-07-02 21:23:26,225 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1526)) - Send buf size 131071
2014-07-02 21:23:26,225 INFO datanode.DataNode (DataXceiver.java:writeBlock(600)) - Receiving BP-300692236-67.195.138.20-1404336203992:blk_1073741832_1008 src: /127.0.0.1:35064 dest: /127.0.0.1:55922
2014-07-02 21:23:26,226 WARN datanode.DataNode (BlockReceiver.java:<init>(230)) - Could not get file descriptor for outputstream of class class org.apache.hadoop.hdfs.server.datanode.SimulatedFSDataset$SimulatedOutputStream
2014-07-02 21:23:26,226 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741832_1008 sending packet packet seqno:14 offsetInBlock:0 lastPacketInBlock:false lastByteOffsetInBlock: 10
2014-07-02 21:23:26,227 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 14 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,227 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741832_1008 sending packet packet seqno:15 offsetInBlock:10 lastPacketInBlock:true lastByteOffsetInBlock: 10
2014-07-02 21:23:26,228 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1243)) - src: /127.0.0.1:35064, dest: /127.0.0.1:55922, bytes: 10, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1332513431_1, offset: 0, srvID: 9fa6616c-20cd-44e6-8b90-ac1acb4d65de, blockid: BP-300692236-67.195.138.20-1404336203992:blk_1073741832_1008, duration: 1381885
2014-07-02 21:23:26,228 INFO datanode.DataNode (BlockReceiver.java:run(1224)) - PacketResponder: BP-300692236-67.195.138.20-1404336203992:blk_1073741832_1008, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2014-07-02 21:23:26,230 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2380)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55922 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]} size 0
2014-07-02 21:23:26,231 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 15 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,232 DEBUG hdfs.DFSClient (DFSOutputStream.java:endBlock(445)) - Closing old block BP-300692236-67.195.138.20-1404336203992:blk_1073741832_1008
2014-07-02 21:23:26,232 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(517)) - Allocating new block
2014-07-02 21:23:26,233 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3215)) - BLOCK* allocateBlock: /tmp.txt. BP-300692236-67.195.138.20-1404336203992 blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]}
2014-07-02 21:23:26,236 DEBUG hdfs.DFSClient (DFSOutputStream.java:createBlockOutputStream(1309)) - pipeline = 127.0.0.1:55922
2014-07-02 21:23:26,236 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1517)) - Connecting to datanode 127.0.0.1:55922
2014-07-02 21:23:26,236 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1526)) - Send buf size 131071
2014-07-02 21:23:26,237 INFO datanode.DataNode (DataXceiver.java:writeBlock(600)) - Receiving BP-300692236-67.195.138.20-1404336203992:blk_1073741833_1009 src: /127.0.0.1:35065 dest: /127.0.0.1:55922
2014-07-02 21:23:26,237 WARN datanode.DataNode (BlockReceiver.java:<init>(230)) - Could not get file descriptor for outputstream of class class org.apache.hadoop.hdfs.server.datanode.SimulatedFSDataset$SimulatedOutputStream
2014-07-02 21:23:26,238 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741833_1009 sending packet packet seqno:16 offsetInBlock:0 lastPacketInBlock:false lastByteOffsetInBlock: 10
2014-07-02 21:23:26,239 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 16 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,240 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741833_1009 sending packet packet seqno:17 offsetInBlock:10 lastPacketInBlock:true lastByteOffsetInBlock: 10
2014-07-02 21:23:26,240 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1243)) - src: /127.0.0.1:35065, dest: /127.0.0.1:55922, bytes: 10, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1332513431_1, offset: 0, srvID: 9fa6616c-20cd-44e6-8b90-ac1acb4d65de, blockid: BP-300692236-67.195.138.20-1404336203992:blk_1073741833_1009, duration: 2040926
2014-07-02 21:23:26,240 INFO datanode.DataNode (BlockReceiver.java:run(1224)) - PacketResponder: BP-300692236-67.195.138.20-1404336203992:blk_1073741833_1009, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2014-07-02 21:23:26,241 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 17 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,241 DEBUG hdfs.DFSClient (DFSOutputStream.java:endBlock(445)) - Closing old block BP-300692236-67.195.138.20-1404336203992:blk_1073741833_1009
2014-07-02 21:23:26,241 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(517)) - Allocating new block
2014-07-02 21:23:26,241 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2380)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55922 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]} size 0
2014-07-02 21:23:26,242 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3215)) - BLOCK* allocateBlock: /tmp.txt. BP-300692236-67.195.138.20-1404336203992 blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]}
2014-07-02 21:23:26,244 DEBUG hdfs.DFSClient (DFSOutputStream.java:createBlockOutputStream(1309)) - pipeline = 127.0.0.1:55922
2014-07-02 21:23:26,245 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1517)) - Connecting to datanode 127.0.0.1:55922
2014-07-02 21:23:26,245 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1526)) - Send buf size 131071
2014-07-02 21:23:26,246 INFO datanode.DataNode (DataXceiver.java:writeBlock(600)) - Receiving BP-300692236-67.195.138.20-1404336203992:blk_1073741834_1010 src: /127.0.0.1:35066 dest: /127.0.0.1:55922
2014-07-02 21:23:26,246 WARN datanode.DataNode (BlockReceiver.java:<init>(230)) - Could not get file descriptor for outputstream of class class org.apache.hadoop.hdfs.server.datanode.SimulatedFSDataset$SimulatedOutputStream
2014-07-02 21:23:26,247 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741834_1010 sending packet packet seqno:18 offsetInBlock:0 lastPacketInBlock:false lastByteOffsetInBlock: 10
2014-07-02 21:23:26,248 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 18 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,248 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741834_1010 sending packet packet seqno:19 offsetInBlock:10 lastPacketInBlock:true lastByteOffsetInBlock: 10
2014-07-02 21:23:26,249 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1243)) - src: /127.0.0.1:35066, dest: /127.0.0.1:55922, bytes: 10, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1332513431_1, offset: 0, srvID: 9fa6616c-20cd-44e6-8b90-ac1acb4d65de, blockid: BP-300692236-67.195.138.20-1404336203992:blk_1073741834_1010, duration: 1562644
2014-07-02 21:23:26,249 INFO datanode.DataNode (BlockReceiver.java:run(1224)) - PacketResponder: BP-300692236-67.195.138.20-1404336203992:blk_1073741834_1010, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2014-07-02 21:23:26,249 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 19 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,249 DEBUG hdfs.DFSClient (DFSOutputStream.java:endBlock(445)) - Closing old block BP-300692236-67.195.138.20-1404336203992:blk_1073741834_1010
2014-07-02 21:23:26,249 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(517)) - Allocating new block
2014-07-02 21:23:26,250 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2380)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55922 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]} size 0
2014-07-02 21:23:26,251 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3215)) - BLOCK* allocateBlock: /tmp.txt. BP-300692236-67.195.138.20-1404336203992 blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]}
2014-07-02 21:23:26,253 DEBUG hdfs.DFSClient (DFSOutputStream.java:createBlockOutputStream(1309)) - pipeline = 127.0.0.1:55922
2014-07-02 21:23:26,253 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1517)) - Connecting to datanode 127.0.0.1:55922
2014-07-02 21:23:26,253 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1526)) - Send buf size 131071
2014-07-02 21:23:26,254 INFO datanode.DataNode (DataXceiver.java:writeBlock(600)) - Receiving BP-300692236-67.195.138.20-1404336203992:blk_1073741835_1011 src: /127.0.0.1:35067 dest: /127.0.0.1:55922
2014-07-02 21:23:26,255 WARN datanode.DataNode (BlockReceiver.java:<init>(230)) - Could not get file descriptor for outputstream of class class org.apache.hadoop.hdfs.server.datanode.SimulatedFSDataset$SimulatedOutputStream
2014-07-02 21:23:26,256 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741835_1011 sending packet packet seqno:20 offsetInBlock:0 lastPacketInBlock:false lastByteOffsetInBlock: 10
2014-07-02 21:23:26,257 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 20 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,257 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741835_1011 sending packet packet seqno:21 offsetInBlock:10 lastPacketInBlock:true lastByteOffsetInBlock: 10
2014-07-02 21:23:26,258 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1243)) - src: /127.0.0.1:35067, dest: /127.0.0.1:55922, bytes: 10, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1332513431_1, offset: 0, srvID: 9fa6616c-20cd-44e6-8b90-ac1acb4d65de, blockid: BP-300692236-67.195.138.20-1404336203992:blk_1073741835_1011, duration: 954528
2014-07-02 21:23:26,258 INFO datanode.DataNode (BlockReceiver.java:run(1224)) - PacketResponder: BP-300692236-67.195.138.20-1404336203992:blk_1073741835_1011, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2014-07-02 21:23:26,258 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 21 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,258 DEBUG hdfs.DFSClient (DFSOutputStream.java:endBlock(445)) - Closing old block BP-300692236-67.195.138.20-1404336203992:blk_1073741835_1011
2014-07-02 21:23:26,258 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(517)) - Allocating new block
2014-07-02 21:23:26,259 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2380)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55922 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]} size 0
2014-07-02 21:23:26,260 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3215)) - BLOCK* allocateBlock: /tmp.txt. BP-300692236-67.195.138.20-1404336203992 blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]}
2014-07-02 21:23:26,263 DEBUG hdfs.DFSClient (DFSOutputStream.java:createBlockOutputStream(1309)) - pipeline = 127.0.0.1:55922
2014-07-02 21:23:26,263 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1517)) - Connecting to datanode 127.0.0.1:55922
2014-07-02 21:23:26,263 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1526)) - Send buf size 131071
2014-07-02 21:23:26,264 INFO datanode.DataNode (DataXceiver.java:writeBlock(600)) - Receiving BP-300692236-67.195.138.20-1404336203992:blk_1073741836_1012 src: /127.0.0.1:35068 dest: /127.0.0.1:55922
2014-07-02 21:23:26,265 WARN datanode.DataNode (BlockReceiver.java:<init>(230)) - Could not get file descriptor for outputstream of class class org.apache.hadoop.hdfs.server.datanode.SimulatedFSDataset$SimulatedOutputStream
2014-07-02 21:23:26,266 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741836_1012 sending packet packet seqno:22 offsetInBlock:0 lastPacketInBlock:false lastByteOffsetInBlock: 10
2014-07-02 21:23:26,266 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 22 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,267 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741836_1012 sending packet packet seqno:23 offsetInBlock:10 lastPacketInBlock:true lastByteOffsetInBlock: 10
2014-07-02 21:23:26,267 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1243)) - src: /127.0.0.1:35068, dest: /127.0.0.1:55922, bytes: 10, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1332513431_1, offset: 0, srvID: 9fa6616c-20cd-44e6-8b90-ac1acb4d65de, blockid: BP-300692236-67.195.138.20-1404336203992:blk_1073741836_1012, duration: 860655
2014-07-02 21:23:26,268 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 23 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,268 INFO datanode.DataNode (BlockReceiver.java:run(1224)) - PacketResponder: BP-300692236-67.195.138.20-1404336203992:blk_1073741836_1012, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2014-07-02 21:23:26,268 DEBUG hdfs.DFSClient (DFSOutputStream.java:endBlock(445)) - Closing old block BP-300692236-67.195.138.20-1404336203992:blk_1073741836_1012
2014-07-02 21:23:26,268 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(517)) - Allocating new block
2014-07-02 21:23:26,268 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2380)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55922 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]} size 0
2014-07-02 21:23:26,270 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3215)) - BLOCK* allocateBlock: /tmp.txt. BP-300692236-67.195.138.20-1404336203992 blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]}
2014-07-02 21:23:26,272 DEBUG hdfs.DFSClient (DFSOutputStream.java:createBlockOutputStream(1309)) - pipeline = 127.0.0.1:55922
2014-07-02 21:23:26,272 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1517)) - Connecting to datanode 127.0.0.1:55922
2014-07-02 21:23:26,272 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1526)) - Send buf size 131071
2014-07-02 21:23:26,273 INFO datanode.DataNode (DataXceiver.java:writeBlock(600)) - Receiving BP-300692236-67.195.138.20-1404336203992:blk_1073741837_1013 src: /127.0.0.1:35069 dest: /127.0.0.1:55922
2014-07-02 21:23:26,274 WARN datanode.DataNode (BlockReceiver.java:<init>(230)) - Could not get file descriptor for outputstream of class class org.apache.hadoop.hdfs.server.datanode.SimulatedFSDataset$SimulatedOutputStream
2014-07-02 21:23:26,275 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741837_1013 sending packet packet seqno:24 offsetInBlock:0 lastPacketInBlock:false lastByteOffsetInBlock: 10
2014-07-02 21:23:26,275 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 24 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,276 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741837_1013 sending packet packet seqno:25 offsetInBlock:10 lastPacketInBlock:true lastByteOffsetInBlock: 10
2014-07-02 21:23:26,276 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1243)) - src: /127.0.0.1:35069, dest: /127.0.0.1:55922, bytes: 10, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1332513431_1, offset: 0, srvID: 9fa6616c-20cd-44e6-8b90-ac1acb4d65de, blockid: BP-300692236-67.195.138.20-1404336203992:blk_1073741837_1013, duration: 1432469
2014-07-02 21:23:26,276 INFO datanode.DataNode (BlockReceiver.java:run(1224)) - PacketResponder: BP-300692236-67.195.138.20-1404336203992:blk_1073741837_1013, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2014-07-02 21:23:26,277 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 25 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,277 DEBUG hdfs.DFSClient (DFSOutputStream.java:endBlock(445)) - Closing old block BP-300692236-67.195.138.20-1404336203992:blk_1073741837_1013
2014-07-02 21:23:26,277 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2380)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55922 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]} size 0
2014-07-02 21:23:26,277 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(517)) - Allocating new block
2014-07-02 21:23:26,279 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3215)) - BLOCK* allocateBlock: /tmp.txt. BP-300692236-67.195.138.20-1404336203992 blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]}
2014-07-02 21:23:26,281 DEBUG hdfs.DFSClient (DFSOutputStream.java:createBlockOutputStream(1309)) - pipeline = 127.0.0.1:55922
2014-07-02 21:23:26,281 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1517)) - Connecting to datanode 127.0.0.1:55922
2014-07-02 21:23:26,281 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1526)) - Send buf size 131071
2014-07-02 21:23:26,282 INFO datanode.DataNode (DataXceiver.java:writeBlock(600)) - Receiving BP-300692236-67.195.138.20-1404336203992:blk_1073741838_1014 src: /127.0.0.1:35070 dest: /127.0.0.1:55922
2014-07-02 21:23:26,282 WARN datanode.DataNode (BlockReceiver.java:<init>(230)) - Could not get file descriptor for outputstream of class class org.apache.hadoop.hdfs.server.datanode.SimulatedFSDataset$SimulatedOutputStream
2014-07-02 21:23:26,283 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741838_1014 sending packet packet seqno:26 offsetInBlock:0 lastPacketInBlock:false lastByteOffsetInBlock: 10
2014-07-02 21:23:26,284 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 26 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,284 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741838_1014 sending packet packet seqno:27 offsetInBlock:10 lastPacketInBlock:true lastByteOffsetInBlock: 10
2014-07-02 21:23:26,284 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1243)) - src: /127.0.0.1:35070, dest: /127.0.0.1:55922, bytes: 10, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1332513431_1, offset: 0, srvID: 9fa6616c-20cd-44e6-8b90-ac1acb4d65de, blockid: BP-300692236-67.195.138.20-1404336203992:blk_1073741838_1014, duration: 1276344
2014-07-02 21:23:26,285 INFO datanode.DataNode (BlockReceiver.java:run(1224)) - PacketResponder: BP-300692236-67.195.138.20-1404336203992:blk_1073741838_1014, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2014-07-02 21:23:26,285 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 27 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,285 DEBUG hdfs.DFSClient (DFSOutputStream.java:endBlock(445)) - Closing old block BP-300692236-67.195.138.20-1404336203992:blk_1073741838_1014
2014-07-02 21:23:26,285 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2380)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55922 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]} size 0
2014-07-02 21:23:26,285 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(517)) - Allocating new block
2014-07-02 21:23:26,287 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3215)) - BLOCK* allocateBlock: /tmp.txt. BP-300692236-67.195.138.20-1404336203992 blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]}
2014-07-02 21:23:26,289 DEBUG hdfs.DFSClient (DFSOutputStream.java:createBlockOutputStream(1309)) - pipeline = 127.0.0.1:55922
2014-07-02 21:23:26,289 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1517)) - Connecting to datanode 127.0.0.1:55922
2014-07-02 21:23:26,289 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1526)) - Send buf size 131071
2014-07-02 21:23:26,290 INFO datanode.DataNode (DataXceiver.java:writeBlock(600)) - Receiving BP-300692236-67.195.138.20-1404336203992:blk_1073741839_1015 src: /127.0.0.1:35071 dest: /127.0.0.1:55922
2014-07-02 21:23:26,290 WARN datanode.DataNode (BlockReceiver.java:<init>(230)) - Could not get file descriptor for outputstream of class class org.apache.hadoop.hdfs.server.datanode.SimulatedFSDataset$SimulatedOutputStream
2014-07-02 21:23:26,291 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741839_1015 sending packet packet seqno:28 offsetInBlock:0 lastPacketInBlock:false lastByteOffsetInBlock: 10
2014-07-02 21:23:26,292 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 28 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,292 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741839_1015 sending packet packet seqno:29 offsetInBlock:10 lastPacketInBlock:true lastByteOffsetInBlock: 10
2014-07-02 21:23:26,293 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1243)) - src: /127.0.0.1:35071, dest: /127.0.0.1:55922, bytes: 10, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1332513431_1, offset: 0, srvID: 9fa6616c-20cd-44e6-8b90-ac1acb4d65de, blockid: BP-300692236-67.195.138.20-1404336203992:blk_1073741839_1015, duration: 928612
2014-07-02 21:23:26,293 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 29 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:26,293 DEBUG hdfs.DFSClient (DFSOutputStream.java:endBlock(445)) - Closing old block BP-300692236-67.195.138.20-1404336203992:blk_1073741839_1015
2014-07-02 21:23:26,293 INFO datanode.DataNode (BlockReceiver.java:run(1224)) - PacketResponder: BP-300692236-67.195.138.20-1404336203992:blk_1073741839_1015, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2014-07-02 21:23:26,293 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2380)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55922 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]} size 0
2014-07-02 21:23:26,298 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3136)) - DIR* completeFile: /tmp.txt is closed by DFSClient_NONMAPREDUCE_-1332513431_1
2014-07-02 21:23:26,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(8414)) - allowed=true ugi=jenkins (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp.txt dst=null perm=null proto=rpc
2014-07-02 21:23:26,309 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(8414)) - allowed=true ugi=jenkins (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp.txt dst=null perm=null proto=rpc
All blocks of file /tmp.txt verified to have replication factor 1
2014-07-02 21:23:26,319 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1290)) - Starting DataNode 1 with dfs.datanode.data.dir: [DISK]file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-hdfs-project/hadoop-hdfs/target/test/data/dfs/data/data3,[DISK]file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-hdfs-project/hadoop-hdfs/target/test/data/dfs/data/data4
2014-07-02 21:23:26,319 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1295)) - Starting DataNode 1 with hostname set to: host1.foo.com
2014-07-02 21:23:26,319 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1300)) - Adding node with hostname : host1.foo.com to rack /rack0
2014-07-02 21:23:26,327 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(152)) - DataNode metrics system started (again)
2014-07-02 21:23:26,328 INFO datanode.DataNode (DataNode.java:<init>(288)) - Configured hostname is host1.foo.com
2014-07-02 21:23:26,328 INFO datanode.DataNode (DataNode.java:startDataNode(759)) - Starting DataNode with maxLockedMemory = 0
2014-07-02 21:23:26,329 INFO datanode.DataNode (DataNode.java:initDataXceiver(560)) - Opened streaming server at /127.0.0.1:57889
2014-07-02 21:23:26,329 INFO datanode.DataNode (DataXceiverServer.java:<init>(75)) - Balancing bandwith is 1048576 bytes/s
2014-07-02 21:23:26,329 INFO datanode.DataNode (DataXceiverServer.java:<init>(76)) - Number threads for balancing is 5
2014-07-02 21:23:26,330 INFO http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.datanode is not defined
2014-07-02 21:23:26,331 INFO http.HttpServer2 (HttpServer2.java:addGlobalFilter(666)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2014-07-02 21:23:26,331 INFO http.HttpServer2 (HttpServer2.java:addFilter(644)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2014-07-02 21:23:26,332 INFO http.HttpServer2 (HttpServer2.java:addFilter(651)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2014-07-02 21:23:26,332 INFO http.HttpServer2 (HttpServer2.java:addFilter(651)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2014-07-02 21:23:26,333 INFO http.HttpServer2 (HttpServer2.java:addJerseyResourcePackage(570)) - addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
2014-07-02 21:23:26,333 INFO http.HttpServer2 (HttpServer2.java:openListeners(854)) - Jetty bound to port 41185
2014-07-02 21:23:26,333 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2014-07-02 21:23:26,342 INFO mortbay.log (Slf4jLog.java:info(67)) - NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
2014-07-02 21:23:26,348 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:41185
2014-07-02 21:23:26,348 INFO datanode.DataNode (DataNode.java:startDataNode(776)) - dnUserName = jenkins
2014-07-02 21:23:26,348 INFO datanode.DataNode (DataNode.java:startDataNode(777)) - supergroup = supergroup
2014-07-02 21:23:26,349 INFO ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2014-07-02 21:23:26,350 INFO ipc.Server (Server.java:run(596)) - Starting Socket Reader #1 for port 52904
2014-07-02 21:23:26,352 INFO datanode.DataNode (DataNode.java:initIpcServer(435)) - Opened IPC server at /127.0.0.1:52904
2014-07-02 21:23:26,357 INFO datanode.DataNode (BlockPoolManager.java:refreshNamenodes(152)) - Refresh request received for nameservices: null
2014-07-02 21:23:26,358 INFO datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(197)) - Starting BPOfferServices for nameservices: <default>
2014-07-02 21:23:26,359 INFO datanode.DataNode (BPServiceActor.java:run(805)) - Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:33665 starting to offer service
2014-07-02 21:23:26,359 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1328)) - Adding node with service : 127.0.0.1:57889 to rack /rack0
2014-07-02 21:23:26,359 INFO ipc.Server (Server.java:run(818)) - IPC Server Responder: starting
2014-07-02 21:23:26,360 INFO ipc.Server (Server.java:run(665)) - IPC Server listener on 52904: starting
2014-07-02 21:23:26,361 INFO datanode.DataNode (DataNode.java:checkDatanodeUuid(805)) - Generated and persisted new Datanode UUID 0104562a-7653-4740-8dbf-51eea8ef9811
2014-07-02 21:23:26,362 INFO datanode.DataNode (SimulatedFSDataset.java:registerMBean(968)) - Registered FSDatasetState MBean
2014-07-02 21:23:26,362 INFO datanode.DataNode (DataNode.java:initDataBlockScanner(510)) - Periodic Block Verification scan disabled because verifcation is not supported by SimulatedFSDataset
2014-07-02 21:23:26,362 INFO datanode.DataNode (DataNode.java:initDirectoryScanner(538)) - Periodic Directory Tree Verification scan is disabled because verifcation is not supported by SimulatedFSDataset
2014-07-02 21:23:26,362 INFO datanode.DataNode (BPServiceActor.java:register(765)) - Block pool BP-300692236-67.195.138.20-1404336203992 (Datanode Uuid null) service to localhost/127.0.0.1:33665 beginning handshake with NN
2014-07-02 21:23:26,363 INFO hdfs.StateChange (DatanodeManager.java:registerDatanode(889)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, datanodeUuid=0104562a-7653-4740-8dbf-51eea8ef9811, infoPort=41185, ipcPort=52904, storageInfo=lv=-55;cid=testClusterID;nsid=1369169098;c=0) storage 0104562a-7653-4740-8dbf-51eea8ef9811
2014-07-02 21:23:26,364 INFO net.NetworkTopology (NetworkTopology.java:add(417)) - Adding a new node: /rack0/127.0.0.1:57889
2014-07-02 21:23:26,365 INFO datanode.DataNode (BPServiceActor.java:register(778)) - Block pool Block pool BP-300692236-67.195.138.20-1404336203992 (Datanode Uuid null) service to localhost/127.0.0.1:33665 successfully registered with NN
2014-07-02 21:23:26,365 INFO datanode.DataNode (DataNode.java:registerBlockPoolWithSecretManager(877)) - Block token params received from NN: for block pool BP-300692236-67.195.138.20-1404336203992 keyUpdateInterval=600 min(s), tokenLifetime=600 min(s)
2014-07-02 21:23:26,366 INFO block.BlockTokenSecretManager (BlockTokenSecretManager.java:addKeys(193)) - Setting block keys
2014-07-02 21:23:26,366 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:shouldWait(2056)) - dn.getCapacity() == 0
2014-07-02 21:23:26,366 INFO datanode.DataNode (BPServiceActor.java:offerService(637)) - For namenode localhost/127.0.0.1:33665 using DELETEREPORT_INTERVAL of 100000 msec BLOCKREPORT_INTERVAL of 21600000msec CACHEREPORT_INTERVAL of 10000msec Initial delay: 0msec; heartBeatInterval=1000
2014-07-02 21:23:26,366 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:waitActive(1992)) - Waiting for cluster to become active
2014-07-02 21:23:26,367 INFO blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(665)) - Adding new storage ID SimulatedStorage-DS-f33a9a01-4fec-4c14-a856-fcbc05c81d6c for DN 127.0.0.1:57889
2014-07-02 21:23:26,368 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(438)) - Namenode Block pool BP-300692236-67.195.138.20-1404336203992 (Datanode Uuid 0104562a-7653-4740-8dbf-51eea8ef9811) service to localhost/127.0.0.1:33665 trying to claim ACTIVE state with txid=48
2014-07-02 21:23:26,368 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(450)) - Acknowledging ACTIVE Namenode Block pool BP-300692236-67.195.138.20-1404336203992 (Datanode Uuid 0104562a-7653-4740-8dbf-51eea8ef9811) service to localhost/127.0.0.1:33665
2014-07-02 21:23:26,370 INFO blockmanagement.BlockManager (BlockManager.java:processReport(1734)) - BLOCK* processReport: Received first block report from DatanodeStorage[SimulatedStorage-DS-f33a9a01-4fec-4c14-a856-fcbc05c81d6c,DISK,NORMAL] after starting up or becoming active. Its block contents are no longer considered stale
2014-07-02 21:23:26,370 INFO BlockStateChange (BlockManager.java:processReport(1750)) - BLOCK* processReport: from storage SimulatedStorage-DS-f33a9a01-4fec-4c14-a856-fcbc05c81d6c node DatanodeRegistration(127.0.0.1, datanodeUuid=0104562a-7653-4740-8dbf-51eea8ef9811, infoPort=41185, ipcPort=52904, storageInfo=lv=-55;cid=testClusterID;nsid=1369169098;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
2014-07-02 21:23:26,371 INFO datanode.DataNode (BPServiceActor.java:blockReport(498)) - Sent 1 blockreports 0 blocks total. Took 0 msec to generate and 3 msecs for RPC and NN processing. Got back commands org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@1424b7b
2014-07-02 21:23:26,371 INFO datanode.DataNode (BPOfferService.java:processCommandFromActive(617)) - Got finalize command for block pool BP-300692236-67.195.138.20-1404336203992
2014-07-02 21:23:26,468 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:waitActive(2023)) - Cluster is active
2014-07-02 21:23:26,981 INFO balancer.Balancer (Balancer.java:run(1455)) - namenodes = [hdfs://localhost:33665]
2014-07-02 21:23:26,982 INFO balancer.Balancer (Balancer.java:run(1456)) - p = Balancer.Parameters[BalancingPolicy.Node, threshold=10.0]
Time Stamp Iteration# Bytes Already Moved Bytes Left To Move Bytes Being Moved
2014-07-02 21:23:27,023 INFO balancer.Balancer (NameNodeConnector.java:<init>(97)) - Block token params received from NN: keyUpdateInterval=600 min(s), tokenLifetime=600 min(s)
2014-07-02 21:23:27,024 INFO block.BlockTokenSecretManager (BlockTokenSecretManager.java:addKeys(193)) - Setting block keys
2014-07-02 21:23:27,024 INFO balancer.Balancer (NameNodeConnector.java:<init>(111)) - Balancer will update its block keys every 150 minute(s)
2014-07-02 21:23:27,025 DEBUG hdfs.DFSClient (DFSClient.java:create(1459)) - /system/balancer.id: masked=rw-r--r--
2014-07-02 21:23:27,027 INFO block.BlockTokenSecretManager (BlockTokenSecretManager.java:addKeys(193)) - Setting block keys
2014-07-02 21:23:27,038 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(8414)) - allowed=true ugi=jenkins (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/system/balancer.id dst=null perm=jenkins:supergroup:rw-r--r-- proto=rpc
2014-07-02 21:23:27,038 DEBUG hdfs.DFSClient (DFSOutputStream.java:computePacketChunkSize(1669)) - computePacketChunkSize: src=/system/balancer.id, chunkSize=14, chunksPerPacket=4681, packetSize=65534
2014-07-02 21:23:27,039 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1739)) - DFSClient writeChunk allocating new packet seqno=0, src=/system/balancer.id, packetSize=65534, chunksPerPacket=4681, bytesCurBlock=0
2014-07-02 21:23:27,039 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1758)) - DFSClient writeChunk packet full seqno=0, src=/system/balancer.id, bytesCurBlock=10, blockSize=10, appendChunk=false
2014-07-02 21:23:27,040 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 0
2014-07-02 21:23:27,040 DEBUG hdfs.DFSClient (DFSOutputStream.java:computePacketChunkSize(1669)) - computePacketChunkSize: src=/system/balancer.id, chunkSize=14, chunksPerPacket=1, packetSize=14
2014-07-02 21:23:27,040 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(517)) - Allocating new block
2014-07-02 21:23:27,040 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 1
2014-07-02 21:23:27,040 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1739)) - DFSClient writeChunk allocating new packet seqno=2, src=/system/balancer.id, packetSize=14, chunksPerPacket=1, bytesCurBlock=0
2014-07-02 21:23:27,041 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1758)) - DFSClient writeChunk packet full seqno=2, src=/system/balancer.id, bytesCurBlock=10, blockSize=10, appendChunk=false
2014-07-02 21:23:27,041 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 2
2014-07-02 21:23:27,041 DEBUG hdfs.DFSClient (DFSOutputStream.java:computePacketChunkSize(1669)) - computePacketChunkSize: src=/system/balancer.id, chunkSize=14, chunksPerPacket=1, packetSize=14
2014-07-02 21:23:27,041 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 3
2014-07-02 21:23:27,042 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3215)) - BLOCK* allocateBlock: /system/balancer.id. BP-300692236-67.195.138.20-1404336203992 blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]}
2014-07-02 21:23:27,044 DEBUG hdfs.DFSClient (DFSOutputStream.java:createBlockOutputStream(1309)) - pipeline = 127.0.0.1:55922
2014-07-02 21:23:27,044 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1517)) - Connecting to datanode 127.0.0.1:55922
2014-07-02 21:23:27,045 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1526)) - Send buf size 131071
2014-07-02 21:23:27,045 INFO net.NetworkTopology (NetworkTopology.java:add(417)) - Adding a new node: /rack0/127.0.0.1:55922
2014-07-02 21:23:27,046 INFO net.NetworkTopology (NetworkTopology.java:add(417)) - Adding a new node: /rack0/127.0.0.1:57889
2014-07-02 21:23:27,046 INFO datanode.DataNode (DataXceiver.java:writeBlock(600)) - Receiving BP-300692236-67.195.138.20-1404336203992:blk_1073741840_1016 src: /127.0.0.1:35074 dest: /127.0.0.1:55922
2014-07-02 21:23:27,046 INFO balancer.Balancer (Balancer.java:logNodes(969)) - 0 over-utilized: []
2014-07-02 21:23:27,047 WARN datanode.DataNode (BlockReceiver.java:<init>(230)) - Could not get file descriptor for outputstream of class class org.apache.hadoop.hdfs.server.datanode.SimulatedFSDataset$SimulatedOutputStream
2014-07-02 21:23:27,047 INFO balancer.Balancer (Balancer.java:logNodes(969)) - 1 above-average: [Source[127.0.0.1:55922, utilization=30.0]]
2014-07-02 21:23:27,048 INFO balancer.Balancer (Balancer.java:logNodes(969)) - 0 below-average: []
2014-07-02 21:23:27,049 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741840_1016 sending packet packet seqno:0 offsetInBlock:0 lastPacketInBlock:false lastByteOffsetInBlock: 10
2014-07-02 21:23:27,050 INFO balancer.Balancer (Balancer.java:logNodes(969)) - 1 underutilized: [BalancerDatanode[127.0.0.1:57889, utilization=0.0]]
2014-07-02 21:23:27,051 INFO balancer.Balancer (Balancer.java:run(1391)) - Need to move 25 B to make the cluster balanced.
2014-07-02 21:23:27,052 INFO balancer.Balancer (Balancer.java:matchSourceWithTargetToMove(1103)) - Decided to move 25 B bytes from 127.0.0.1:55922 to 127.0.0.1:57889
2014-07-02 21:23:27,052 INFO balancer.Balancer (Balancer.java:run(1405)) - Will move 25 B in this iteration
2014-07-02 21:23:27,052 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 0 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:27,052 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741840_1016 sending packet packet seqno:1 offsetInBlock:10 lastPacketInBlock:true lastByteOffsetInBlock: 10
Jul 2, 2014 9:23:27 PM 2014-07-02 21:23:27,053 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1243)) - src: /127.0.0.1:35074, dest: /127.0.0.1:55922, bytes: 10, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1332513431_1, offset: 0, srvID: 9fa6616c-20cd-44e6-8b90-ac1acb4d65de, blockid: BP-300692236-67.195.138.20-1404336203992:blk_1073741840_1016, duration: 5302232
0 0 B 25 B2014-07-02 21:23:27,053 INFO datanode.DataNode (BlockReceiver.java:run(1224)) - PacketResponder: BP-300692236-67.195.138.20-1404336203992:blk_1073741840_1016, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
25 B
2014-07-02 21:23:27,054 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 1 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:27,054 DEBUG hdfs.DFSClient (DFSOutputStream.java:endBlock(445)) - Closing old block BP-300692236-67.195.138.20-1404336203992:blk_1073741840_1016
2014-07-02 21:23:27,055 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(517)) - Allocating new block
2014-07-02 21:23:27,056 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2380)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55922 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-33db2a2d-b99a-4ebd-a864-a2afa58df080:NORMAL|RBW]]} size 0
2014-07-02 21:23:27,057 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3215)) - BLOCK* allocateBlock: /system/balancer.id. BP-300692236-67.195.138.20-1404336203992 blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-f33a9a01-4fec-4c14-a856-fcbc05c81d6c:NORMAL|RBW]]}
2014-07-02 21:23:27,059 DEBUG hdfs.DFSClient (DFSOutputStream.java:createBlockOutputStream(1309)) - pipeline = 127.0.0.1:57889
2014-07-02 21:23:27,059 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1517)) - Connecting to datanode 127.0.0.1:57889
2014-07-02 21:23:27,060 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1526)) - Send buf size 131071
2014-07-02 21:23:27,061 INFO datanode.DataNode (DataXceiver.java:writeBlock(600)) - Receiving BP-300692236-67.195.138.20-1404336203992:blk_1073741841_1017 src: /127.0.0.1:51647 dest: /127.0.0.1:57889
2014-07-02 21:23:27,062 WARN datanode.DataNode (BlockReceiver.java:<init>(230)) - Could not get file descriptor for outputstream of class class org.apache.hadoop.hdfs.server.datanode.SimulatedFSDataset$SimulatedOutputStream
2014-07-02 21:23:27,063 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741841_1017 sending packet packet seqno:2 offsetInBlock:0 lastPacketInBlock:false lastByteOffsetInBlock: 10
2014-07-02 21:23:27,068 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 2 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:27,068 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741841_1017 sending packet packet seqno:3 offsetInBlock:10 lastPacketInBlock:true lastByteOffsetInBlock: 10
2014-07-02 21:23:27,069 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1243)) - src: /127.0.0.1:51647, dest: /127.0.0.1:57889, bytes: 10, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1332513431_1, offset: 0, srvID: 0104562a-7653-4740-8dbf-51eea8ef9811, blockid: BP-300692236-67.195.138.20-1404336203992:blk_1073741841_1017, duration: 6216047
2014-07-02 21:23:27,069 INFO datanode.DataNode (BlockReceiver.java:run(1224)) - PacketResponder: BP-300692236-67.195.138.20-1404336203992:blk_1073741841_1017, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2014-07-02 21:23:27,070 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 3 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:27,071 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2380)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:57889 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-f33a9a01-4fec-4c14-a856-fcbc05c81d6c:NORMAL|RBW]]} size 0
2014-07-02 21:23:27,072 DEBUG hdfs.DFSClient (DFSOutputStream.java:endBlock(445)) - Closing old block BP-300692236-67.195.138.20-1404336203992:blk_1073741841_1017
2014-07-02 21:23:27,078 DEBUG balancer.Balancer (Balancer.java:markMovedIfGoodBlock(285)) - Decided to move blk_1073741840_1016 with size=10 from 127.0.0.1:55922 to 127.0.0.1:57889 through 127.0.0.1:55922
2014-07-02 21:23:27,078 DEBUG balancer.Balancer (Balancer.java:markMovedIfGoodBlock(285)) - Decided to move blk_1073741839_1015 with size=10 from 127.0.0.1:55922 to 127.0.0.1:57889 through 127.0.0.1:55922
2014-07-02 21:23:27,079 DEBUG balancer.Balancer (Balancer.java:run(431)) - Start moving blk_1073741840_1016 with size=10 from 127.0.0.1:55922 to 127.0.0.1:57889 through 127.0.0.1:55922
2014-07-02 21:23:27,079 DEBUG balancer.Balancer (Balancer.java:markMovedIfGoodBlock(285)) - Decided to move blk_1073741838_1014 with size=10 from 127.0.0.1:55922 to 127.0.0.1:57889 through 127.0.0.1:55922
2014-07-02 21:23:27,079 DEBUG balancer.Balancer (Balancer.java:run(431)) - Start moving blk_1073741839_1015 with size=10 from 127.0.0.1:55922 to 127.0.0.1:57889 through 127.0.0.1:55922
2014-07-02 21:23:27,079 DEBUG balancer.Balancer (Balancer.java:run(431)) - Start moving blk_1073741838_1014 with size=10 from 127.0.0.1:55922 to 127.0.0.1:57889 through 127.0.0.1:55922
2014-07-02 21:23:27,101 WARN datanode.DataNode (BlockReceiver.java:<init>(230)) - Could not get file descriptor for outputstream of class class org.apache.hadoop.hdfs.server.datanode.SimulatedFSDataset$SimulatedOutputStream
2014-07-02 21:23:27,101 INFO datanode.DataNode (DataXceiver.java:copyBlock(955)) - Copied BP-300692236-67.195.138.20-1404336203992:blk_1073741839_1015 to /127.0.0.1:35079
2014-07-02 21:23:27,101 INFO datanode.DataNode (DataXceiver.java:copyBlock(955)) - Copied BP-300692236-67.195.138.20-1404336203992:blk_1073741840_1016 to /127.0.0.1:35081
2014-07-02 21:23:27,101 INFO datanode.DataNode (DataXceiver.java:copyBlock(955)) - Copied BP-300692236-67.195.138.20-1404336203992:blk_1073741838_1014 to /127.0.0.1:35080
2014-07-02 21:23:27,101 WARN datanode.DataNode (BlockReceiver.java:<init>(230)) - Could not get file descriptor for outputstream of class class org.apache.hadoop.hdfs.server.datanode.SimulatedFSDataset$SimulatedOutputStream
2014-07-02 21:23:27,101 WARN datanode.DataNode (BlockReceiver.java:<init>(230)) - Could not get file descriptor for outputstream of class class org.apache.hadoop.hdfs.server.datanode.SimulatedFSDataset$SimulatedOutputStream
2014-07-02 21:23:27,103 INFO datanode.DataNode (DataXceiver.java:replaceBlock(1083)) - Moved BP-300692236-67.195.138.20-1404336203992:blk_1073741838_1014 from /127.0.0.1:51650, delHint=9fa6616c-20cd-44e6-8b90-ac1acb4d65de
2014-07-02 21:23:27,104 INFO datanode.DataNode (DataXceiver.java:replaceBlock(1083)) - Moved BP-300692236-67.195.138.20-1404336203992:blk_1073741840_1016 from /127.0.0.1:51648, delHint=9fa6616c-20cd-44e6-8b90-ac1acb4d65de
2014-07-02 21:23:27,102 INFO datanode.DataNode (DataXceiver.java:replaceBlock(1083)) - Moved BP-300692236-67.195.138.20-1404336203992:blk_1073741839_1015 from /127.0.0.1:51649, delHint=9fa6616c-20cd-44e6-8b90-ac1acb4d65de
2014-07-02 21:23:27,104 INFO balancer.Balancer (Balancer.java:dispatch(370)) - Successfully moved blk_1073741838_1014 with size=10 from 127.0.0.1:55922 to 127.0.0.1:57889 through 127.0.0.1:55922
2014-07-02 21:23:27,104 INFO balancer.Balancer (Balancer.java:dispatch(370)) - Successfully moved blk_1073741840_1016 with size=10 from 127.0.0.1:55922 to 127.0.0.1:57889 through 127.0.0.1:55922
2014-07-02 21:23:27,104 INFO balancer.Balancer (Balancer.java:dispatch(370)) - Successfully moved blk_1073741839_1015 with size=10 from 127.0.0.1:55922 to 127.0.0.1:57889 through 127.0.0.1:55922
2014-07-02 21:23:27,104 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2380)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:57889 is added to blk_1073741839_1015 size 10
2014-07-02 21:23:27,106 INFO BlockStateChange (InvalidateBlocks.java:add(114)) - BLOCK* InvalidateBlocks: add blk_1073741839_1015 to 127.0.0.1:55922
2014-07-02 21:23:27,106 INFO BlockStateChange (BlockManager.java:chooseExcessReplicates(2731)) - BLOCK* chooseExcessReplicates: (127.0.0.1:55922, blk_1073741839_1015) is added to invalidated blocks set
2014-07-02 21:23:27,108 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2380)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:57889 is added to blk_1073741838_1014 size 10
2014-07-02 21:23:27,108 INFO BlockStateChange (InvalidateBlocks.java:add(114)) - BLOCK* InvalidateBlocks: add blk_1073741838_1014 to 127.0.0.1:55922
2014-07-02 21:23:27,108 INFO BlockStateChange (BlockManager.java:chooseExcessReplicates(2731)) - BLOCK* chooseExcessReplicates: (127.0.0.1:55922, blk_1073741838_1014) is added to invalidated blocks set
2014-07-02 21:23:27,108 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2380)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:57889 is added to blk_1073741840_1016 size 10
2014-07-02 21:23:28,304 INFO BlockStateChange (BlockManager.java:invalidateWorkForOneNode(3262)) - BLOCK* BlockManager: ask 127.0.0.1:55922 to delete [blk_1073741838_1014, blk_1073741839_1015]
2014-07-02 21:23:30,082 INFO net.NetworkTopology (NetworkTopology.java:add(417)) - Adding a new node: /rack0/127.0.0.1:55922
2014-07-02 21:23:30,083 INFO net.NetworkTopology (NetworkTopology.java:add(417)) - Adding a new node: /rack0/127.0.0.1:57889
2014-07-02 21:23:30,083 INFO balancer.Balancer (Balancer.java:logNodes(969)) - 0 over-utilized: []
2014-07-02 21:23:30,083 INFO balancer.Balancer (Balancer.java:logNodes(969)) - 1 above-average: [Source[127.0.0.1:55922, utilization=28.0]]
2014-07-02 21:23:30,083 INFO balancer.Balancer (Balancer.java:logNodes(969)) - 1 below-average: [BalancerDatanode[127.0.0.1:57889, utilization=16.0]]
2014-07-02 21:23:30,083 INFO balancer.Balancer (Balancer.java:logNodes(969)) - 0 underutilized: []
The cluster is balanced. Exiting...
2014-07-02 21:23:30,084 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1739)) - DFSClient writeChunk allocating new packet seqno=4, src=/system/balancer.id, packetSize=14, chunksPerPacket=1, bytesCurBlock=0
2014-07-02 21:23:30,084 DEBUG hdfs.DFSClient (DFSOutputStream.java:writeChunk(1758)) - DFSClient writeChunk packet full seqno=4, src=/system/balancer.id, bytesCurBlock=4, blockSize=10, appendChunk=false
2014-07-02 21:23:30,084 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 4
2014-07-02 21:23:30,084 DEBUG hdfs.DFSClient (DFSOutputStream.java:computePacketChunkSize(1669)) - computePacketChunkSize: src=/system/balancer.id, chunkSize=14, chunksPerPacket=1, packetSize=14
2014-07-02 21:23:30,084 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(517)) - Allocating new block
2014-07-02 21:23:30,085 DEBUG hdfs.DFSClient (DFSOutputStream.java:queueCurrentPacket(1682)) - Queued packet 5
2014-07-02 21:23:30,085 DEBUG balancer.Balancer (NameNodeConnector.java:run(246)) - InterruptedException in block key updater thread
java.lang.InterruptedException: sleep interrupted
at java.lang.Thread.sleep(Native Method)
at org.apache.hadoop.hdfs.server.balancer.NameNodeConnector$BlockKeyUpdater.run(NameNodeConnector.java:243)
at java.lang.Thread.run(Thread.java:662)
2014-07-02 21:23:30,086 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3215)) - BLOCK* allocateBlock: /system/balancer.id. BP-300692236-67.195.138.20-1404336203992 blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-f33a9a01-4fec-4c14-a856-fcbc05c81d6c:NORMAL|RBW]]}
2014-07-02 21:23:30,085 DEBUG hdfs.DFSClient (DFSOutputStream.java:waitForAckedSeqno(2013)) - Waiting for ack for: 5
2014-07-02 21:23:30,117 DEBUG hdfs.DFSClient (DFSOutputStream.java:createBlockOutputStream(1309)) - pipeline = 127.0.0.1:57889
2014-07-02 21:23:30,117 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1517)) - Connecting to datanode 127.0.0.1:57889
2014-07-02 21:23:30,117 DEBUG hdfs.DFSClient (DFSOutputStream.java:createSocketForPipeline(1526)) - Send buf size 131071
2014-07-02 21:23:30,119 INFO datanode.DataNode (DataXceiver.java:writeBlock(600)) - Receiving BP-300692236-67.195.138.20-1404336203992:blk_1073741842_1018 src: /127.0.0.1:51655 dest: /127.0.0.1:57889
2014-07-02 21:23:30,120 WARN datanode.DataNode (BlockReceiver.java:<init>(230)) - Could not get file descriptor for outputstream of class class org.apache.hadoop.hdfs.server.datanode.SimulatedFSDataset$SimulatedOutputStream
2014-07-02 21:23:30,121 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741842_1018 sending packet packet seqno:4 offsetInBlock:0 lastPacketInBlock:false lastByteOffsetInBlock: 4
2014-07-02 21:23:30,123 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 4 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:30,123 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(568)) - DataStreamer block BP-300692236-67.195.138.20-1404336203992:blk_1073741842_1018 sending packet packet seqno:5 offsetInBlock:4 lastPacketInBlock:true lastByteOffsetInBlock: 4
2014-07-02 21:23:30,123 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1243)) - src: /127.0.0.1:51655, dest: /127.0.0.1:57889, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1332513431_1, offset: 0, srvID: 0104562a-7653-4740-8dbf-51eea8ef9811, blockid: BP-300692236-67.195.138.20-1404336203992:blk_1073741842_1018, duration: 2842555
2014-07-02 21:23:30,124 DEBUG hdfs.DFSClient (DFSOutputStream.java:run(802)) - DFSClient seqno: 5 status: SUCCESS downstreamAckTimeNanos: 0
2014-07-02 21:23:30,124 INFO datanode.DataNode (BlockReceiver.java:run(1224)) - PacketResponder: BP-300692236-67.195.138.20-1404336203992:blk_1073741842_1018, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2014-07-02 21:23:30,125 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2380)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:57889 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]SimulatedStorage-DS-f33a9a01-4fec-4c14-a856-fcbc05c81d6c:NORMAL|RBW]]} size 0
2014-07-02 21:23:30,126 INFO BlockStateChange (InvalidateBlocks.java:add(114)) - BLOCK* InvalidateBlocks: add blk_1073741840_1016 to 127.0.0.1:57889
2014-07-02 21:23:30,126 INFO BlockStateChange (BlockManager.java:chooseExcessReplicates(2731)) - BLOCK* chooseExcessReplicates: (127.0.0.1:57889, blk_1073741840_1016) is added to invalidated blocks set
2014-07-02 21:23:30,127 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3136)) - DIR* completeFile: /system/balancer.id is closed by DFSClient_NONMAPREDUCE_-1332513431_1
2014-07-02 21:23:30,136 INFO BlockStateChange (BlockManager.java:addToInvalidates(1074)) - BLOCK* addToInvalidates: blk_1073741840_1016 127.0.0.1:55922 127.0.0.1:57889
2014-07-02 21:23:30,136 INFO BlockStateChange (BlockManager.java:addToInvalidates(1074)) - BLOCK* addToInvalidates: blk_1073741841_1017 127.0.0.1:57889
2014-07-02 21:23:30,136 INFO BlockStateChange (BlockManager.java:addToInvalidates(1074)) - BLOCK* addToInvalidates: blk_1073741842_1018 127.0.0.1:57889
2014-07-02 21:23:30,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(8414)) - allowed=true ugi=jenkins (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/system/balancer.id dst=null perm=null proto=rpc
2014-07-02 21:23:31,304 INFO BlockStateChange (BlockManager.java:invalidateWorkForOneNode(3262)) - BLOCK* BlockManager: ask 127.0.0.1:55922 to delete [blk_1073741840_1016]
2014-07-02 21:23:34,305 INFO BlockStateChange (BlockManager.java:invalidateWorkForOneNode(3262)) - BLOCK* BlockManager: ask 127.0.0.1:57889 to delete [blk_1073741840_1016, blk_1073741841_1017, blk_1073741842_1018]
2014-07-02 21:23:35,413 INFO hdfs.TestBalancer (TestBalancer.java:runBalancer(381)) - Rebalancing with default ctor.
2014-07-02 21:23:55,333 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(177)) - Rescanning after 30000 milliseconds
2014-07-02 21:23:55,334 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(202)) - Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2014-07-02 21:24:15,425 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:shutdown(1546)) - Shutting down the Mini HDFS Cluster
2014-07-02 21:24:15,426 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:shutdownDataNodes(1578)) - Shutting down DataNode 1
2014-07-02 21:24:15,426 INFO datanode.DataNode (DataXceiverServer.java:closeAllPeers(245)) - Closing all peers.
2014-07-02 21:24:15,432 INFO mortbay.log (Slf4jLog.java:info(67)) - Stopped SelectChannelConnector@localhost:0
2014-07-02 21:24:15,533 INFO datanode.DataNode (DataNode.java:shutdown(1302)) - Waiting for threadgroup to exit, active threads is 0
2014-07-02 21:24:15,533 INFO ipc.Server (Server.java:stop(2484)) - Stopping server on 52904
2014-07-02 21:24:15,534 INFO ipc.Server (Server.java:run(697)) - Stopping IPC Server listener on 52904
2014-07-02 21:24:15,534 INFO ipc.Server (Server.java:run(823)) - Stopping IPC Server Responder
2014-07-02 21:24:15,534 WARN datanode.DataNode (BPServiceActor.java:offerService(722)) - BPOfferService for Block pool BP-300692236-67.195.138.20-1404336203992 (Datanode Uuid 0104562a-7653-4740-8dbf-51eea8ef9811) service to localhost/127.0.0.1:33665 interrupted
2014-07-02 21:24:15,534 WARN datanode.DataNode (BPServiceActor.java:run(845)) - Ending block pool service for: Block pool BP-300692236-67.195.138.20-1404336203992 (Datanode Uuid 0104562a-7653-4740-8dbf-51eea8ef9811) service to localhost/127.0.0.1:33665
2014-07-02 21:24:15,535 INFO datanode.DataNode (BlockPoolManager.java:remove(103)) - Removed Block pool BP-300692236-67.195.138.20-1404336203992 (Datanode Uuid 0104562a-7653-4740-8dbf-51eea8ef9811)
2014-07-02 21:24:15,541 INFO datanode.DataNode (DataNode.java:shutdown(1364)) - Shutdown complete.
2014-07-02 21:24:15,542 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:shutdownDataNodes(1578)) - Shutting down DataNode 0
2014-07-02 21:24:15,542 INFO datanode.DataNode (DataXceiverServer.java:closeAllPeers(245)) - Closing all peers.
2014-07-02 21:24:15,543 INFO mortbay.log (Slf4jLog.java:info(67)) - Stopped SelectChannelConnector@localhost:0
2014-07-02 21:24:15,643 INFO datanode.DataNode (DataNode.java:shutdown(1302)) - Waiting for threadgroup to exit, active threads is 0
2014-07-02 21:24:15,644 INFO ipc.Server (Server.java:stop(2484)) - Stopping server on 38883
2014-07-02 21:24:15,644 INFO ipc.Server (Server.java:run(697)) - Stopping IPC Server listener on 38883
2014-07-02 21:24:15,644 INFO ipc.Server (Server.java:run(823)) - Stopping IPC Server Responder
2014-07-02 21:24:15,644 WARN datanode.DataNode (BPServiceActor.java:offerService(722)) - BPOfferService for Block pool BP-300692236-67.195.138.20-1404336203992 (Datanode Uuid 9fa6616c-20cd-44e6-8b90-ac1acb4d65de) service to localhost/127.0.0.1:33665 interrupted
2014-07-02 21:24:15,645 WARN datanode.DataNode (BPServiceActor.java:run(845)) - Ending block pool service for: Block pool BP-300692236-67.195.138.20-1404336203992 (Datanode Uuid 9fa6616c-20cd-44e6-8b90-ac1acb4d65de) service to localhost/127.0.0.1:33665
2014-07-02 21:24:15,645 INFO datanode.DataNode (BlockPoolManager.java:remove(103)) - Removed Block pool BP-300692236-67.195.138.20-1404336203992 (Datanode Uuid 9fa6616c-20cd-44e6-8b90-ac1acb4d65de)
2014-07-02 21:24:15,645 INFO datanode.DataNode (DataNode.java:shutdown(1364)) - Shutdown complete.
2014-07-02 21:24:15,646 INFO namenode.FSNamesystem (FSNamesystem.java:stopActiveServices(1167)) - Stopping services started for active state
2014-07-02 21:24:15,646 INFO namenode.FSEditLog (FSEditLog.java:endCurrentLogSegment(1216)) - Ending log segment 1
2014-07-02 21:24:15,647 INFO namenode.FSNamesystem (FSNamesystem.java:run(4714)) - NameNodeEditLogRoller was interrupted, exiting
2014-07-02 21:24:15,673 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(675)) - Number of transactions: 62 Total time for transactions(ms): 19 Number of transactions batched in Syncs: 0 Number of syncs: 27 SyncTimes(ms): 167 62
2014-07-02 21:24:15,675 INFO namenode.FileJournalManager (FileJournalManager.java:finalizeLogSegment(132)) - Finalizing edits file /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-hdfs-project/hadoop-hdfs/target/test/data/dfs/name1/current/edits_inprogress_0000000000000000001 -> /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-hdfs-project/hadoop-hdfs/target/test/data/dfs/name1/current/edits_0000000000000000001-0000000000000000062
2014-07-02 21:24:15,676 INFO namenode.FileJournalManager (FileJournalManager.java:finalizeLogSegment(132)) - Finalizing edits file /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-hdfs-project/hadoop-hdfs/target/test/data/dfs/name2/current/edits_inprogress_0000000000000000001 -> /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-hdfs-project/hadoop-hdfs/target/test/data/dfs/name2/current/edits_0000000000000000001-0000000000000000062
2014-07-02 21:24:15,676 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(168)) - Shutting down CacheReplicationMonitor
2014-07-02 21:24:15,677 INFO ipc.Server (Server.java:stop(2484)) - Stopping server on 33665
2014-07-02 21:24:15,678 INFO ipc.Server (Server.java:run(697)) - Stopping IPC Server listener on 33665
2014-07-02 21:24:15,678 INFO blockmanagement.BlockManager (BlockManager.java:run(3397)) - Stopping ReplicationMonitor.
2014-07-02 21:24:15,678 INFO ipc.Server (Server.java:run(823)) - Stopping IPC Server Responder
2014-07-02 21:24:15,679 WARN blockmanagement.DecommissionManager (DecommissionManager.java:run(78)) - Monitor interrupted: java.lang.InterruptedException: sleep interrupted
2014-07-02 21:24:15,691 INFO namenode.FSNamesystem (FSNamesystem.java:stopActiveServices(1167)) - Stopping services started for active state
2014-07-02 21:24:15,692 INFO namenode.FSNamesystem (FSNamesystem.java:stopStandbyServices(1251)) - Stopping services started for standby state
2014-07-02 21:24:15,694 INFO mortbay.log (Slf4jLog.java:info(67)) - Stopped SelectChannelConnector@localhost:0
2014-07-02 21:24:15,795 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:stop(201)) - Stopping DataNode metrics system...
2014-07-02 21:24:15,796 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:stop(207)) - DataNode metrics system stopped.
2014-07-02 21:24:15,796 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:shutdown(568)) - DataNode metrics system shutdown complete.
|
