HBase
  1. HBase
  2. HBASE-10977

TestHBaseFsck.testQuarantineMissingHFile fails missing files test

    Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Minor Minor
    • Resolution: Unresolved
    • Affects Version/s: 0.94.15
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      On our internal rig, ran into this failure:

      java.lang.AssertionError: expected:<2> but was:<1>
      	at org.junit.Assert.fail(Assert.java:88)
      	at org.junit.Assert.failNotEquals(Assert.java:743)
      	at org.junit.Assert.assertEquals(Assert.java:118)
      	at org.junit.Assert.assertEquals(Assert.java:555)
      	at org.junit.Assert.assertEquals(Assert.java:542)
      	at org.apache.hadoop.hbase.util.TestHBaseFsck.doQuarantineTest(TestHBaseFsck.java:1737)
      	at org.apache.hadoop.hbase.util.TestHBaseFsck.testQuarantineMissingHFile(TestHBaseFsck.java:1781)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:606)
      	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
      	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
      	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
      	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
      	at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
      

      This is what is failing:

      assertEquals(hfcc.getMissing().size(), missing);

      The file remove has not run yet or, else, this complaint is related:

      2014-04-12 23:24:57,638 WARN  [IPC Server handler 4 on 50919] security.UserGroupInformation(1551): PriviledgedActionException as:jenkins (auth:SIMPLE) cause:java.io.FileNotFoundException: File does not exist: /user/jenkins/hbase/data/default/testQuarantineMissingHFile/63cdcba1fc55ae6463463ae16f4e454e/fam/57a07eaac97e4acd8dc04e08d1950adc
      

      Below is full log. Will come back and add logging....

      Regression
      
      org.apache.hadoop.hbase.util.TestHBaseFsck.testQuarantineMissingHFile
      
      Failing for the past 1 build (Since Failed#3 )
      Took 10 ms.
      add description
      Error Message
      
      expected:<2> but was:<1>
      Stacktrace
      
      java.lang.AssertionError: expected:<2> but was:<1>
      	at org.junit.Assert.fail(Assert.java:88)
      	at org.junit.Assert.failNotEquals(Assert.java:743)
      	at org.junit.Assert.assertEquals(Assert.java:118)
      	at org.junit.Assert.assertEquals(Assert.java:555)
      	at org.junit.Assert.assertEquals(Assert.java:542)
      	at org.apache.hadoop.hbase.util.TestHBaseFsck.doQuarantineTest(TestHBaseFsck.java:1737)
      	at org.apache.hadoop.hbase.util.TestHBaseFsck.testQuarantineMissingHFile(TestHBaseFsck.java:1781)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:606)
      	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
      	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
      	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
      	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
      	at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
      Standard Output
      
      Allow checking/fixes for table: testQuarantineMissingHFile
      Checked 4 hfile for corruption
        HFiles corrupted:                  0
          HFiles successfully quarantined: 0
          HFiles failed quarantine:        0
          HFiles moved while checking:     2
            hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/63cdcba1fc55ae6463463ae16f4e454e/fam/57a07eaac97e4acd8dc04e08d1950adc
            hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/d383980be98665b638fd56bfac97a351/fam/9dd79f30f29e4cfeaa46f6e20b32e078
      Summary: OK => OK
      Version: 0.96.1.1-cdh5.0.1-SNAPSHOT
      ---- Table 'testQuarantineMissingHFile': region split map
      :	[ { meta => null, hdfs => hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/63cdcba1fc55ae6463463ae16f4e454e, deployed =>  }, A]	
      A:	[ { meta => null, hdfs => hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/a8a68d998d21b00499aca60887ae5aef, deployed =>  }, B]	
      B:	[ { meta => null, hdfs => hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/d383980be98665b638fd56bfac97a351, deployed =>  }, C]	
      C:	[ { meta => null, hdfs => hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/f9c185520bca999a753ee3ce0a244f6d, deployed =>  }, ]	
      null:	
      ---- Table 'testQuarantineMissingHFile': overlap groups
      There are 0 overlap groups with 0 overlapping regions
      ---- Table 'hbase:meta': region split map
      :	[ { meta => null, hdfs => hdfs://localhost:50919/user/jenkins/hbase/data/hbase/meta/1588230740, deployed =>  }, ]	
      null:	
      ---- Table 'hbase:meta': overlap groups
      There are 0 overlap groups with 0 overlapping regions
      Number of live region servers: 3
        p0419.mtv.cloudera.com,41017,1397370264982
        p0419.mtv.cloudera.com,39010,1397370264935
        p0419.mtv.cloudera.com,32877,1397370265023
      Number of dead region servers: 0
      Master: p0419.mtv.cloudera.com,33001,1397370264247
      Number of backup masters: 0
      Average load: 2.0
      Number of requests: 655
      Number of regions: 6
      Number of regions in transition: 0
      RegionServer: p0419.mtv.cloudera.com,32877,1397370265023 number of regions: 0
      RegionServer: p0419.mtv.cloudera.com,39010,1397370264935 number of regions: 0
      RegionServer: p0419.mtv.cloudera.com,41017,1397370264982 number of regions: 1
        hbase:meta,,1.1588230740 id: 1 encoded_name: 1588230740 start:  end: 
      Number of empty REGIONINFO_QUALIFIER rows in hbase:meta: 0
      Number of Tables: 0
      Number of Tables in flux: 1
      ---- Table 'hbase:meta': region split map
      :	[ { meta => hbase:meta,,1.1588230740, hdfs => hdfs://localhost:50919/user/jenkins/hbase/data/hbase/meta/1588230740, deployed => p0419.mtv.cloudera.com,41017,1397370264982;hbase:meta,,1.1588230740 }, ]	
      null:	
      ---- Table 'hbase:meta': overlap groups
      There are 0 overlap groups with 0 overlapping regions
      Summary:
        testQuarantineMissingHFile is okay.
          Number of regions: 0
          Deployed on: 
        hbase:meta is okay.
          Number of regions: 1
          Deployed on:  p0419.mtv.cloudera.com,41017,1397370264982
      0 inconsistencies detected.
      Status: OK
      Standard Error
      
      2014-04-12 23:24:54,802 INFO  [pool-1-thread-1] hbase.ResourceChecker(147): before: util.TestHBaseFsck#testQuarantineMissingHFile Thread=410, OpenFileDescriptor=691, MaxFileDescriptor=32768, SystemLoadAverage=422, ProcessCount=485, AvailableMemoryMB=3139, ConnectionCount=5
      2014-04-12 23:24:54,809 INFO  [RpcServer.handler=0,port=33001] master.HMaster(1748): Client=jenkins//172.29.122.11 create 'testQuarantineMissingHFile', {NAME => 'fam', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => '2147483647', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}
      2014-04-12 23:24:54,886 DEBUG [RpcServer.handler=0,port=33001] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testQuarantineMissingHFile/write-master:330010000000000
      2014-04-12 23:24:54,960 INFO  [MASTER_TABLE_OPERATIONS-p0419:33001-0] handler.CreateTableHandler(148): Create table testQuarantineMissingHFile
      2014-04-12 23:24:55,060 INFO  [IPC Server handler 6 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:53997 is added to blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a192707c-27de-4afa-9948-d58a0f0df6bf:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-0cf6df80-0db5-43f5-bbc4-a7092d736c08:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b2725947-b15b-4c3a-be84-aedc2a57e25f:NORMAL|RBW]]} size 0
      2014-04-12 23:24:55,061 INFO  [IPC Server handler 3 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33353 is added to blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a192707c-27de-4afa-9948-d58a0f0df6bf:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-0cf6df80-0db5-43f5-bbc4-a7092d736c08:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b2725947-b15b-4c3a-be84-aedc2a57e25f:NORMAL|RBW]]} size 0
      2014-04-12 23:24:55,062 INFO  [IPC Server handler 5 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:49422 is added to blk_1073741867_1043 size 305
      2014-04-12 23:24:55,185 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:50919/user/jenkins/hbase/.tmp/data/default/testQuarantineMissingHFile/.tabledesc/.tableinfo.0000000001
      2014-04-12 23:24:55,188 INFO  [RegionOpenAndInitThread-testQuarantineMissingHFile-1] regionserver.HRegion(3969): creating HRegion testQuarantineMissingHFile HTD == 'testQuarantineMissingHFile', {NAME => 'fam', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => '2147483647', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:50919/user/jenkins/hbase/.tmp Table name == testQuarantineMissingHFile
      2014-04-12 23:24:55,188 INFO  [RegionOpenAndInitThread-testQuarantineMissingHFile-2] regionserver.HRegion(3969): creating HRegion testQuarantineMissingHFile HTD == 'testQuarantineMissingHFile', {NAME => 'fam', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => '2147483647', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:50919/user/jenkins/hbase/.tmp Table name == testQuarantineMissingHFile
      2014-04-12 23:24:55,188 INFO  [RegionOpenAndInitThread-testQuarantineMissingHFile-3] regionserver.HRegion(3969): creating HRegion testQuarantineMissingHFile HTD == 'testQuarantineMissingHFile', {NAME => 'fam', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => '2147483647', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:50919/user/jenkins/hbase/.tmp Table name == testQuarantineMissingHFile
      2014-04-12 23:24:55,188 INFO  [RegionOpenAndInitThread-testQuarantineMissingHFile-4] regionserver.HRegion(3969): creating HRegion testQuarantineMissingHFile HTD == 'testQuarantineMissingHFile', {NAME => 'fam', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => '2147483647', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:50919/user/jenkins/hbase/.tmp Table name == testQuarantineMissingHFile
      2014-04-12 23:24:55,378 INFO  [IPC Server handler 2 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:53997 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-34a4a47f-8a95-461c-8633-2a7fd583b8d9:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-80866ac4-36df-41f3-a856-da7636fa89a3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-45b6fa92-7966-4203-8e5a-f8115f53e1ae:NORMAL|RBW]]} size 0
      2014-04-12 23:24:55,379 INFO  [IPC Server handler 0 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33353 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-34a4a47f-8a95-461c-8633-2a7fd583b8d9:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-80866ac4-36df-41f3-a856-da7636fa89a3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-45b6fa92-7966-4203-8e5a-f8115f53e1ae:NORMAL|RBW]]} size 0
      2014-04-12 23:24:55,379 INFO  [IPC Server handler 1 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:49422 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-34a4a47f-8a95-461c-8633-2a7fd583b8d9:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-80866ac4-36df-41f3-a856-da7636fa89a3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-45b6fa92-7966-4203-8e5a-f8115f53e1ae:NORMAL|RBW]]} size 0
      2014-04-12 23:24:55,386 INFO  [IPC Server handler 9 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:49422 is added to blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0cf6df80-0db5-43f5-bbc4-a7092d736c08:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b2725947-b15b-4c3a-be84-aedc2a57e25f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a192707c-27de-4afa-9948-d58a0f0df6bf:NORMAL|RBW]]} size 0
      2014-04-12 23:24:55,387 INFO  [IPC Server handler 2 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:53997 is added to blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0cf6df80-0db5-43f5-bbc4-a7092d736c08:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b2725947-b15b-4c3a-be84-aedc2a57e25f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a192707c-27de-4afa-9948-d58a0f0df6bf:NORMAL|RBW]]} size 0
      2014-04-12 23:24:55,388 INFO  [IPC Server handler 1 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33353 is added to blk_1073741868_1044 size 61
      2014-04-12 23:24:55,410 INFO  [IPC Server handler 9 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:53997 is added to blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-80866ac4-36df-41f3-a856-da7636fa89a3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-45b6fa92-7966-4203-8e5a-f8115f53e1ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-34a4a47f-8a95-461c-8633-2a7fd583b8d9:NORMAL|RBW]]} size 0
      2014-04-12 23:24:55,410 INFO  [IPC Server handler 2 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33353 is added to blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-80866ac4-36df-41f3-a856-da7636fa89a3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-45b6fa92-7966-4203-8e5a-f8115f53e1ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-34a4a47f-8a95-461c-8633-2a7fd583b8d9:NORMAL|RBW]]} size 0
      2014-04-12 23:24:55,411 INFO  [IPC Server handler 4 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:49422 is added to blk_1073741871_1047 size 61
      2014-04-12 23:24:55,418 INFO  [IPC Server handler 8 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:53997 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0cf6df80-0db5-43f5-bbc4-a7092d736c08:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b2725947-b15b-4c3a-be84-aedc2a57e25f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a192707c-27de-4afa-9948-d58a0f0df6bf:NORMAL|RBW]]} size 0
      2014-04-12 23:24:55,418 INFO  [IPC Server handler 9 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33353 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0cf6df80-0db5-43f5-bbc4-a7092d736c08:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b2725947-b15b-4c3a-be84-aedc2a57e25f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a192707c-27de-4afa-9948-d58a0f0df6bf:NORMAL|RBW]]} size 0
      2014-04-12 23:24:55,419 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-3] regionserver.HRegion(542): Instantiated testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351.
      2014-04-12 23:24:55,419 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-3] regionserver.HRegion(988): Closing testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351.: disabling compactions & flushes
      2014-04-12 23:24:55,419 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-3] regionserver.HRegion(1010): Updates disabled for region testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351.
      2014-04-12 23:24:55,419 INFO  [IPC Server handler 4 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:49422 is added to blk_1073741870_1046 size 60
      2014-04-12 23:24:55,419 INFO  [RegionOpenAndInitThread-testQuarantineMissingHFile-3] regionserver.HRegion(1068): Closed testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351.
      2014-04-12 23:24:55,458 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-1] regionserver.HRegion(542): Instantiated testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e.
      2014-04-12 23:24:55,458 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-2] regionserver.HRegion(542): Instantiated testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef.
      2014-04-12 23:24:55,459 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-1] regionserver.HRegion(988): Closing testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e.: disabling compactions & flushes
      2014-04-12 23:24:55,459 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-2] regionserver.HRegion(988): Closing testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef.: disabling compactions & flushes
      2014-04-12 23:24:55,459 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-1] regionserver.HRegion(1010): Updates disabled for region testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e.
      2014-04-12 23:24:55,459 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-2] regionserver.HRegion(1010): Updates disabled for region testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef.
      2014-04-12 23:24:55,459 INFO  [RegionOpenAndInitThread-testQuarantineMissingHFile-1] regionserver.HRegion(1068): Closed testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e.
      2014-04-12 23:24:55,459 INFO  [RegionOpenAndInitThread-testQuarantineMissingHFile-2] regionserver.HRegion(1068): Closed testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef.
      2014-04-12 23:24:55,460 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-4] regionserver.HRegion(542): Instantiated testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d.
      2014-04-12 23:24:55,461 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-4] regionserver.HRegion(988): Closing testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d.: disabling compactions & flushes
      2014-04-12 23:24:55,461 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-4] regionserver.HRegion(1010): Updates disabled for region testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d.
      2014-04-12 23:24:55,461 INFO  [RegionOpenAndInitThread-testQuarantineMissingHFile-4] regionserver.HRegion(1068): Closed testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d.
      2014-04-12 23:24:55,502 INFO  [MASTER_TABLE_OPERATIONS-p0419:33001-0] catalog.MetaEditor(278): Added 4
      2014-04-12 23:24:55,503 INFO  [MASTER_TABLE_OPERATIONS-p0419:33001-0] master.AssignmentManager(2506): Bulk assigning 4 region(s) across 3 server(s), round-robin=true
      2014-04-12 23:24:55,503 DEBUG [p0419.mtv.cloudera.com,33001,1397370264247-GeneralBulkAssigner-0] master.AssignmentManager(1451): Assigning 1 region(s) to p0419.mtv.cloudera.com,32877,1397370265023
      2014-04-12 23:24:55,503 DEBUG [p0419.mtv.cloudera.com,33001,1397370264247-GeneralBulkAssigner-1] master.AssignmentManager(1451): Assigning 1 region(s) to p0419.mtv.cloudera.com,39010,1397370264935
      2014-04-12 23:24:55,503 DEBUG [p0419.mtv.cloudera.com,33001,1397370264247-GeneralBulkAssigner-2] master.AssignmentManager(1451): Assigning 2 region(s) to p0419.mtv.cloudera.com,41017,1397370264982
      2014-04-12 23:24:55,504 DEBUG [p0419.mtv.cloudera.com,33001,1397370264247-GeneralBulkAssigner-1] zookeeper.ZKAssign(175): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Async create of unassigned node a8a68d998d21b00499aca60887ae5aef with OFFLINE state
      2014-04-12 23:24:55,504 DEBUG [p0419.mtv.cloudera.com,33001,1397370264247-GeneralBulkAssigner-2] zookeeper.ZKAssign(175): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Async create of unassigned node d383980be98665b638fd56bfac97a351 with OFFLINE state
      2014-04-12 23:24:55,503 DEBUG [p0419.mtv.cloudera.com,33001,1397370264247-GeneralBulkAssigner-0] zookeeper.ZKAssign(175): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Async create of unassigned node 63cdcba1fc55ae6463463ae16f4e454e with OFFLINE state
      2014-04-12 23:24:55,503 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] master.GeneralBulkAssigner(177): Timeout-on-RIT=152000
      2014-04-12 23:24:55,504 DEBUG [p0419.mtv.cloudera.com,33001,1397370264247-GeneralBulkAssigner-2] zookeeper.ZKAssign(175): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Async create of unassigned node f9c185520bca999a753ee3ce0a244f6d with OFFLINE state
      2014-04-12 23:24:55,510 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition
      2014-04-12 23:24:55,510 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={a8a68d998d21b00499aca60887ae5aef state=OFFLINE, ts=1397370295502, server=null}, server=p0419.mtv.cloudera.com,39010,1397370264935
      2014-04-12 23:24:55,511 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={d383980be98665b638fd56bfac97a351 state=OFFLINE, ts=1397370295502, server=null}, server=p0419.mtv.cloudera.com,41017,1397370264982
      2014-04-12 23:24:55,518 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={63cdcba1fc55ae6463463ae16f4e454e state=OFFLINE, ts=1397370295502, server=null}, server=p0419.mtv.cloudera.com,32877,1397370265023
      2014-04-12 23:24:55,519 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={f9c185520bca999a753ee3ce0a244f6d state=OFFLINE, ts=1397370295502, server=null}, server=p0419.mtv.cloudera.com,41017,1397370264982
      2014-04-12 23:24:55,519 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={a8a68d998d21b00499aca60887ae5aef state=OFFLINE, ts=1397370295502, server=null}, server=p0419.mtv.cloudera.com,39010,1397370264935
      2014-04-12 23:24:55,519 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={d383980be98665b638fd56bfac97a351 state=OFFLINE, ts=1397370295502, server=null}, server=p0419.mtv.cloudera.com,41017,1397370264982
      2014-04-12 23:24:55,519 INFO  [p0419.mtv.cloudera.com,33001,1397370264247-GeneralBulkAssigner-1] master.AssignmentManager(1502): p0419.mtv.cloudera.com,39010,1397370264935 unassigned znodes=1 of total=1
      2014-04-12 23:24:55,519 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={63cdcba1fc55ae6463463ae16f4e454e state=OFFLINE, ts=1397370295502, server=null}, server=p0419.mtv.cloudera.com,32877,1397370265023
      2014-04-12 23:24:55,519 INFO  [p0419.mtv.cloudera.com,33001,1397370264247-GeneralBulkAssigner-1] master.RegionStates(316): Transitioned {a8a68d998d21b00499aca60887ae5aef state=OFFLINE, ts=1397370295504, server=null} to {a8a68d998d21b00499aca60887ae5aef state=PENDING_OPEN, ts=1397370295519, server=p0419.mtv.cloudera.com,39010,1397370264935}
      2014-04-12 23:24:55,519 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={f9c185520bca999a753ee3ce0a244f6d state=OFFLINE, ts=1397370295502, server=null}, server=p0419.mtv.cloudera.com,41017,1397370264982
      2014-04-12 23:24:55,519 INFO  [p0419.mtv.cloudera.com,33001,1397370264247-GeneralBulkAssigner-0] master.AssignmentManager(1502): p0419.mtv.cloudera.com,32877,1397370265023 unassigned znodes=1 of total=1
      2014-04-12 23:24:55,520 INFO  [p0419.mtv.cloudera.com,33001,1397370264247-GeneralBulkAssigner-2] master.AssignmentManager(1502): p0419.mtv.cloudera.com,41017,1397370264982 unassigned znodes=2 of total=2
      2014-04-12 23:24:55,520 INFO  [p0419.mtv.cloudera.com,33001,1397370264247-GeneralBulkAssigner-0] master.RegionStates(316): Transitioned {63cdcba1fc55ae6463463ae16f4e454e state=OFFLINE, ts=1397370295503, server=null} to {63cdcba1fc55ae6463463ae16f4e454e state=PENDING_OPEN, ts=1397370295520, server=p0419.mtv.cloudera.com,32877,1397370265023}
      2014-04-12 23:24:55,520 INFO  [p0419.mtv.cloudera.com,33001,1397370264247-GeneralBulkAssigner-2] master.RegionStates(316): Transitioned {d383980be98665b638fd56bfac97a351 state=OFFLINE, ts=1397370295504, server=null} to {d383980be98665b638fd56bfac97a351 state=PENDING_OPEN, ts=1397370295520, server=p0419.mtv.cloudera.com,41017,1397370264982}
      2014-04-12 23:24:55,520 INFO  [Priority.RpcServer.handler=1,port=39010] regionserver.HRegionServer(3513): Open testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef.
      2014-04-12 23:24:55,520 INFO  [p0419.mtv.cloudera.com,33001,1397370264247-GeneralBulkAssigner-2] master.RegionStates(316): Transitioned {f9c185520bca999a753ee3ce0a244f6d state=OFFLINE, ts=1397370295504, server=null} to {f9c185520bca999a753ee3ce0a244f6d state=PENDING_OPEN, ts=1397370295520, server=p0419.mtv.cloudera.com,41017,1397370264982}
      2014-04-12 23:24:55,521 INFO  [Priority.RpcServer.handler=1,port=32877] regionserver.HRegionServer(3513): Open testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e.
      2014-04-12 23:24:55,521 INFO  [Priority.RpcServer.handler=1,port=41017] regionserver.HRegionServer(3513): Open testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351.
      2014-04-12 23:24:55,525 DEBUG [RS_OPEN_REGION-p0419:39010-1] zookeeper.ZKAssign(832): regionserver:39010-0x14559c215740001, quorum=localhost:53570, baseZNode=/hbase Transitioning a8a68d998d21b00499aca60887ae5aef from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING
      2014-04-12 23:24:55,526 DEBUG [p0419.mtv.cloudera.com,33001,1397370264247-GeneralBulkAssigner-1] master.AssignmentManager(1626): Bulk assigning done for p0419.mtv.cloudera.com,39010,1397370264935
      2014-04-12 23:24:55,526 DEBUG [RS_OPEN_REGION-p0419:41017-0] zookeeper.ZKAssign(832): regionserver:41017-0x14559c215740002, quorum=localhost:53570, baseZNode=/hbase Transitioning d383980be98665b638fd56bfac97a351 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING
      2014-04-12 23:24:55,526 DEBUG [p0419.mtv.cloudera.com,33001,1397370264247-GeneralBulkAssigner-0] master.AssignmentManager(1626): Bulk assigning done for p0419.mtv.cloudera.com,32877,1397370265023
      2014-04-12 23:24:55,526 INFO  [Priority.RpcServer.handler=1,port=41017] regionserver.HRegionServer(3513): Open testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d.
      2014-04-12 23:24:55,526 DEBUG [RS_OPEN_REGION-p0419:32877-0] zookeeper.ZKAssign(832): regionserver:32877-0x14559c215740003, quorum=localhost:53570, baseZNode=/hbase Transitioning 63cdcba1fc55ae6463463ae16f4e454e from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING
      2014-04-12 23:24:55,527 DEBUG [RS_OPEN_REGION-p0419:41017-2] zookeeper.ZKAssign(832): regionserver:41017-0x14559c215740002, quorum=localhost:53570, baseZNode=/hbase Transitioning f9c185520bca999a753ee3ce0a244f6d from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING
      2014-04-12 23:24:55,527 DEBUG [p0419.mtv.cloudera.com,33001,1397370264247-GeneralBulkAssigner-2] master.AssignmentManager(1626): Bulk assigning done for p0419.mtv.cloudera.com,41017,1397370264982
      2014-04-12 23:24:55,527 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] master.GeneralBulkAssigner(153): bulk assigning total 4 regions to 3 servers, took 23ms, with 4 regions still in transition
      2014-04-12 23:24:55,527 INFO  [MASTER_TABLE_OPERATIONS-p0419:33001-0] master.AssignmentManager(2513): Bulk assigning done
      2014-04-12 23:24:55,535 DEBUG [RS_OPEN_REGION-p0419:39010-1] zookeeper.ZKAssign(907): regionserver:39010-0x14559c215740001, quorum=localhost:53570, baseZNode=/hbase Transitioned node a8a68d998d21b00499aca60887ae5aef from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING
      2014-04-12 23:24:55,535 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/a8a68d998d21b00499aca60887ae5aef
      2014-04-12 23:24:55,536 DEBUG [RS_OPEN_REGION-p0419:39010-1] regionserver.HRegion(4153): Opening region: {ENCODED => a8a68d998d21b00499aca60887ae5aef, NAME => 'testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef.', STARTKEY => 'A', ENDKEY => 'B'}
      2014-04-12 23:24:55,536 DEBUG [RS_OPEN_REGION-p0419:39010-1] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testQuarantineMissingHFile a8a68d998d21b00499aca60887ae5aef
      2014-04-12 23:24:55,536 DEBUG [RS_OPEN_REGION-p0419:39010-1] regionserver.HRegion(542): Instantiated testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef.
      2014-04-12 23:24:55,577 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/d383980be98665b638fd56bfac97a351
      2014-04-12 23:24:55,577 DEBUG [RS_OPEN_REGION-p0419:41017-0] zookeeper.ZKAssign(907): regionserver:41017-0x14559c215740002, quorum=localhost:53570, baseZNode=/hbase Transitioned node d383980be98665b638fd56bfac97a351 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING
      2014-04-12 23:24:55,578 DEBUG [RS_OPEN_REGION-p0419:41017-0] regionserver.HRegion(4153): Opening region: {ENCODED => d383980be98665b638fd56bfac97a351, NAME => 'testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351.', STARTKEY => 'B', ENDKEY => 'C'}
      2014-04-12 23:24:55,578 DEBUG [RS_OPEN_REGION-p0419:41017-0] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testQuarantineMissingHFile d383980be98665b638fd56bfac97a351
      2014-04-12 23:24:55,579 DEBUG [RS_OPEN_REGION-p0419:41017-0] regionserver.HRegion(542): Instantiated testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351.
      2014-04-12 23:24:55,594 INFO  [StoreOpener-a8a68d998d21b00499aca60887ae5aef-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000
      2014-04-12 23:24:55,598 DEBUG [RS_OPEN_REGION-p0419:39010-1] regionserver.HRegion(2822): Found 0 recovered edits file(s) under hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/a8a68d998d21b00499aca60887ae5aef
      2014-04-12 23:24:55,600 INFO  [RS_OPEN_REGION-p0419:39010-1] regionserver.HRegion(637): Onlined a8a68d998d21b00499aca60887ae5aef; next sequenceid=1
      2014-04-12 23:24:55,600 DEBUG [RS_OPEN_REGION-p0419:39010-1] zookeeper.ZKAssign(644): regionserver:39010-0x14559c215740001, quorum=localhost:53570, baseZNode=/hbase Attempting to retransition opening state of node a8a68d998d21b00499aca60887ae5aef
      2014-04-12 23:24:55,644 INFO  [StoreOpener-d383980be98665b638fd56bfac97a351-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000
      2014-04-12 23:24:55,648 DEBUG [RS_OPEN_REGION-p0419:41017-0] regionserver.HRegion(2822): Found 0 recovered edits file(s) under hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/d383980be98665b638fd56bfac97a351
      2014-04-12 23:24:55,650 INFO  [RS_OPEN_REGION-p0419:41017-0] regionserver.HRegion(637): Onlined d383980be98665b638fd56bfac97a351; next sequenceid=1
      2014-04-12 23:24:55,650 DEBUG [RS_OPEN_REGION-p0419:41017-0] zookeeper.ZKAssign(644): regionserver:41017-0x14559c215740002, quorum=localhost:53570, baseZNode=/hbase Attempting to retransition opening state of node d383980be98665b638fd56bfac97a351
      2014-04-12 23:24:55,657 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/63cdcba1fc55ae6463463ae16f4e454e
      2014-04-12 23:24:55,657 DEBUG [RS_OPEN_REGION-p0419:32877-0] zookeeper.ZKAssign(907): regionserver:32877-0x14559c215740003, quorum=localhost:53570, baseZNode=/hbase Transitioned node 63cdcba1fc55ae6463463ae16f4e454e from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING
      2014-04-12 23:24:55,658 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/f9c185520bca999a753ee3ce0a244f6d
      2014-04-12 23:24:55,658 DEBUG [RS_OPEN_REGION-p0419:41017-2] zookeeper.ZKAssign(907): regionserver:41017-0x14559c215740002, quorum=localhost:53570, baseZNode=/hbase Transitioned node f9c185520bca999a753ee3ce0a244f6d from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING
      2014-04-12 23:24:55,658 DEBUG [AM.ZK.Worker-pool2-t11] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=p0419.mtv.cloudera.com,39010,1397370264935, region=a8a68d998d21b00499aca60887ae5aef, current_state={a8a68d998d21b00499aca60887ae5aef state=PENDING_OPEN, ts=1397370295519, server=p0419.mtv.cloudera.com,39010,1397370264935}
      2014-04-12 23:24:55,658 DEBUG [RS_OPEN_REGION-p0419:32877-0] regionserver.HRegion(4153): Opening region: {ENCODED => 63cdcba1fc55ae6463463ae16f4e454e, NAME => 'testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e.', STARTKEY => '', ENDKEY => 'A'}
      2014-04-12 23:24:55,658 DEBUG [RS_OPEN_REGION-p0419:41017-2] regionserver.HRegion(4153): Opening region: {ENCODED => f9c185520bca999a753ee3ce0a244f6d, NAME => 'testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d.', STARTKEY => 'C', ENDKEY => ''}
      2014-04-12 23:24:55,658 INFO  [AM.ZK.Worker-pool2-t11] master.RegionStates(316): Transitioned {a8a68d998d21b00499aca60887ae5aef state=PENDING_OPEN, ts=1397370295519, server=p0419.mtv.cloudera.com,39010,1397370264935} to {a8a68d998d21b00499aca60887ae5aef state=OPENING, ts=1397370295658, server=p0419.mtv.cloudera.com,39010,1397370264935}
      2014-04-12 23:24:55,659 DEBUG [RS_OPEN_REGION-p0419:32877-0] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testQuarantineMissingHFile 63cdcba1fc55ae6463463ae16f4e454e
      2014-04-12 23:24:55,659 DEBUG [RS_OPEN_REGION-p0419:41017-2] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testQuarantineMissingHFile f9c185520bca999a753ee3ce0a244f6d
      2014-04-12 23:24:55,659 DEBUG [RS_OPEN_REGION-p0419:32877-0] regionserver.HRegion(542): Instantiated testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e.
      2014-04-12 23:24:55,659 DEBUG [RS_OPEN_REGION-p0419:41017-2] regionserver.HRegion(542): Instantiated testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d.
      2014-04-12 23:24:55,694 DEBUG [AM.ZK.Worker-pool2-t13] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=p0419.mtv.cloudera.com,41017,1397370264982, region=d383980be98665b638fd56bfac97a351, current_state={d383980be98665b638fd56bfac97a351 state=PENDING_OPEN, ts=1397370295520, server=p0419.mtv.cloudera.com,41017,1397370264982}
      2014-04-12 23:24:55,694 INFO  [AM.ZK.Worker-pool2-t13] master.RegionStates(316): Transitioned {d383980be98665b638fd56bfac97a351 state=PENDING_OPEN, ts=1397370295520, server=p0419.mtv.cloudera.com,41017,1397370264982} to {d383980be98665b638fd56bfac97a351 state=OPENING, ts=1397370295694, server=p0419.mtv.cloudera.com,41017,1397370264982}
      2014-04-12 23:24:55,694 DEBUG [AM.ZK.Worker-pool2-t18] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=p0419.mtv.cloudera.com,32877,1397370265023, region=63cdcba1fc55ae6463463ae16f4e454e, current_state={63cdcba1fc55ae6463463ae16f4e454e state=PENDING_OPEN, ts=1397370295520, server=p0419.mtv.cloudera.com,32877,1397370265023}
      2014-04-12 23:24:55,694 DEBUG [AM.ZK.Worker-pool2-t10] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=p0419.mtv.cloudera.com,41017,1397370264982, region=f9c185520bca999a753ee3ce0a244f6d, current_state={f9c185520bca999a753ee3ce0a244f6d state=PENDING_OPEN, ts=1397370295520, server=p0419.mtv.cloudera.com,41017,1397370264982}
      2014-04-12 23:24:55,694 INFO  [PostOpenDeployTasks:d383980be98665b638fd56bfac97a351] regionserver.HRegionServer(1688): Post open deploy tasks for region=testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351.
      2014-04-12 23:24:55,694 INFO  [AM.ZK.Worker-pool2-t18] master.RegionStates(316): Transitioned {63cdcba1fc55ae6463463ae16f4e454e state=PENDING_OPEN, ts=1397370295520, server=p0419.mtv.cloudera.com,32877,1397370265023} to {63cdcba1fc55ae6463463ae16f4e454e state=OPENING, ts=1397370295694, server=p0419.mtv.cloudera.com,32877,1397370265023}
      2014-04-12 23:24:55,694 INFO  [PostOpenDeployTasks:a8a68d998d21b00499aca60887ae5aef] regionserver.HRegionServer(1688): Post open deploy tasks for region=testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef.
      2014-04-12 23:24:55,695 INFO  [AM.ZK.Worker-pool2-t10] master.RegionStates(316): Transitioned {f9c185520bca999a753ee3ce0a244f6d state=PENDING_OPEN, ts=1397370295520, server=p0419.mtv.cloudera.com,41017,1397370264982} to {f9c185520bca999a753ee3ce0a244f6d state=OPENING, ts=1397370295695, server=p0419.mtv.cloudera.com,41017,1397370264982}
      2014-04-12 23:24:55,718 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testQuarantineMissingHFile/write-master:330010000000000
      2014-04-12 23:24:55,723 INFO  [PostOpenDeployTasks:d383980be98665b638fd56bfac97a351] catalog.MetaEditor(464): Updated row testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351. with server=p0419.mtv.cloudera.com,41017,1397370264982
      2014-04-12 23:24:55,723 INFO  [PostOpenDeployTasks:d383980be98665b638fd56bfac97a351] regionserver.HRegionServer(1713): Finished post open deploy task for testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351.
      2014-04-12 23:24:55,726 DEBUG [RS_OPEN_REGION-p0419:41017-0] zookeeper.ZKAssign(832): regionserver:41017-0x14559c215740002, quorum=localhost:53570, baseZNode=/hbase Transitioning d383980be98665b638fd56bfac97a351 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED
      2014-04-12 23:24:55,726 INFO  [PostOpenDeployTasks:a8a68d998d21b00499aca60887ae5aef] catalog.MetaEditor(464): Updated row testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef. with server=p0419.mtv.cloudera.com,39010,1397370264935
      2014-04-12 23:24:55,726 INFO  [PostOpenDeployTasks:a8a68d998d21b00499aca60887ae5aef] regionserver.HRegionServer(1713): Finished post open deploy task for testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef.
      2014-04-12 23:24:55,727 DEBUG [RS_OPEN_REGION-p0419:39010-1] zookeeper.ZKAssign(832): regionserver:39010-0x14559c215740001, quorum=localhost:53570, baseZNode=/hbase Transitioning a8a68d998d21b00499aca60887ae5aef from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED
      2014-04-12 23:24:55,728 INFO  [StoreOpener-f9c185520bca999a753ee3ce0a244f6d-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000
      2014-04-12 23:24:55,731 DEBUG [RS_OPEN_REGION-p0419:41017-2] regionserver.HRegion(2822): Found 0 recovered edits file(s) under hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/f9c185520bca999a753ee3ce0a244f6d
      2014-04-12 23:24:55,732 INFO  [RS_OPEN_REGION-p0419:41017-2] regionserver.HRegion(637): Onlined f9c185520bca999a753ee3ce0a244f6d; next sequenceid=1
      2014-04-12 23:24:55,733 DEBUG [RS_OPEN_REGION-p0419:41017-2] zookeeper.ZKAssign(644): regionserver:41017-0x14559c215740002, quorum=localhost:53570, baseZNode=/hbase Attempting to retransition opening state of node f9c185520bca999a753ee3ce0a244f6d
      2014-04-12 23:24:55,777 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/d383980be98665b638fd56bfac97a351
      2014-04-12 23:24:55,777 DEBUG [RS_OPEN_REGION-p0419:41017-0] zookeeper.ZKAssign(907): regionserver:41017-0x14559c215740002, quorum=localhost:53570, baseZNode=/hbase Transitioned node d383980be98665b638fd56bfac97a351 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED
      2014-04-12 23:24:55,777 DEBUG [RS_OPEN_REGION-p0419:41017-0] handler.OpenRegionHandler(389): Transitioned d383980be98665b638fd56bfac97a351 to OPENED in zk on p0419.mtv.cloudera.com,41017,1397370264982
      2014-04-12 23:24:55,777 DEBUG [RS_OPEN_REGION-p0419:41017-0] handler.OpenRegionHandler(189): Opened testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351. on p0419.mtv.cloudera.com,41017,1397370264982
      2014-04-12 23:24:55,786 INFO  [StoreOpener-63cdcba1fc55ae6463463ae16f4e454e-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000
      2014-04-12 23:24:55,789 DEBUG [RS_OPEN_REGION-p0419:32877-0] regionserver.HRegion(2822): Found 0 recovered edits file(s) under hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/63cdcba1fc55ae6463463ae16f4e454e
      2014-04-12 23:24:55,792 INFO  [RS_OPEN_REGION-p0419:32877-0] regionserver.HRegion(637): Onlined 63cdcba1fc55ae6463463ae16f4e454e; next sequenceid=1
      2014-04-12 23:24:55,792 DEBUG [RS_OPEN_REGION-p0419:32877-0] zookeeper.ZKAssign(644): regionserver:32877-0x14559c215740003, quorum=localhost:53570, baseZNode=/hbase Attempting to retransition opening state of node 63cdcba1fc55ae6463463ae16f4e454e
      2014-04-12 23:24:55,827 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/a8a68d998d21b00499aca60887ae5aef
      2014-04-12 23:24:55,827 DEBUG [RS_OPEN_REGION-p0419:39010-1] zookeeper.ZKAssign(907): regionserver:39010-0x14559c215740001, quorum=localhost:53570, baseZNode=/hbase Transitioned node a8a68d998d21b00499aca60887ae5aef from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED
      2014-04-12 23:24:55,827 DEBUG [RS_OPEN_REGION-p0419:39010-1] handler.OpenRegionHandler(389): Transitioned a8a68d998d21b00499aca60887ae5aef to OPENED in zk on p0419.mtv.cloudera.com,39010,1397370264935
      2014-04-12 23:24:55,827 DEBUG [AM.ZK.Worker-pool2-t15] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=p0419.mtv.cloudera.com,41017,1397370264982, region=d383980be98665b638fd56bfac97a351, current_state={d383980be98665b638fd56bfac97a351 state=OPENING, ts=1397370295694, server=p0419.mtv.cloudera.com,41017,1397370264982}
      2014-04-12 23:24:55,827 DEBUG [RS_OPEN_REGION-p0419:39010-1] handler.OpenRegionHandler(189): Opened testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef. on p0419.mtv.cloudera.com,39010,1397370264935
      2014-04-12 23:24:55,827 INFO  [AM.ZK.Worker-pool2-t15] master.RegionStates(316): Transitioned {d383980be98665b638fd56bfac97a351 state=OPENING, ts=1397370295694, server=p0419.mtv.cloudera.com,41017,1397370264982} to {d383980be98665b638fd56bfac97a351 state=OPEN, ts=1397370295827, server=p0419.mtv.cloudera.com,41017,1397370264982}
      2014-04-12 23:24:55,828 INFO  [PostOpenDeployTasks:f9c185520bca999a753ee3ce0a244f6d] regionserver.HRegionServer(1688): Post open deploy tasks for region=testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d.
      2014-04-12 23:24:55,828 DEBUG [AM.ZK.Worker-pool2-t15] handler.OpenedRegionHandler(149): Handling OPENED of d383980be98665b638fd56bfac97a351 from p0419.mtv.cloudera.com,41017,1397370264982; deleting unassigned node
      2014-04-12 23:24:55,828 INFO  [PostOpenDeployTasks:63cdcba1fc55ae6463463ae16f4e454e] regionserver.HRegionServer(1688): Post open deploy tasks for region=testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e.
      2014-04-12 23:24:55,828 DEBUG [AM.ZK.Worker-pool2-t1] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=p0419.mtv.cloudera.com,39010,1397370264935, region=a8a68d998d21b00499aca60887ae5aef, current_state={a8a68d998d21b00499aca60887ae5aef state=OPENING, ts=1397370295658, server=p0419.mtv.cloudera.com,39010,1397370264935}
      2014-04-12 23:24:55,828 INFO  [AM.ZK.Worker-pool2-t1] master.RegionStates(316): Transitioned {a8a68d998d21b00499aca60887ae5aef state=OPENING, ts=1397370295658, server=p0419.mtv.cloudera.com,39010,1397370264935} to {a8a68d998d21b00499aca60887ae5aef state=OPEN, ts=1397370295828, server=p0419.mtv.cloudera.com,39010,1397370264935}
      2014-04-12 23:24:55,829 DEBUG [AM.ZK.Worker-pool2-t1] handler.OpenedRegionHandler(149): Handling OPENED of a8a68d998d21b00499aca60887ae5aef from p0419.mtv.cloudera.com,39010,1397370264935; deleting unassigned node
      2014-04-12 23:24:55,844 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/d383980be98665b638fd56bfac97a351
      2014-04-12 23:24:55,844 DEBUG [AM.ZK.Worker-pool2-t15] zookeeper.ZKAssign(480): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Deleted unassigned node d383980be98665b638fd56bfac97a351 in expected state RS_ZK_REGION_OPENED
      2014-04-12 23:24:55,844 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition
      2014-04-12 23:24:55,844 DEBUG [AM.ZK.Worker-pool2-t15] master.AssignmentManager$4(1173): Znode testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351. deleted, state: {d383980be98665b638fd56bfac97a351 state=OPEN, ts=1397370295827, server=p0419.mtv.cloudera.com,41017,1397370264982}
      2014-04-12 23:24:55,844 INFO  [AM.ZK.Worker-pool2-t15] master.RegionStates(377): Onlined d383980be98665b638fd56bfac97a351 on p0419.mtv.cloudera.com,41017,1397370264982
      2014-04-12 23:24:55,848 INFO  [PostOpenDeployTasks:f9c185520bca999a753ee3ce0a244f6d] catalog.MetaEditor(464): Updated row testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d. with server=p0419.mtv.cloudera.com,41017,1397370264982
      2014-04-12 23:24:55,848 INFO  [PostOpenDeployTasks:63cdcba1fc55ae6463463ae16f4e454e] catalog.MetaEditor(464): Updated row testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e. with server=p0419.mtv.cloudera.com,32877,1397370265023
      2014-04-12 23:24:55,849 INFO  [PostOpenDeployTasks:63cdcba1fc55ae6463463ae16f4e454e] regionserver.HRegionServer(1713): Finished post open deploy task for testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e.
      2014-04-12 23:24:55,849 INFO  [PostOpenDeployTasks:f9c185520bca999a753ee3ce0a244f6d] regionserver.HRegionServer(1713): Finished post open deploy task for testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d.
      2014-04-12 23:24:55,850 DEBUG [RS_OPEN_REGION-p0419:32877-0] zookeeper.ZKAssign(832): regionserver:32877-0x14559c215740003, quorum=localhost:53570, baseZNode=/hbase Transitioning 63cdcba1fc55ae6463463ae16f4e454e from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED
      2014-04-12 23:24:55,850 DEBUG [RS_OPEN_REGION-p0419:41017-2] zookeeper.ZKAssign(832): regionserver:41017-0x14559c215740002, quorum=localhost:53570, baseZNode=/hbase Transitioning f9c185520bca999a753ee3ce0a244f6d from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED
      2014-04-12 23:24:55,869 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/a8a68d998d21b00499aca60887ae5aef
      2014-04-12 23:24:55,869 DEBUG [AM.ZK.Worker-pool2-t1] zookeeper.ZKAssign(480): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Deleted unassigned node a8a68d998d21b00499aca60887ae5aef in expected state RS_ZK_REGION_OPENED
      2014-04-12 23:24:55,869 DEBUG [AM.ZK.Worker-pool2-t1] master.AssignmentManager$4(1173): Znode testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef. deleted, state: {a8a68d998d21b00499aca60887ae5aef state=OPEN, ts=1397370295828, server=p0419.mtv.cloudera.com,39010,1397370264935}
      2014-04-12 23:24:55,869 INFO  [AM.ZK.Worker-pool2-t1] master.RegionStates(377): Onlined a8a68d998d21b00499aca60887ae5aef on p0419.mtv.cloudera.com,39010,1397370264935
      2014-04-12 23:24:55,910 DEBUG [RS_OPEN_REGION-p0419:32877-0] zookeeper.ZKAssign(907): regionserver:32877-0x14559c215740003, quorum=localhost:53570, baseZNode=/hbase Transitioned node 63cdcba1fc55ae6463463ae16f4e454e from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED
      2014-04-12 23:24:55,910 DEBUG [RS_OPEN_REGION-p0419:41017-2] zookeeper.ZKAssign(907): regionserver:41017-0x14559c215740002, quorum=localhost:53570, baseZNode=/hbase Transitioned node f9c185520bca999a753ee3ce0a244f6d from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED
      2014-04-12 23:24:55,911 DEBUG [RS_OPEN_REGION-p0419:41017-2] handler.OpenRegionHandler(389): Transitioned f9c185520bca999a753ee3ce0a244f6d to OPENED in zk on p0419.mtv.cloudera.com,41017,1397370264982
      2014-04-12 23:24:55,910 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/63cdcba1fc55ae6463463ae16f4e454e
      2014-04-12 23:24:55,911 DEBUG [RS_OPEN_REGION-p0419:41017-2] handler.OpenRegionHandler(189): Opened testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d. on p0419.mtv.cloudera.com,41017,1397370264982
      2014-04-12 23:24:55,910 DEBUG [RS_OPEN_REGION-p0419:32877-0] handler.OpenRegionHandler(389): Transitioned 63cdcba1fc55ae6463463ae16f4e454e to OPENED in zk on p0419.mtv.cloudera.com,32877,1397370265023
      2014-04-12 23:24:55,911 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/f9c185520bca999a753ee3ce0a244f6d
      2014-04-12 23:24:55,911 DEBUG [RS_OPEN_REGION-p0419:32877-0] handler.OpenRegionHandler(189): Opened testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e. on p0419.mtv.cloudera.com,32877,1397370265023
      2014-04-12 23:24:55,912 DEBUG [AM.ZK.Worker-pool2-t7] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=p0419.mtv.cloudera.com,32877,1397370265023, region=63cdcba1fc55ae6463463ae16f4e454e, current_state={63cdcba1fc55ae6463463ae16f4e454e state=OPENING, ts=1397370295694, server=p0419.mtv.cloudera.com,32877,1397370265023}
      2014-04-12 23:24:55,912 INFO  [AM.ZK.Worker-pool2-t7] master.RegionStates(316): Transitioned {63cdcba1fc55ae6463463ae16f4e454e state=OPENING, ts=1397370295694, server=p0419.mtv.cloudera.com,32877,1397370265023} to {63cdcba1fc55ae6463463ae16f4e454e state=OPEN, ts=1397370295912, server=p0419.mtv.cloudera.com,32877,1397370265023}
      2014-04-12 23:24:55,912 DEBUG [AM.ZK.Worker-pool2-t20] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=p0419.mtv.cloudera.com,41017,1397370264982, region=f9c185520bca999a753ee3ce0a244f6d, current_state={f9c185520bca999a753ee3ce0a244f6d state=OPENING, ts=1397370295695, server=p0419.mtv.cloudera.com,41017,1397370264982}
      2014-04-12 23:24:55,912 DEBUG [AM.ZK.Worker-pool2-t7] handler.OpenedRegionHandler(149): Handling OPENED of 63cdcba1fc55ae6463463ae16f4e454e from p0419.mtv.cloudera.com,32877,1397370265023; deleting unassigned node
      2014-04-12 23:24:55,912 INFO  [AM.ZK.Worker-pool2-t20] master.RegionStates(316): Transitioned {f9c185520bca999a753ee3ce0a244f6d state=OPENING, ts=1397370295695, server=p0419.mtv.cloudera.com,41017,1397370264982} to {f9c185520bca999a753ee3ce0a244f6d state=OPEN, ts=1397370295912, server=p0419.mtv.cloudera.com,41017,1397370264982}
      2014-04-12 23:24:55,913 DEBUG [AM.ZK.Worker-pool2-t20] handler.OpenedRegionHandler(149): Handling OPENED of f9c185520bca999a753ee3ce0a244f6d from p0419.mtv.cloudera.com,41017,1397370264982; deleting unassigned node
      2014-04-12 23:24:55,927 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/63cdcba1fc55ae6463463ae16f4e454e
      2014-04-12 23:24:55,927 DEBUG [AM.ZK.Worker-pool2-t7] zookeeper.ZKAssign(480): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Deleted unassigned node 63cdcba1fc55ae6463463ae16f4e454e in expected state RS_ZK_REGION_OPENED
      2014-04-12 23:24:55,927 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition
      2014-04-12 23:24:55,927 DEBUG [AM.ZK.Worker-pool2-t7] master.AssignmentManager$4(1173): Znode testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e. deleted, state: {63cdcba1fc55ae6463463ae16f4e454e state=OPEN, ts=1397370295912, server=p0419.mtv.cloudera.com,32877,1397370265023}
      2014-04-12 23:24:55,927 INFO  [AM.ZK.Worker-pool2-t7] master.RegionStates(377): Onlined 63cdcba1fc55ae6463463ae16f4e454e on p0419.mtv.cloudera.com,32877,1397370265023
      2014-04-12 23:24:55,935 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/f9c185520bca999a753ee3ce0a244f6d
      2014-04-12 23:24:55,935 DEBUG [AM.ZK.Worker-pool2-t20] zookeeper.ZKAssign(480): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Deleted unassigned node f9c185520bca999a753ee3ce0a244f6d in expected state RS_ZK_REGION_OPENED
      2014-04-12 23:24:55,936 DEBUG [AM.ZK.Worker-pool2-t20] master.AssignmentManager$4(1173): Znode testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d. deleted, state: {f9c185520bca999a753ee3ce0a244f6d state=OPEN, ts=1397370295912, server=p0419.mtv.cloudera.com,41017,1397370264982}
      2014-04-12 23:24:55,936 INFO  [AM.ZK.Worker-pool2-t20] master.RegionStates(377): Onlined f9c185520bca999a753ee3ce0a244f6d on p0419.mtv.cloudera.com,41017,1397370264982
      2014-04-12 23:24:56,206 INFO  [Thread-587] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x1ae9e1aa connecting to ZooKeeper ensemble=localhost:53570
      2014-04-12 23:24:56,206 DEBUG [Thread-587] catalog.CatalogTracker(193): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@55a56f72
      2014-04-12 23:24:56,219 DEBUG [Thread-587-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x1ae9e1aa, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null
      2014-04-12 23:24:56,219 DEBUG [Thread-587] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x1ae9e1aa, quorum=localhost:53570, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server
      2014-04-12 23:24:56,220 DEBUG [Thread-587-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x1ae9e1aa-0x14559c215740041 connected
      2014-04-12 23:24:56,225 DEBUG [Thread-587] catalog.CatalogTracker(209): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@55a56f72
      2014-04-12 23:24:56,263 DEBUG [Thread-587] client.ClientScanner(257): Advancing internal scanner to startKey at 'A'
      2014-04-12 23:24:56,267 DEBUG [Thread-587] client.ClientScanner(257): Advancing internal scanner to startKey at 'B'
      2014-04-12 23:24:56,270 DEBUG [Thread-587] client.ClientScanner(257): Advancing internal scanner to startKey at 'C'
      2014-04-12 23:24:56,273 INFO  [Thread-587] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x1ae9e1aa connecting to ZooKeeper ensemble=localhost:53570
      2014-04-12 23:24:56,274 DEBUG [Thread-587] catalog.CatalogTracker(193): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@7c28bed5
      2014-04-12 23:24:56,294 DEBUG [Thread-587-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x1ae9e1aa, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null
      2014-04-12 23:24:56,294 DEBUG [Thread-587] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x1ae9e1aa, quorum=localhost:53570, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server
      2014-04-12 23:24:56,295 DEBUG [Thread-587-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x1ae9e1aa-0x14559c215740042 connected
      2014-04-12 23:24:56,320 INFO  [Priority.RpcServer.handler=0,port=32877] regionserver.HRegionServer(3661): Flushing testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e.
      2014-04-12 23:24:56,322 DEBUG [Priority.RpcServer.handler=0,port=32877] regionserver.HRegion(1513): Started memstore flush for testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e., current region memstore size 320
      2014-04-12 23:24:56,460 INFO  [IPC Server handler 1 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:53997 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-80866ac4-36df-41f3-a856-da7636fa89a3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-34a4a47f-8a95-461c-8633-2a7fd583b8d9:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-45b6fa92-7966-4203-8e5a-f8115f53e1ae:NORMAL|RBW]]} size 0
      2014-04-12 23:24:56,461 INFO  [IPC Server handler 0 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:49422 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-80866ac4-36df-41f3-a856-da7636fa89a3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-34a4a47f-8a95-461c-8633-2a7fd583b8d9:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-45b6fa92-7966-4203-8e5a-f8115f53e1ae:NORMAL|RBW]]} size 0
      2014-04-12 23:24:56,462 INFO  [IPC Server handler 7 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33353 is added to blk_1073741872_1048 size 1042
      2014-04-12 23:24:56,502 INFO  [Priority.RpcServer.handler=0,port=32877] regionserver.DefaultStoreFlusher(88): Flushed, sequenceid=15, memsize=320, hasBloomFilter=true, into tmp file hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/63cdcba1fc55ae6463463ae16f4e454e/.tmp/57a07eaac97e4acd8dc04e08d1950adc
      2014-04-12 23:24:56,514 DEBUG [Priority.RpcServer.handler=0,port=32877] regionserver.HRegionFileSystem(338): Committing store file hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/63cdcba1fc55ae6463463ae16f4e454e/.tmp/57a07eaac97e4acd8dc04e08d1950adc as hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/63cdcba1fc55ae6463463ae16f4e454e/fam/57a07eaac97e4acd8dc04e08d1950adc
      2014-04-12 23:24:56,584 INFO  [Priority.RpcServer.handler=0,port=32877] regionserver.HStore(764): Added hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/63cdcba1fc55ae6463463ae16f4e454e/fam/57a07eaac97e4acd8dc04e08d1950adc, entries=2, sequenceid=15, filesize=1.0 K
      2014-04-12 23:24:56,584 INFO  [Priority.RpcServer.handler=0,port=32877] regionserver.HRegion(1660): Finished memstore flush of ~320/320, currentsize=0/0 for region testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e. in 262ms, sequenceid=15, compaction requested=false
      2014-04-12 23:24:56,586 INFO  [Priority.RpcServer.handler=0,port=39010] regionserver.HRegionServer(3661): Flushing testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef.
      2014-04-12 23:24:56,589 DEBUG [Priority.RpcServer.handler=0,port=39010] regionserver.HRegion(1513): Started memstore flush for testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef., current region memstore size 320
      2014-04-12 23:24:56,668 INFO  [IPC Server handler 7 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:53997 is added to blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0cf6df80-0db5-43f5-bbc4-a7092d736c08:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b2725947-b15b-4c3a-be84-aedc2a57e25f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a192707c-27de-4afa-9948-d58a0f0df6bf:NORMAL|RBW]]} size 0
      2014-04-12 23:24:56,669 INFO  [IPC Server handler 2 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:49422 is added to blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0cf6df80-0db5-43f5-bbc4-a7092d736c08:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b2725947-b15b-4c3a-be84-aedc2a57e25f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a192707c-27de-4afa-9948-d58a0f0df6bf:NORMAL|RBW]]} size 0
      2014-04-12 23:24:56,669 INFO  [IPC Server handler 8 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33353 is added to blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0cf6df80-0db5-43f5-bbc4-a7092d736c08:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b2725947-b15b-4c3a-be84-aedc2a57e25f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a192707c-27de-4afa-9948-d58a0f0df6bf:NORMAL|RBW]]} size 0
      2014-04-12 23:24:56,677 INFO  [Priority.RpcServer.handler=0,port=39010] regionserver.DefaultStoreFlusher(88): Flushed, sequenceid=10, memsize=320, hasBloomFilter=true, into tmp file hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/a8a68d998d21b00499aca60887ae5aef/.tmp/0ce0a00435f64a02856bfe0fb779093b
      2014-04-12 23:24:56,688 DEBUG [Priority.RpcServer.handler=0,port=39010] regionserver.HRegionFileSystem(338): Committing store file hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/a8a68d998d21b00499aca60887ae5aef/.tmp/0ce0a00435f64a02856bfe0fb779093b as hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/a8a68d998d21b00499aca60887ae5aef/fam/0ce0a00435f64a02856bfe0fb779093b
      2014-04-12 23:24:56,701 INFO  [Priority.RpcServer.handler=0,port=39010] regionserver.HStore(764): Added hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/a8a68d998d21b00499aca60887ae5aef/fam/0ce0a00435f64a02856bfe0fb779093b, entries=2, sequenceid=10, filesize=1.0 K
      2014-04-12 23:24:56,701 INFO  [Priority.RpcServer.handler=0,port=39010] regionserver.HRegion(1660): Finished memstore flush of ~320/320, currentsize=0/0 for region testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef. in 112ms, sequenceid=10, compaction requested=false
      2014-04-12 23:24:56,702 INFO  [Priority.RpcServer.handler=1,port=41017] regionserver.HRegionServer(3661): Flushing testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351.
      2014-04-12 23:24:56,702 DEBUG [Priority.RpcServer.handler=1,port=41017] regionserver.HRegion(1513): Started memstore flush for testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351., current region memstore size 320
      2014-04-12 23:24:56,734 INFO  [IPC Server handler 8 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:49422 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-45b6fa92-7966-4203-8e5a-f8115f53e1ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-34a4a47f-8a95-461c-8633-2a7fd583b8d9:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-80866ac4-36df-41f3-a856-da7636fa89a3:NORMAL|RBW]]} size 0
      2014-04-12 23:24:56,734 INFO  [IPC Server handler 5 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:53997 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-45b6fa92-7966-4203-8e5a-f8115f53e1ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-34a4a47f-8a95-461c-8633-2a7fd583b8d9:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-80866ac4-36df-41f3-a856-da7636fa89a3:NORMAL|RBW]]} size 0
      2014-04-12 23:24:56,735 INFO  [IPC Server handler 9 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33353 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-45b6fa92-7966-4203-8e5a-f8115f53e1ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-34a4a47f-8a95-461c-8633-2a7fd583b8d9:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-80866ac4-36df-41f3-a856-da7636fa89a3:NORMAL|RBW]]} size 0
      2014-04-12 23:24:56,744 INFO  [Priority.RpcServer.handler=1,port=41017] regionserver.DefaultStoreFlusher(88): Flushed, sequenceid=14, memsize=320, hasBloomFilter=true, into tmp file hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/d383980be98665b638fd56bfac97a351/.tmp/9dd79f30f29e4cfeaa46f6e20b32e078
      2014-04-12 23:24:56,754 DEBUG [Priority.RpcServer.handler=1,port=41017] regionserver.HRegionFileSystem(338): Committing store file hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/d383980be98665b638fd56bfac97a351/.tmp/9dd79f30f29e4cfeaa46f6e20b32e078 as hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/d383980be98665b638fd56bfac97a351/fam/9dd79f30f29e4cfeaa46f6e20b32e078
      2014-04-12 23:24:56,786 INFO  [Priority.RpcServer.handler=1,port=41017] regionserver.HStore(764): Added hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/d383980be98665b638fd56bfac97a351/fam/9dd79f30f29e4cfeaa46f6e20b32e078, entries=2, sequenceid=14, filesize=1.0 K
      2014-04-12 23:24:56,786 INFO  [Priority.RpcServer.handler=1,port=41017] regionserver.HRegion(1660): Finished memstore flush of ~320/320, currentsize=0/0 for region testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351. in 84ms, sequenceid=14, compaction requested=false
      2014-04-12 23:24:56,787 INFO  [Priority.RpcServer.handler=0,port=41017] regionserver.HRegionServer(3661): Flushing testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d.
      2014-04-12 23:24:56,787 DEBUG [Priority.RpcServer.handler=0,port=41017] regionserver.HRegion(1513): Started memstore flush for testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d., current region memstore size 320
      2014-04-12 23:24:57,027 INFO  [IPC Server handler 9 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:53997 is added to blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0cf6df80-0db5-43f5-bbc4-a7092d736c08:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a192707c-27de-4afa-9948-d58a0f0df6bf:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b2725947-b15b-4c3a-be84-aedc2a57e25f:NORMAL|RBW]]} size 0
      2014-04-12 23:24:57,028 INFO  [IPC Server handler 6 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:49422 is added to blk_1073741875_1051 size 1042
      2014-04-12 23:24:57,029 INFO  [IPC Server handler 4 on 50919] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33353 is added to blk_1073741875_1051 size 1042
      2014-04-12 23:24:57,077 INFO  [Priority.RpcServer.handler=0,port=41017] regionserver.DefaultStoreFlusher(88): Flushed, sequenceid=15, memsize=320, hasBloomFilter=true, into tmp file hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/f9c185520bca999a753ee3ce0a244f6d/.tmp/404e9e4c06b54305a0831dc4749d9a5f
      2014-04-12 23:24:57,089 DEBUG [Priority.RpcServer.handler=0,port=41017] regionserver.HRegionFileSystem(338): Committing store file hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/f9c185520bca999a753ee3ce0a244f6d/.tmp/404e9e4c06b54305a0831dc4749d9a5f as hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/f9c185520bca999a753ee3ce0a244f6d/fam/404e9e4c06b54305a0831dc4749d9a5f
      2014-04-12 23:24:57,153 INFO  [Priority.RpcServer.handler=0,port=41017] regionserver.HStore(764): Added hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/f9c185520bca999a753ee3ce0a244f6d/fam/404e9e4c06b54305a0831dc4749d9a5f, entries=2, sequenceid=15, filesize=1.0 K
      2014-04-12 23:24:57,154 INFO  [Priority.RpcServer.handler=0,port=41017] regionserver.HRegion(1660): Finished memstore flush of ~320/320, currentsize=0/0 for region testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d. in 367ms, sequenceid=15, compaction requested=false
      2014-04-12 23:24:57,154 DEBUG [Thread-587] catalog.CatalogTracker(209): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@7c28bed5
      2014-04-12 23:24:57,176 INFO  [Thread-587] client.HBaseAdmin$5(909): Started disable of testQuarantineMissingHFile
      2014-04-12 23:24:57,178 INFO  [RpcServer.handler=0,port=33001] master.HMaster(1980): Client=jenkins//172.29.122.11 disable testQuarantineMissingHFile
      2014-04-12 23:24:57,219 DEBUG [RpcServer.handler=0,port=33001] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testQuarantineMissingHFile/write-master:330010000000001
      2014-04-12 23:24:57,252 INFO  [MASTER_TABLE_OPERATIONS-p0419:33001-0] handler.DisableTableHandler(130): Attempting to disable table testQuarantineMissingHFile
      2014-04-12 23:24:57,253 INFO  [Thread-587] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x1ae9e1aa connecting to ZooKeeper ensemble=localhost:53570
      2014-04-12 23:24:57,254 DEBUG [Thread-587] catalog.CatalogTracker(193): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@17dc9229
      2014-04-12 23:24:57,277 INFO  [MASTER_TABLE_OPERATIONS-p0419:33001-0] handler.DisableTableHandler(174): Offlining 4 regions.
      2014-04-12 23:24:57,278 DEBUG [p0419.mtv.cloudera.com,33001,1397370264247-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-0] master.AssignmentManager(2232): Starting unassign of testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e. (offlining), current state: {63cdcba1fc55ae6463463ae16f4e454e state=OPEN, ts=1397370295927, server=p0419.mtv.cloudera.com,32877,1397370265023}
      2014-04-12 23:24:57,278 DEBUG [p0419.mtv.cloudera.com,33001,1397370264247-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-2] master.AssignmentManager(2232): Starting unassign of testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351. (offlining), current state: {d383980be98665b638fd56bfac97a351 state=OPEN, ts=1397370295844, server=p0419.mtv.cloudera.com,41017,1397370264982}
      2014-04-12 23:24:57,278 DEBUG [p0419.mtv.cloudera.com,33001,1397370264247-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-2] zookeeper.ZKAssign(527): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Creating unassigned node d383980be98665b638fd56bfac97a351 in a CLOSING state
      2014-04-12 23:24:57,278 DEBUG [p0419.mtv.cloudera.com,33001,1397370264247-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-1] master.AssignmentManager(2232): Starting unassign of testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef. (offlining), current state: {a8a68d998d21b00499aca60887ae5aef state=OPEN, ts=1397370295869, server=p0419.mtv.cloudera.com,39010,1397370264935}
      2014-04-12 23:24:57,278 DEBUG [p0419.mtv.cloudera.com,33001,1397370264247-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-1] zookeeper.ZKAssign(527): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Creating unassigned node a8a68d998d21b00499aca60887ae5aef in a CLOSING state
      2014-04-12 23:24:57,278 DEBUG [p0419.mtv.cloudera.com,33001,1397370264247-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-3] master.AssignmentManager(2232): Starting unassign of testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d. (offlining), current state: {f9c185520bca999a753ee3ce0a244f6d state=OPEN, ts=1397370295936, server=p0419.mtv.cloudera.com,41017,1397370264982}
      2014-04-12 23:24:57,278 DEBUG [p0419.mtv.cloudera.com,33001,1397370264247-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-0] zookeeper.ZKAssign(527): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Creating unassigned node 63cdcba1fc55ae6463463ae16f4e454e in a CLOSING state
      2014-04-12 23:24:57,279 DEBUG [p0419.mtv.cloudera.com,33001,1397370264247-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-3] zookeeper.ZKAssign(527): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Creating unassigned node f9c185520bca999a753ee3ce0a244f6d in a CLOSING state
      2014-04-12 23:24:57,311 DEBUG [Thread-587-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x1ae9e1aa, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null
      2014-04-12 23:24:57,312 DEBUG [Thread-587-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x1ae9e1aa-0x14559c215740043 connected
      2014-04-12 23:24:57,319 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition
      2014-04-12 23:24:57,319 DEBUG [Thread-587] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x1ae9e1aa-0x14559c215740043, quorum=localhost:53570, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server
      2014-04-12 23:24:57,320 INFO  [p0419.mtv.cloudera.com,33001,1397370264247-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-2] master.RegionStates(316): Transitioned {d383980be98665b638fd56bfac97a351 state=OPEN, ts=1397370295844, server=p0419.mtv.cloudera.com,41017,1397370264982} to {d383980be98665b638fd56bfac97a351 state=PENDING_CLOSE, ts=1397370297320, server=p0419.mtv.cloudera.com,41017,1397370264982}
      2014-04-12 23:24:57,320 INFO  [p0419.mtv.cloudera.com,33001,1397370264247-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-0] master.RegionStates(316): Transitioned {63cdcba1fc55ae6463463ae16f4e454e state=OPEN, ts=1397370295927, server=p0419.mtv.cloudera.com,32877,1397370265023} to {63cdcba1fc55ae6463463ae16f4e454e state=PENDING_CLOSE, ts=1397370297320, server=p0419.mtv.cloudera.com,32877,1397370265023}
      2014-04-12 23:24:57,320 INFO  [p0419.mtv.cloudera.com,33001,1397370264247-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-1] master.RegionStates(316): Transitioned {a8a68d998d21b00499aca60887ae5aef state=OPEN, ts=1397370295869, server=p0419.mtv.cloudera.com,39010,1397370264935} to {a8a68d998d21b00499aca60887ae5aef state=PENDING_CLOSE, ts=1397370297320, server=p0419.mtv.cloudera.com,39010,1397370264935}
      2014-04-12 23:24:57,320 INFO  [p0419.mtv.cloudera.com,33001,1397370264247-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-3] master.RegionStates(316): Transitioned {f9c185520bca999a753ee3ce0a244f6d state=OPEN, ts=1397370295936, server=p0419.mtv.cloudera.com,41017,1397370264982} to {f9c185520bca999a753ee3ce0a244f6d state=PENDING_CLOSE, ts=1397370297320, server=p0419.mtv.cloudera.com,41017,1397370264982}
      2014-04-12 23:24:57,320 INFO  [Priority.RpcServer.handler=0,port=41017] regionserver.HRegionServer(3635): Close d383980be98665b638fd56bfac97a351, via zk=yes, znode version=0, on null
      2014-04-12 23:24:57,320 INFO  [Priority.RpcServer.handler=1,port=32877] regionserver.HRegionServer(3635): Close 63cdcba1fc55ae6463463ae16f4e454e, via zk=yes, znode version=0, on null
      2014-04-12 23:24:57,321 INFO  [Priority.RpcServer.handler=1,port=39010] regionserver.HRegionServer(3635): Close a8a68d998d21b00499aca60887ae5aef, via zk=yes, znode version=0, on null
      2014-04-12 23:24:57,321 INFO  [Priority.RpcServer.handler=1,port=41017] regionserver.HRegionServer(3635): Close f9c185520bca999a753ee3ce0a244f6d, via zk=yes, znode version=0, on null
      2014-04-12 23:24:57,321 DEBUG [p0419.mtv.cloudera.com,33001,1397370264247-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-2] master.AssignmentManager(1674): Sent CLOSE to p0419.mtv.cloudera.com,41017,1397370264982 for region testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351.
      2014-04-12 23:24:57,321 DEBUG [RS_CLOSE_REGION-p0419:41017-1] handler.CloseRegionHandler(125): Processing close of testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d.
      2014-04-12 23:24:57,321 DEBUG [p0419.mtv.cloudera.com,33001,1397370264247-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-1] master.AssignmentManager(1674): Sent CLOSE to p0419.mtv.cloudera.com,39010,1397370264935 for region testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef.
      2014-04-12 23:24:57,321 DEBUG [p0419.mtv.cloudera.com,33001,1397370264247-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-0] master.AssignmentManager(1674): Sent CLOSE to p0419.mtv.cloudera.com,32877,1397370265023 for region testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e.
      2014-04-12 23:24:57,321 DEBUG [RS_CLOSE_REGION-p0419:39010-1] handler.CloseRegionHandler(125): Processing close of testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef.
      2014-04-12 23:24:57,321 DEBUG [RS_CLOSE_REGION-p0419:41017-2] handler.CloseRegionHandler(125): Processing close of testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351.
      2014-04-12 23:24:57,321 DEBUG [RS_CLOSE_REGION-p0419:32877-1] handler.CloseRegionHandler(125): Processing close of testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e.
      2014-04-12 23:24:57,321 DEBUG [p0419.mtv.cloudera.com,33001,1397370264247-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-3] master.AssignmentManager(1674): Sent CLOSE to p0419.mtv.cloudera.com,41017,1397370264982 for region testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d.
      2014-04-12 23:24:57,322 DEBUG [RS_CLOSE_REGION-p0419:41017-1] regionserver.HRegion(988): Closing testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d.: disabling compactions & flushes
      2014-04-12 23:24:57,323 DEBUG [RS_CLOSE_REGION-p0419:41017-1] regionserver.HRegion(1010): Updates disabled for region testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d.
      2014-04-12 23:24:57,323 DEBUG [RS_CLOSE_REGION-p0419:39010-1] regionserver.HRegion(988): Closing testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef.: disabling compactions & flushes
      2014-04-12 23:24:57,323 DEBUG [RS_CLOSE_REGION-p0419:39010-1] regionserver.HRegion(1010): Updates disabled for region testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef.
      2014-04-12 23:24:57,323 DEBUG [RS_CLOSE_REGION-p0419:41017-2] regionserver.HRegion(988): Closing testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351.: disabling compactions & flushes
      2014-04-12 23:24:57,323 DEBUG [RS_CLOSE_REGION-p0419:32877-1] regionserver.HRegion(988): Closing testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e.: disabling compactions & flushes
      2014-04-12 23:24:57,323 DEBUG [RS_CLOSE_REGION-p0419:41017-2] regionserver.HRegion(1010): Updates disabled for region testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351.
      2014-04-12 23:24:57,323 DEBUG [RS_CLOSE_REGION-p0419:32877-1] regionserver.HRegion(1010): Updates disabled for region testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e.
      2014-04-12 23:24:57,327 INFO  [StoreCloserThread-testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef.-1] regionserver.HStore(661): Closed fam
      2014-04-12 23:24:57,327 INFO  [StoreCloserThread-testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d.-1] regionserver.HStore(661): Closed fam
      2014-04-12 23:24:57,328 INFO  [RS_CLOSE_REGION-p0419:39010-1] regionserver.HRegion(1068): Closed testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef.
      2014-04-12 23:24:57,328 DEBUG [RS_CLOSE_REGION-p0419:39010-1] zookeeper.ZKAssign(832): regionserver:39010-0x14559c215740001, quorum=localhost:53570, baseZNode=/hbase Transitioning a8a68d998d21b00499aca60887ae5aef from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED
      2014-04-12 23:24:57,328 INFO  [RS_CLOSE_REGION-p0419:41017-1] regionserver.HRegion(1068): Closed testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d.
      2014-04-12 23:24:57,330 DEBUG [RS_CLOSE_REGION-p0419:41017-1] zookeeper.ZKAssign(832): regionserver:41017-0x14559c215740002, quorum=localhost:53570, baseZNode=/hbase Transitioning f9c185520bca999a753ee3ce0a244f6d from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED
      2014-04-12 23:24:57,330 INFO  [StoreCloserThread-testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e.-1] regionserver.HStore(661): Closed fam
      2014-04-12 23:24:57,330 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] handler.DisableTableHandler$BulkDisabler(230): Disable waiting until done; 300000 ms remaining; [{ENCODED => 63cdcba1fc55ae6463463ae16f4e454e, NAME => 'testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e.', STARTKEY => '', ENDKEY => 'A'}, {ENCODED => a8a68d998d21b00499aca60887ae5aef, NAME => 'testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef.', STARTKEY => 'A', ENDKEY => 'B'}, {ENCODED => d383980be98665b638fd56bfac97a351, NAME => 'testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351.', STARTKEY => 'B', ENDKEY => 'C'}, {ENCODED => f9c185520bca999a753ee3ce0a244f6d, NAME => 'testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d.', STARTKEY => 'C', ENDKEY => ''}]
      2014-04-12 23:24:57,330 INFO  [RS_CLOSE_REGION-p0419:32877-1] regionserver.HRegion(1068): Closed testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e.
      2014-04-12 23:24:57,330 INFO  [StoreCloserThread-testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351.-1] regionserver.HStore(661): Closed fam
      2014-04-12 23:24:57,331 DEBUG [RS_CLOSE_REGION-p0419:32877-1] zookeeper.ZKAssign(832): regionserver:32877-0x14559c215740003, quorum=localhost:53570, baseZNode=/hbase Transitioning 63cdcba1fc55ae6463463ae16f4e454e from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED
      2014-04-12 23:24:57,331 DEBUG [Thread-587] catalog.CatalogTracker(209): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@17dc9229
      2014-04-12 23:24:57,331 INFO  [RS_CLOSE_REGION-p0419:41017-2] regionserver.HRegion(1068): Closed testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351.
      2014-04-12 23:24:57,331 DEBUG [RS_CLOSE_REGION-p0419:41017-2] zookeeper.ZKAssign(832): regionserver:41017-0x14559c215740002, quorum=localhost:53570, baseZNode=/hbase Transitioning d383980be98665b638fd56bfac97a351 from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED
      2014-04-12 23:24:57,381 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] handler.DisableTableHandler$BulkDisabler(230): Disable waiting until done; 299947 ms remaining; [{ENCODED => 63cdcba1fc55ae6463463ae16f4e454e, NAME => 'testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e.', STARTKEY => '', ENDKEY => 'A'}, {ENCODED => a8a68d998d21b00499aca60887ae5aef, NAME => 'testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef.', STARTKEY => 'A', ENDKEY => 'B'}, {ENCODED => d383980be98665b638fd56bfac97a351, NAME => 'testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351.', STARTKEY => 'B', ENDKEY => 'C'}, {ENCODED => f9c185520bca999a753ee3ce0a244f6d, NAME => 'testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d.', STARTKEY => 'C', ENDKEY => ''}]
      2014-04-12 23:24:57,385 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/a8a68d998d21b00499aca60887ae5aef
      2014-04-12 23:24:57,385 DEBUG [RS_CLOSE_REGION-p0419:39010-1] zookeeper.ZKAssign(907): regionserver:39010-0x14559c215740001, quorum=localhost:53570, baseZNode=/hbase Transitioned node a8a68d998d21b00499aca60887ae5aef from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED
      2014-04-12 23:24:57,386 DEBUG [RS_CLOSE_REGION-p0419:39010-1] handler.CloseRegionHandler(168): Set closed state in zk for testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef. on p0419.mtv.cloudera.com,39010,1397370264935
      2014-04-12 23:24:57,386 DEBUG [RS_CLOSE_REGION-p0419:39010-1] handler.CloseRegionHandler(176): Closed testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef.
      2014-04-12 23:24:57,402 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/f9c185520bca999a753ee3ce0a244f6d
      2014-04-12 23:24:57,402 DEBUG [RS_CLOSE_REGION-p0419:41017-1] zookeeper.ZKAssign(907): regionserver:41017-0x14559c215740002, quorum=localhost:53570, baseZNode=/hbase Transitioned node f9c185520bca999a753ee3ce0a244f6d from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED
      2014-04-12 23:24:57,402 DEBUG [RS_CLOSE_REGION-p0419:41017-1] handler.CloseRegionHandler(168): Set closed state in zk for testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d. on p0419.mtv.cloudera.com,41017,1397370264982
      2014-04-12 23:24:57,402 DEBUG [RS_CLOSE_REGION-p0419:41017-1] handler.CloseRegionHandler(176): Closed testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d.
      2014-04-12 23:24:57,402 DEBUG [AM.ZK.Worker-pool2-t2] master.AssignmentManager(790): Handling RS_ZK_REGION_CLOSED, server=p0419.mtv.cloudera.com,39010,1397370264935, region=a8a68d998d21b00499aca60887ae5aef, current_state={a8a68d998d21b00499aca60887ae5aef state=PENDING_CLOSE, ts=1397370297320, server=p0419.mtv.cloudera.com,39010,1397370264935}
      2014-04-12 23:24:57,403 DEBUG [AM.ZK.Worker-pool2-t2] handler.ClosedRegionHandler(92): Handling CLOSED event for a8a68d998d21b00499aca60887ae5aef
      2014-04-12 23:24:57,403 DEBUG [Thread-587] client.HBaseAdmin(948): Sleeping= 100ms, waiting for all regions to be disabled in testQuarantineMissingHFile
      2014-04-12 23:24:57,403 DEBUG [AM.ZK.Worker-pool2-t2] master.AssignmentManager(1374): Table being disabled so deleting ZK node and removing from regions in transition, skipping assignment of region testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef.
      2014-04-12 23:24:57,410 DEBUG [RS_CLOSE_REGION-p0419:32877-1] zookeeper.ZKAssign(907): regionserver:32877-0x14559c215740003, quorum=localhost:53570, baseZNode=/hbase Transitioned node 63cdcba1fc55ae6463463ae16f4e454e from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED
      2014-04-12 23:24:57,410 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/63cdcba1fc55ae6463463ae16f4e454e
      2014-04-12 23:24:57,410 DEBUG [AM.ZK.Worker-pool2-t4] master.AssignmentManager(790): Handling RS_ZK_REGION_CLOSED, server=p0419.mtv.cloudera.com,41017,1397370264982, region=f9c185520bca999a753ee3ce0a244f6d, current_state={f9c185520bca999a753ee3ce0a244f6d state=PENDING_CLOSE, ts=1397370297320, server=p0419.mtv.cloudera.com,41017,1397370264982}
      2014-04-12 23:24:57,410 DEBUG [RS_CLOSE_REGION-p0419:32877-1] handler.CloseRegionHandler(168): Set closed state in zk for testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e. on p0419.mtv.cloudera.com,32877,1397370265023
      2014-04-12 23:24:57,411 DEBUG [AM.ZK.Worker-pool2-t4] handler.ClosedRegionHandler(92): Handling CLOSED event for f9c185520bca999a753ee3ce0a244f6d
      2014-04-12 23:24:57,411 DEBUG [RS_CLOSE_REGION-p0419:32877-1] handler.CloseRegionHandler(176): Closed testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e.
      2014-04-12 23:24:57,411 DEBUG [AM.ZK.Worker-pool2-t4] master.AssignmentManager(1374): Table being disabled so deleting ZK node and removing from regions in transition, skipping assignment of region testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d.
      2014-04-12 23:24:57,418 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/d383980be98665b638fd56bfac97a351
      2014-04-12 23:24:57,418 DEBUG [RS_CLOSE_REGION-p0419:41017-2] zookeeper.ZKAssign(907): regionserver:41017-0x14559c215740002, quorum=localhost:53570, baseZNode=/hbase Transitioned node d383980be98665b638fd56bfac97a351 from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED
      2014-04-12 23:24:57,419 DEBUG [AM.ZK.Worker-pool2-t12] master.AssignmentManager(790): Handling RS_ZK_REGION_CLOSED, server=p0419.mtv.cloudera.com,32877,1397370265023, region=63cdcba1fc55ae6463463ae16f4e454e, current_state={63cdcba1fc55ae6463463ae16f4e454e state=PENDING_CLOSE, ts=1397370297320, server=p0419.mtv.cloudera.com,32877,1397370265023}
      2014-04-12 23:24:57,419 DEBUG [RS_CLOSE_REGION-p0419:41017-2] handler.CloseRegionHandler(168): Set closed state in zk for testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351. on p0419.mtv.cloudera.com,41017,1397370264982
      2014-04-12 23:24:57,419 DEBUG [AM.ZK.Worker-pool2-t12] handler.ClosedRegionHandler(92): Handling CLOSED event for 63cdcba1fc55ae6463463ae16f4e454e
      2014-04-12 23:24:57,419 DEBUG [RS_CLOSE_REGION-p0419:41017-2] handler.CloseRegionHandler(176): Closed testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351.
      2014-04-12 23:24:57,419 DEBUG [AM.ZK.Worker-pool2-t12] master.AssignmentManager(1374): Table being disabled so deleting ZK node and removing from regions in transition, skipping assignment of region testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e.
      2014-04-12 23:24:57,427 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/a8a68d998d21b00499aca60887ae5aef
      2014-04-12 23:24:57,427 DEBUG [AM.ZK.Worker-pool2-t2] zookeeper.ZKAssign(480): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Deleted unassigned node a8a68d998d21b00499aca60887ae5aef in expected state RS_ZK_REGION_CLOSED
      2014-04-12 23:24:57,427 DEBUG [AM.ZK.Worker-pool2-t14] master.AssignmentManager(790): Handling RS_ZK_REGION_CLOSED, server=p0419.mtv.cloudera.com,41017,1397370264982, region=d383980be98665b638fd56bfac97a351, current_state={d383980be98665b638fd56bfac97a351 state=PENDING_CLOSE, ts=1397370297320, server=p0419.mtv.cloudera.com,41017,1397370264982}
      2014-04-12 23:24:57,427 INFO  [AM.ZK.Worker-pool2-t2] master.RegionStates(316): Transitioned {a8a68d998d21b00499aca60887ae5aef state=PENDING_CLOSE, ts=1397370297320, server=p0419.mtv.cloudera.com,39010,1397370264935} to {a8a68d998d21b00499aca60887ae5aef state=OFFLINE, ts=1397370297427, server=p0419.mtv.cloudera.com,39010,1397370264935}
      2014-04-12 23:24:57,427 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition
      2014-04-12 23:24:57,427 INFO  [AM.ZK.Worker-pool2-t2] master.RegionStates(457): Offlined a8a68d998d21b00499aca60887ae5aef from p0419.mtv.cloudera.com,39010,1397370264935
      2014-04-12 23:24:57,428 DEBUG [AM.ZK.Worker-pool2-t14] handler.ClosedRegionHandler(92): Handling CLOSED event for d383980be98665b638fd56bfac97a351
      2014-04-12 23:24:57,428 DEBUG [AM.ZK.Worker-pool2-t14] master.AssignmentManager(1374): Table being disabled so deleting ZK node and removing from regions in transition, skipping assignment of region testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351.
      2014-04-12 23:24:57,431 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] handler.DisableTableHandler$BulkDisabler(230): Disable waiting until done; 299897 ms remaining; [{ENCODED => 63cdcba1fc55ae6463463ae16f4e454e, NAME => 'testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e.', STARTKEY => '', ENDKEY => 'A'}, {ENCODED => d383980be98665b638fd56bfac97a351, NAME => 'testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351.', STARTKEY => 'B', ENDKEY => 'C'}, {ENCODED => f9c185520bca999a753ee3ce0a244f6d, NAME => 'testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d.', STARTKEY => 'C', ENDKEY => ''}]
      2014-04-12 23:24:57,435 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/f9c185520bca999a753ee3ce0a244f6d
      2014-04-12 23:24:57,435 DEBUG [AM.ZK.Worker-pool2-t4] zookeeper.ZKAssign(480): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Deleted unassigned node f9c185520bca999a753ee3ce0a244f6d in expected state RS_ZK_REGION_CLOSED
      2014-04-12 23:24:57,435 INFO  [AM.ZK.Worker-pool2-t4] master.RegionStates(316): Transitioned {f9c185520bca999a753ee3ce0a244f6d state=PENDING_CLOSE, ts=1397370297320, server=p0419.mtv.cloudera.com,41017,1397370264982} to {f9c185520bca999a753ee3ce0a244f6d state=OFFLINE, ts=1397370297435, server=p0419.mtv.cloudera.com,41017,1397370264982}
      2014-04-12 23:24:57,436 INFO  [AM.ZK.Worker-pool2-t4] master.RegionStates(457): Offlined f9c185520bca999a753ee3ce0a244f6d from p0419.mtv.cloudera.com,41017,1397370264982
      2014-04-12 23:24:57,444 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/63cdcba1fc55ae6463463ae16f4e454e
      2014-04-12 23:24:57,444 DEBUG [AM.ZK.Worker-pool2-t12] zookeeper.ZKAssign(480): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Deleted unassigned node 63cdcba1fc55ae6463463ae16f4e454e in expected state RS_ZK_REGION_CLOSED
      2014-04-12 23:24:57,444 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition
      2014-04-12 23:24:57,444 INFO  [AM.ZK.Worker-pool2-t12] master.RegionStates(316): Transitioned {63cdcba1fc55ae6463463ae16f4e454e state=PENDING_CLOSE, ts=1397370297320, server=p0419.mtv.cloudera.com,32877,1397370265023} to {63cdcba1fc55ae6463463ae16f4e454e state=OFFLINE, ts=1397370297444, server=p0419.mtv.cloudera.com,32877,1397370265023}
      2014-04-12 23:24:57,444 INFO  [AM.ZK.Worker-pool2-t12] master.RegionStates(457): Offlined 63cdcba1fc55ae6463463ae16f4e454e from p0419.mtv.cloudera.com,32877,1397370265023
      2014-04-12 23:24:57,452 DEBUG [AM.ZK.Worker-pool2-t14] zookeeper.ZKAssign(480): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Deleted unassigned node d383980be98665b638fd56bfac97a351 in expected state RS_ZK_REGION_CLOSED
      2014-04-12 23:24:57,452 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/d383980be98665b638fd56bfac97a351
      2014-04-12 23:24:57,452 INFO  [AM.ZK.Worker-pool2-t14] master.RegionStates(316): Transitioned {d383980be98665b638fd56bfac97a351 state=PENDING_CLOSE, ts=1397370297320, server=p0419.mtv.cloudera.com,41017,1397370264982} to {d383980be98665b638fd56bfac97a351 state=OFFLINE, ts=1397370297452, server=p0419.mtv.cloudera.com,41017,1397370264982}
      2014-04-12 23:24:57,452 INFO  [AM.ZK.Worker-pool2-t14] master.RegionStates(457): Offlined d383980be98665b638fd56bfac97a351 from p0419.mtv.cloudera.com,41017,1397370264982
      2014-04-12 23:24:57,482 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] handler.DisableTableHandler$BulkDisabler(230): Disable waiting until done; 299846 ms remaining; []
      2014-04-12 23:24:57,493 INFO  [MASTER_TABLE_OPERATIONS-p0419:33001-0] handler.DisableTableHandler(190): Disabled table is done=true
      2014-04-12 23:24:57,502 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testQuarantineMissingHFile/write-master:330010000000001
      2014-04-12 23:24:57,504 INFO  [Thread-587] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x1ae9e1aa connecting to ZooKeeper ensemble=localhost:53570
      2014-04-12 23:24:57,505 DEBUG [Thread-587] catalog.CatalogTracker(193): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@6c7f76bb
      2014-04-12 23:24:57,519 DEBUG [Thread-587-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x1ae9e1aa, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null
      2014-04-12 23:24:57,519 DEBUG [Thread-587] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x1ae9e1aa, quorum=localhost:53570, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server
      2014-04-12 23:24:57,520 DEBUG [Thread-587-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x1ae9e1aa-0x14559c215740044 connected
      2014-04-12 23:24:57,525 DEBUG [Thread-587] catalog.CatalogTracker(209): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@6c7f76bb
      2014-04-12 23:24:57,536 INFO  [Thread-587] client.HBaseAdmin(964): Disabled testQuarantineMissingHFile
      2014-04-12 23:24:57,540 INFO  [Thread-587] util.HBaseFsck(3774): Checking all hfiles for corruption
      2014-04-12 23:24:57,602 INFO  [IPC Server handler 7 on 50919] blockmanagement.BlockManager(1053): BLOCK* addToInvalidates: blk_1073741872_1048 127.0.0.1:49422 127.0.0.1:53997 127.0.0.1:33353 
      2014-04-12 23:24:57,638 WARN  [IPC Server handler 4 on 50919] security.UserGroupInformation(1551): PriviledgedActionException as:jenkins (auth:SIMPLE) cause:java.io.FileNotFoundException: File does not exist: /user/jenkins/hbase/data/default/testQuarantineMissingHFile/63cdcba1fc55ae6463463ae16f4e454e/fam/57a07eaac97e4acd8dc04e08d1950adc
      2014-04-12 23:24:57,640 WARN  [pool-115-thread-1] hbck.HFileCorruptionChecker(111): HFile hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/63cdcba1fc55ae6463463ae16f4e454e/fam/57a07eaac97e4acd8dc04e08d1950adc was missing.  Likely removed due to compaction/split?
      2014-04-12 23:24:57,652 INFO  [IPC Server handler 2 on 50919] blockmanagement.BlockManager(1053): BLOCK* addToInvalidates: blk_1073741874_1050 127.0.0.1:33353 127.0.0.1:53997 127.0.0.1:49422 
      2014-04-12 23:24:57,679 WARN  [IPC Server handler 3 on 50919] security.UserGroupInformation(1551): PriviledgedActionException as:jenkins (auth:SIMPLE) cause:java.io.FileNotFoundException: File does not exist: /user/jenkins/hbase/data/default/testQuarantineMissingHFile/d383980be98665b638fd56bfac97a351/fam/9dd79f30f29e4cfeaa46f6e20b32e078
      2014-04-12 23:24:57,680 WARN  [pool-115-thread-3] hbck.HFileCorruptionChecker(111): HFile hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/d383980be98665b638fd56bfac97a351/fam/9dd79f30f29e4cfeaa46f6e20b32e078 was missing.  Likely removed due to compaction/split?
      2014-04-12 23:24:57,682 INFO  [Thread-587] util.HBaseFsck(375): Loading regioninfos HDFS
      2014-04-12 23:24:57,682 INFO  [Thread-587] util.HBaseFsck(608): Loading HBase regioninfo from HDFS...
      2014-04-12 23:24:57,691 DEBUG [Thread-587] util.HBaseFsck(1334): Loading region dirs from hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile
      2014-04-12 23:24:57,691 DEBUG [Thread-587] util.HBaseFsck(1334): Loading region dirs from hdfs://localhost:50919/user/jenkins/hbase/data/hbase/meta
      2014-04-12 23:24:57,693 DEBUG [pool-115-thread-2] util.HBaseFsck$WorkItemHdfsDir(3211): Loading region info from hdfs:hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/63cdcba1fc55ae6463463ae16f4e454e
      2014-04-12 23:24:57,693 DEBUG [pool-115-thread-1] util.HBaseFsck$WorkItemHdfsDir(3211): Loading region info from hdfs:hdfs://localhost:50919/user/jenkins/hbase/data/hbase/meta/1588230740
      2014-04-12 23:24:57,696 DEBUG [pool-115-thread-2] util.HBaseFsck$WorkItemHdfsDir(3211): Loading region info from hdfs:hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/a8a68d998d21b00499aca60887ae5aef
      2014-04-12 23:24:57,699 DEBUG [pool-115-thread-2] util.HBaseFsck$WorkItemHdfsDir(3211): Loading region info from hdfs:hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/d383980be98665b638fd56bfac97a351
      2014-04-12 23:24:57,701 DEBUG [pool-115-thread-2] util.HBaseFsck$WorkItemHdfsDir(3211): Loading region info from hdfs:hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/f9c185520bca999a753ee3ce0a244f6d
      2014-04-12 23:24:57,714 DEBUG [pool-115-thread-4] util.HBaseFsck(762): HRegionInfo read: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}
      2014-04-12 23:24:57,721 DEBUG [pool-115-thread-3] util.HBaseFsck(762): HRegionInfo read: {ENCODED => 63cdcba1fc55ae6463463ae16f4e454e, NAME => 'testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e.', STARTKEY => '', ENDKEY => 'A'}
      2014-04-12 23:24:57,755 DEBUG [pool-115-thread-6] util.HBaseFsck(762): HRegionInfo read: {ENCODED => d383980be98665b638fd56bfac97a351, NAME => 'testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351.', STARTKEY => 'B', ENDKEY => 'C'}
      2014-04-12 23:24:57,755 DEBUG [pool-115-thread-1] util.HBaseFsck(762): HRegionInfo read: {ENCODED => f9c185520bca999a753ee3ce0a244f6d, NAME => 'testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d.', STARTKEY => 'C', ENDKEY => ''}
      2014-04-12 23:24:57,756 DEBUG [pool-115-thread-5] util.HBaseFsck(762): HRegionInfo read: {ENCODED => a8a68d998d21b00499aca60887ae5aef, NAME => 'testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef.', STARTKEY => 'A', ENDKEY => 'B'}
      2014-04-12 23:24:57,782 INFO  [Thread-587] util.HBaseFsck(1107): Checking HBase region split map from HDFS data...
      2014-04-12 23:24:57,782 INFO  [Thread-587] util.HBaseFsck(617): No integrity errors.  We are done with this phase. Glorious.
      2014-04-12 23:24:57,835 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/balancer
      2014-04-12 23:24:57,836 INFO  [RpcServer.handler=0,port=33001] master.HMaster(1550): Client=jenkins//172.29.122.11 set balanceSwitch=false
      2014-04-12 23:24:57,840 INFO  [Thread-587] zookeeper.RecoverableZooKeeper(120): Process identifier=hbase Fsck connecting to ZooKeeper ensemble=localhost:53570
      2014-04-12 23:24:57,869 DEBUG [Thread-587-EventThread] zookeeper.ZooKeeperWatcher(310): hbase Fsck, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null
      2014-04-12 23:24:57,870 DEBUG [Thread-587-EventThread] zookeeper.ZooKeeperWatcher(387): hbase Fsck-0x14559c215740045 connected
      2014-04-12 23:24:57,902 INFO  [Thread-587] util.HBaseFsck(431): Loading regionsinfo from the hbase:meta table
      2014-04-12 23:24:57,912 INFO  [Thread-587] util.HBaseFsck(2521): getHTableDescriptors == tableNames => []
      2014-04-12 23:24:57,922 DEBUG [Thread-587] util.HBaseFsck(1334): Loading region dirs from hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile
      2014-04-12 23:24:57,922 DEBUG [Thread-587] util.HBaseFsck(1334): Loading region dirs from hdfs://localhost:50919/user/jenkins/hbase/data/hbase/meta
      2014-04-12 23:24:57,923 DEBUG [pool-115-thread-10] util.HBaseFsck$WorkItemHdfsDir(3211): Loading region info from hdfs:hdfs://localhost:50919/user/jenkins/hbase/data/hbase/meta/1588230740
      2014-04-12 23:24:57,924 DEBUG [pool-115-thread-9] util.HBaseFsck$WorkItemHdfsDir(3211): Loading region info from hdfs:hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/63cdcba1fc55ae6463463ae16f4e454e
      2014-04-12 23:24:57,926 DEBUG [pool-115-thread-9] util.HBaseFsck$WorkItemHdfsDir(3211): Loading region info from hdfs:hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/a8a68d998d21b00499aca60887ae5aef
      2014-04-12 23:24:57,929 DEBUG [pool-115-thread-9] util.HBaseFsck$WorkItemHdfsDir(3211): Loading region info from hdfs:hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/d383980be98665b638fd56bfac97a351
      2014-04-12 23:24:57,931 DEBUG [pool-115-thread-9] util.HBaseFsck$WorkItemHdfsDir(3211): Loading region info from hdfs:hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/f9c185520bca999a753ee3ce0a244f6d
      2014-04-12 23:24:57,936 DEBUG [pool-115-thread-4] util.HBaseFsck(762): HRegionInfo read: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}
      2014-04-12 23:24:57,937 DEBUG [pool-115-thread-1] util.HBaseFsck(762): HRegionInfo read: {ENCODED => d383980be98665b638fd56bfac97a351, NAME => 'testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351.', STARTKEY => 'B', ENDKEY => 'C'}
      2014-04-12 23:24:57,977 DEBUG [pool-115-thread-6] util.HBaseFsck(762): HRegionInfo read: {ENCODED => a8a68d998d21b00499aca60887ae5aef, NAME => 'testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef.', STARTKEY => 'A', ENDKEY => 'B'}
      2014-04-12 23:24:57,977 DEBUG [pool-115-thread-5] util.HBaseFsck(762): HRegionInfo read: {ENCODED => f9c185520bca999a753ee3ce0a244f6d, NAME => 'testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d.', STARTKEY => 'C', ENDKEY => ''}
      2014-04-12 23:24:57,978 DEBUG [pool-115-thread-3] util.HBaseFsck(762): HRegionInfo read: {ENCODED => 63cdcba1fc55ae6463463ae16f4e454e, NAME => 'testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e.', STARTKEY => '', ENDKEY => 'A'}
      2014-04-12 23:24:58,004 INFO  [Thread-587] zookeeper.RecoverableZooKeeper(120): Process identifier=hbase Fsck connecting to ZooKeeper ensemble=localhost:53570
      2014-04-12 23:24:58,036 DEBUG [Thread-587-EventThread] zookeeper.ZooKeeperWatcher(310): hbase Fsck, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null
      2014-04-12 23:24:58,037 DEBUG [Thread-587-EventThread] zookeeper.ZooKeeperWatcher(387): hbase Fsck-0x14559c215740046 connected
      2014-04-12 23:24:58,069 INFO  [Thread-587] util.HBaseFsck(1650): Region { meta => testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e., hdfs => hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/63cdcba1fc55ae6463463ae16f4e454e, deployed =>  } is in META, and in a disabled tabled that is not deployed
      2014-04-12 23:24:58,069 INFO  [Thread-587] util.HBaseFsck(1650): Region { meta => testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef., hdfs => hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/a8a68d998d21b00499aca60887ae5aef, deployed =>  } is in META, and in a disabled tabled that is not deployed
      2014-04-12 23:24:58,069 INFO  [Thread-587] util.HBaseFsck(1650): Region { meta => testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351., hdfs => hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/d383980be98665b638fd56bfac97a351, deployed =>  } is in META, and in a disabled tabled that is not deployed
      2014-04-12 23:24:58,069 INFO  [Thread-587] util.HBaseFsck(1650): Region { meta => testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d., hdfs => hdfs://localhost:50919/user/jenkins/hbase/data/default/testQuarantineMissingHFile/f9c185520bca999a753ee3ce0a244f6d, deployed =>  } is in META, and in a disabled tabled that is not deployed
      2014-04-12 23:24:58,070 DEBUG [Thread-587] util.HBaseFsck(1804): There are 5 region info entries
      2014-04-12 23:24:58,110 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(310): master:33001-0x14559c215740000, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/balancer
      2014-04-12 23:24:58,111 INFO  [RpcServer.handler=0,port=33001] master.HMaster(1550): Client=jenkins//172.29.122.11 set balanceSwitch=true
      2014-04-12 23:24:58,152 INFO  [Thread-587] zookeeper.RecoverableZooKeeper(120): Process identifier=hbase Fsck connecting to ZooKeeper ensemble=localhost:53570
      2014-04-12 23:24:58,177 DEBUG [Thread-587-EventThread] zookeeper.ZooKeeperWatcher(310): hbase Fsck, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null
      2014-04-12 23:24:58,179 DEBUG [Thread-587-EventThread] zookeeper.ZooKeeperWatcher(387): hbase Fsck-0x14559c215740047 connected
      2014-04-12 23:24:58,182 INFO  [Thread-587] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x1ae9e1aa connecting to ZooKeeper ensemble=localhost:53570
      2014-04-12 23:24:58,182 DEBUG [Thread-587] catalog.CatalogTracker(193): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@73b62d67
      2014-04-12 23:24:58,219 DEBUG [Thread-587-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x1ae9e1aa, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null
      2014-04-12 23:24:58,219 DEBUG [Thread-587] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x1ae9e1aa, quorum=localhost:53570, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server
      2014-04-12 23:24:58,220 DEBUG [Thread-587-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x1ae9e1aa-0x14559c215740048 connected
      2014-04-12 23:24:58,226 DEBUG [Thread-587] catalog.CatalogTracker(209): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@73b62d67
      2014-04-12 23:24:58,279 INFO  [Thread-587] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x1ae9e1aa connecting to ZooKeeper ensemble=localhost:53570
      2014-04-12 23:24:58,279 DEBUG [Thread-587] catalog.CatalogTracker(193): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@490d9812
      2014-04-12 23:24:58,302 DEBUG [Thread-587-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x1ae9e1aa, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null
      2014-04-12 23:24:58,303 DEBUG [Thread-587] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x1ae9e1aa, quorum=localhost:53570, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server
      2014-04-12 23:24:58,303 DEBUG [Thread-587-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x1ae9e1aa-0x14559c215740049 connected
      2014-04-12 23:24:58,309 DEBUG [Thread-587] catalog.CatalogTracker(209): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@490d9812
      2014-04-12 23:24:58,354 INFO  [RpcServer.handler=0,port=33001] master.HMaster(1817): Client=jenkins//172.29.122.11 delete testQuarantineMissingHFile
      2014-04-12 23:24:58,420 DEBUG [RpcServer.handler=0,port=33001] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testQuarantineMissingHFile/write-master:330010000000002
      2014-04-12 23:24:58,432 INFO  [MASTER_TABLE_OPERATIONS-p0419:33001-0] handler.TableEventHandler(123): Handling table operation C_M_DELETE_TABLE on table testQuarantineMissingHFile
      2014-04-12 23:24:58,438 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] handler.DeleteTableHandler(93): Deleting regions from META
      2014-04-12 23:24:58,449 INFO  [MASTER_TABLE_OPERATIONS-p0419:33001-0] catalog.MetaEditor(495): Deleted [{ENCODED => 63cdcba1fc55ae6463463ae16f4e454e, NAME => 'testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e.', STARTKEY => '', ENDKEY => 'A'}, {ENCODED => a8a68d998d21b00499aca60887ae5aef, NAME => 'testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef.', STARTKEY => 'A', ENDKEY => 'B'}, {ENCODED => d383980be98665b638fd56bfac97a351, NAME => 'testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351.', STARTKEY => 'B', ENDKEY => 'C'}, {ENCODED => f9c185520bca999a753ee3ce0a244f6d, NAME => 'testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d.', STARTKEY => 'C', ENDKEY => ''}]
      2014-04-12 23:24:58,510 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] handler.DeleteTableHandler(104): Archiving region testQuarantineMissingHFile,,1397370294808.63cdcba1fc55ae6463463ae16f4e454e. from FS
      2014-04-12 23:24:58,511 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] backup.HFileArchiver(93): ARCHIVING hdfs://localhost:50919/user/jenkins/hbase/.tmp/data/default/testQuarantineMissingHFile/63cdcba1fc55ae6463463ae16f4e454e
      2014-04-12 23:24:58,515 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] backup.HFileArchiver(134): Archiving [class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:50919/user/jenkins/hbase/.tmp/data/default/testQuarantineMissingHFile/63cdcba1fc55ae6463463ae16f4e454e/fam]
      2014-04-12 23:24:58,635 INFO  [IPC Server handler 2 on 50919] blockmanagement.BlockManager(1053): BLOCK* addToInvalidates: blk_1073741869_1045 127.0.0.1:49422 127.0.0.1:33353 127.0.0.1:53997 
      2014-04-12 23:24:58,636 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] backup.HFileArchiver(453): Deleted all region files in: hdfs://localhost:50919/user/jenkins/hbase/.tmp/data/default/testQuarantineMissingHFile/63cdcba1fc55ae6463463ae16f4e454e
      2014-04-12 23:24:58,636 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] handler.DeleteTableHandler(104): Archiving region testQuarantineMissingHFile,A,1397370294808.a8a68d998d21b00499aca60887ae5aef. from FS
      2014-04-12 23:24:58,636 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] backup.HFileArchiver(93): ARCHIVING hdfs://localhost:50919/user/jenkins/hbase/.tmp/data/default/testQuarantineMissingHFile/a8a68d998d21b00499aca60887ae5aef
      2014-04-12 23:24:58,641 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] backup.HFileArchiver(134): Archiving [class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:50919/user/jenkins/hbase/.tmp/data/default/testQuarantineMissingHFile/a8a68d998d21b00499aca60887ae5aef/fam]
      2014-04-12 23:24:58,802 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] backup.HFileArchiver(438): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:50919/user/jenkins/hbase/.tmp/data/default/testQuarantineMissingHFile/a8a68d998d21b00499aca60887ae5aef/fam/0ce0a00435f64a02856bfe0fb779093b, to hdfs://localhost:50919/user/jenkins/hbase/archive/data/default/testQuarantineMissingHFile/a8a68d998d21b00499aca60887ae5aef/fam/0ce0a00435f64a02856bfe0fb779093b
      2014-04-12 23:24:58,835 INFO  [IPC Server handler 7 on 50919] blockmanagement.BlockManager(1053): BLOCK* addToInvalidates: blk_1073741871_1047 127.0.0.1:33353 127.0.0.1:53997 127.0.0.1:49422 
      2014-04-12 23:24:58,836 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] backup.HFileArchiver(453): Deleted all region files in: hdfs://localhost:50919/user/jenkins/hbase/.tmp/data/default/testQuarantineMissingHFile/a8a68d998d21b00499aca60887ae5aef
      2014-04-12 23:24:58,836 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] handler.DeleteTableHandler(104): Archiving region testQuarantineMissingHFile,B,1397370294808.d383980be98665b638fd56bfac97a351. from FS
      2014-04-12 23:24:58,836 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] backup.HFileArchiver(93): ARCHIVING hdfs://localhost:50919/user/jenkins/hbase/.tmp/data/default/testQuarantineMissingHFile/d383980be98665b638fd56bfac97a351
      2014-04-12 23:24:58,840 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] backup.HFileArchiver(134): Archiving [class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:50919/user/jenkins/hbase/.tmp/data/default/testQuarantineMissingHFile/d383980be98665b638fd56bfac97a351/fam]
      2014-04-12 23:24:58,860 INFO  [IPC Server handler 7 on 50919] blockmanagement.BlockManager(1053): BLOCK* addToInvalidates: blk_1073741868_1044 127.0.0.1:53997 127.0.0.1:49422 127.0.0.1:33353 
      2014-04-12 23:24:58,861 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] backup.HFileArchiver(453): Deleted all region files in: hdfs://localhost:50919/user/jenkins/hbase/.tmp/data/default/testQuarantineMissingHFile/d383980be98665b638fd56bfac97a351
      2014-04-12 23:24:58,861 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] handler.DeleteTableHandler(104): Archiving region testQuarantineMissingHFile,C,1397370294808.f9c185520bca999a753ee3ce0a244f6d. from FS
      2014-04-12 23:24:58,861 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] backup.HFileArchiver(93): ARCHIVING hdfs://localhost:50919/user/jenkins/hbase/.tmp/data/default/testQuarantineMissingHFile/f9c185520bca999a753ee3ce0a244f6d
      2014-04-12 23:24:58,865 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] backup.HFileArchiver(134): Archiving [class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:50919/user/jenkins/hbase/.tmp/data/default/testQuarantineMissingHFile/f9c185520bca999a753ee3ce0a244f6d/fam]
      2014-04-12 23:24:58,893 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] backup.HFileArchiver(438): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:50919/user/jenkins/hbase/.tmp/data/default/testQuarantineMissingHFile/f9c185520bca999a753ee3ce0a244f6d/fam/404e9e4c06b54305a0831dc4749d9a5f, to hdfs://localhost:50919/user/jenkins/hbase/archive/data/default/testQuarantineMissingHFile/f9c185520bca999a753ee3ce0a244f6d/fam/404e9e4c06b54305a0831dc4749d9a5f
      2014-04-12 23:24:58,902 INFO  [IPC Server handler 8 on 50919] blockmanagement.BlockManager(1053): BLOCK* addToInvalidates: blk_1073741870_1046 127.0.0.1:33353 127.0.0.1:53997 127.0.0.1:49422 
      2014-04-12 23:24:58,902 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] backup.HFileArchiver(453): Deleted all region files in: hdfs://localhost:50919/user/jenkins/hbase/.tmp/data/default/testQuarantineMissingHFile/f9c185520bca999a753ee3ce0a244f6d
      2014-04-12 23:24:58,910 INFO  [IPC Server handler 5 on 50919] blockmanagement.BlockManager(1053): BLOCK* addToInvalidates: blk_1073741867_1043 127.0.0.1:33353 127.0.0.1:53997 127.0.0.1:49422 
      2014-04-12 23:24:58,910 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] handler.DeleteTableHandler(114): Table 'testQuarantineMissingHFile' archived!
      2014-04-12 23:24:58,911 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] handler.DeleteTableHandler(117): Removing 'testQuarantineMissingHFile' descriptor.
      2014-04-12 23:24:58,912 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] handler.DeleteTableHandler(121): Removing 'testQuarantineMissingHFile' from region states.
      2014-04-12 23:24:58,912 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] handler.DeleteTableHandler(125): Marking 'testQuarantineMissingHFile' as deleted.
      2014-04-12 23:24:58,927 DEBUG [MASTER_TABLE_OPERATIONS-p0419:33001-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testQuarantineMissingHFile/write-master:330010000000002
      2014-04-12 23:24:59,068 INFO  [Thread-587] client.HBaseAdmin(696): Deleted testQuarantineMissingHFile
      2014-04-12 23:24:59,115 INFO  [pool-1-thread-1] hbase.ResourceChecker(171): after: util.TestHBaseFsck#testQuarantineMissingHFile Thread=420 (was 410)
      Potentially hanging thread: Thread-587-SendThread(localhost:53570)
      	sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
      	sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
      	sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
      	sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
      	sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
      	org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
      	org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1075)
      
      Potentially hanging thread: pool-115-thread-1
      	sun.misc.Unsafe.park(Native Method)
      	java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
      	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
      	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079)
      	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
      	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
      	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
      	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      	java.lang.Thread.run(Thread.java:724)
      
      Potentially hanging thread: pool-115-thread-6
      	sun.misc.Unsafe.park(Native Method)
      	java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
      	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
      	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079)
      	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
      	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
      	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
      	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      	java.lang.Thread.run(Thread.java:724)
      
      Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1456019779_8 at /127.0.0.1:34032 [Waiting for operation #5]
      	sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
      	sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
      	sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
      	sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
      	sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
      	org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335)
      	org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157)
      	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161)
      	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131)
      	java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
      	java.io.BufferedInputStream.read(BufferedInputStream.java:254)
      	java.io.DataInputStream.readShort(DataInputStream.java:312)
      	org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55)
      	org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:206)
      	java.lang.Thread.run(Thread.java:724)
      
      Potentially hanging thread: pool-115-thread-4
      	sun.misc.Unsafe.park(Native Method)
      	java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
      	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
      	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079)
      	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
      	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
      	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
      	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      	java.lang.Thread.run(Thread.java:724)
      
      Potentially hanging thread: pool-115-thread-3
      	sun.misc.Unsafe.park(Native Method)
      	java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
      	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
      	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079)
      	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
      	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
      	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
      	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      	java.lang.Thread.run(Thread.java:724)
      
      Potentially hanging thread: pool-115-thread-5
      	sun.misc.Unsafe.park(Native Method)
      	java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
      	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
      	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079)
      	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
      	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
      	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
      	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      	java.lang.Thread.run(Thread.java:724)
      
      Potentially hanging thread: Thread-587-EventThread
      	sun.misc.Unsafe.park(Native Method)
      	java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
      	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
      	java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      	org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
      
      Potentially hanging thread: pool-115-thread-9
      	sun.misc.Unsafe.park(Native Method)
      	java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
      	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
      	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079)
      	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
      	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
      	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
      	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      	java.lang.Thread.run(Thread.java:724)
      
      Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1456019779_8 at /127.0.0.1:34026 [Waiting for operation #7]
      	sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
      	sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
      	sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
      	sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
      	sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
      	org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335)
      	org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157)
      	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161)
      	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131)
      	java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
      	java.io.BufferedInputStream.read(BufferedInputStream.java:254)
      	java.io.DataInputStream.readShort(DataInputStream.java:312)
      	org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55)
      	org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:206)
      	java.lang.Thread.run(Thread.java:724)
      
      Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1456019779_8 at /127.0.0.1:33883 [Waiting for operation #12]
      	sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
      	sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
      	sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
      	sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
      	sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
      	org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335)
      	org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157)
      	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161)
      	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131)
      	java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
      	java.io.BufferedInputStream.read(BufferedInputStream.java:254)
      	java.io.DataInputStream.readShort(DataInputStream.java:312)
      	org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55)
      	org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:206)
      	java.lang.Thread.run(Thread.java:724)
      
      Potentially hanging thread: pool-115-thread-8
      	sun.misc.Unsafe.park(Native Method)
      	java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
      	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
      	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079)
      	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
      	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
      	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
      	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      	java.lang.Thread.run(Thread.java:724)
      
      Potentially hanging thread: pool-115-thread-10
      	sun.misc.Unsafe.park(Native Method)
      	java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
      	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
      	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079)
      	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
      	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
      	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
      	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      	java.lang.Thread.run(Thread.java:724)
      
      Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1456019779_8 at /127.0.0.1:36692 [Waiting for operation #7]
      	sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
      	sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
      	sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
      	sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
      	sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
      	org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335)
      	org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157)
      	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161)
      	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131)
      	java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
      	java.io.BufferedInputStream.read(BufferedInputStream.java:254)
      	java.io.DataInputStream.readShort(DataInputStream.java:312)
      	org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55)
      	org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:206)
      	java.lang.Thread.run(Thread.java:724)
      
      Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1456019779_8 at /127.0.0.1:44587 [Waiting for operation #12]
      	sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
      	sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
      	sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
      	sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
      	sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
      	org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335)
      	org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157)
      	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161)
      	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131)
      	java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
      	java.io.BufferedInputStream.read(BufferedInputStream.java:254)
      	java.io.DataInputStream.readShort(DataInputStream.java:312)
      	org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55)
      	org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:206)
      	java.lang.Thread.run(Thread.java:724)
      
      Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1456019779_8 at /127.0.0.1:36707 [Waiting for operation #6]
      	sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
      	sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
      	sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
      	sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
      	sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
      	org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335)
      	org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157)
      	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161)
      	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131)
      	java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
      	java.io.BufferedInputStream.read(BufferedInputStream.java:254)
      	java.io.DataInputStream.readShort(DataInputStream.java:312)
      	org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55)
      	org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:206)
      	java.lang.Thread.run(Thread.java:724)
      
      Potentially hanging thread: pool-115-thread-2
      	sun.misc.Unsafe.park(Native Method)
      	java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
      	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
      	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079)
      	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
      	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
      	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
      	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      	java.lang.Thread.run(Thread.java:724)
      
      Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1456019779_8 at /127.0.0.1:44585 [Waiting for operation #14]
      	sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
      	sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
      	sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
      	sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
      	sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
      	org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335)
      	org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157)
      	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161)
      	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131)
      	java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
      	java.io.BufferedInputStream.read(BufferedInputStream.java:254)
      	java.io.DataInputStream.readShort(DataInputStream.java:312)
      	org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55)
      	org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:206)
      	java.lang.Thread.run(Thread.java:724)
      
      Potentially hanging thread: pool-115-thread-7
      	sun.misc.Unsafe.park(Native Method)
      	java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
      	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
      	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079)
      	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
      	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
      	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
      	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      	java.lang.Thread.run(Thread.java:724)
       - Thread LEAK? -, OpenFileDescriptor=692 (was 691) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=32768 (was 32768), SystemLoadAverage=453 (was 422) - SystemLoadAverage LEAK? -, ProcessCount=485 (was 485), AvailableMemoryMB=3026 (was 3139), ConnectionCount=5 (was 5)
      2014-04-12 23:28:53,025 DEBUG [Thread-587-EventThread] zookeeper.ZooKeeperWatcher(310): hbase Fsck-0x14559c215740047, quorum=localhost:53570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null
      2014-04-12 23:28:53,025 DEBUG [Thread-587-EventThread] zookeeper.ZooKeeperWatcher(392): hbase Fsck-0x14559c215740047, quorum=localhost:53570, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring
      

        Activity

        Show
        stack added a comment - Not just 0.94. It failed here on trunk https://builds.apache.org/job/HBase-TRUNK/5423/testReport/junit/org.apache.hadoop.hbase.util/TestHBaseFsck/testQuarantineMissingHFile/
        Hide
        stack added a comment -

        Happened again on our internal rig.

        Regression
        
        org.apache.hadoop.hbase.util.TestHBaseFsck.testQuarantineMissingHFile
        
        Failing for the past 1 build (Since Failed#700 )
        Took 21 ms.
        add description
        Error Message
        
        expected:<2> but was:<1>
        Stacktrace
        
        java.lang.AssertionError: expected:<2> but was:<1>
        	at org.junit.Assert.fail(Assert.java:88)
        	at org.junit.Assert.failNotEquals(Assert.java:743)
        	at org.junit.Assert.assertEquals(Assert.java:118)
        	at org.junit.Assert.assertEquals(Assert.java:555)
        	at org.junit.Assert.assertEquals(Assert.java:542)
        	at org.apache.hadoop.hbase.util.TestHBaseFsck.doQuarantineTest(TestHBaseFsck.java:1681)
        	at org.apache.hadoop.hbase.util.TestHBaseFsck.testQuarantineMissingHFile(TestHBaseFsck.java:1723)
        	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        	at java.lang.reflect.Method.invoke(Method.java:597)
        	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
        	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
        	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
        	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
        	at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
        Standard Output
        
        Allow checking/fixes for table: testQuarantineMissingHFile
        Checked 4 hfile for corruption
          HFiles corrupted:                  0
            HFiles successfully quarantined: 0
            HFiles failed quarantine:        0
            HFiles moved while checking:     2
              hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/fam/92484a47b8f14c338314b70c98ebc0dc
              hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/fam/e81f27e4ffbf435cb38dca815be340e8
        Summary: OK => OK
        Version: 0.94.15-cdh4.8.0-SNAPSHOT
        ---- Table '-ROOT-': region split map
        :	[ { meta => null, hdfs => hdfs://localhost:58811/user/jenkins/hbase/-ROOT-/70236052, deployed =>  }, ]	
        null:	
        ---- Table '-ROOT-': overlap groups
        There are 0 overlap groups with 0 overlapping regions
        ---- Table '.META.': region split map
        :	[ { meta => null, hdfs => hdfs://localhost:58811/user/jenkins/hbase/.META./1028785192, deployed =>  }, ]	
        null:	
        ---- Table '.META.': overlap groups
        There are 0 overlap groups with 0 overlapping regions
        ---- Table 'testQuarantineMissingHFile': region split map
        :	[ { meta => null, hdfs => hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372, deployed =>  }, A]	
        A:	[ { meta => null, hdfs => hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5, deployed =>  }, B]	
        B:	[ { meta => null, hdfs => hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212, deployed =>  }, C]	
        C:	[ { meta => null, hdfs => hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214, deployed =>  }, ]	
        null:	
        ---- Table 'testQuarantineMissingHFile': overlap groups
        There are 0 overlap groups with 0 overlapping regions
        Number of Tables: 0
        Number of Tables in flux: 2
        Number of live region servers: 3
          p0420.sjc.cloudera.com,60875,1408686379690
          p0420.sjc.cloudera.com,54158,1408686379607
          p0420.sjc.cloudera.com,56883,1408686379653
        Number of dead region servers: 0
        Master: p0420.sjc.cloudera.com,37883,1408686379181
        Number of backup masters: 0
        RegionServer: p0420.sjc.cloudera.com,54158,1408686379607 number of regions: 0
        RegionServer: p0420.sjc.cloudera.com,56883,1408686379653 number of regions: 0
        RegionServer: p0420.sjc.cloudera.com,60875,1408686379690 number of regions: 2
          -ROOT-,,0.70236052 id: 0 encoded_name: 70236052 start:  end: 
          .META.,,1.1028785192 id: 1 encoded_name: 1028785192 start:  end: 
        Number of empty REGIONINFO_QUALIFIER rows in .META.: 0
        ---- Table '-ROOT-': region split map
        :	[ { meta => -ROOT-,,0.70236052, hdfs => hdfs://localhost:58811/user/jenkins/hbase/-ROOT-/70236052, deployed => p0420.sjc.cloudera.com,60875,1408686379690;-ROOT-,,0.70236052 }, ]	
        null:	
        ---- Table '-ROOT-': overlap groups
        There are 0 overlap groups with 0 overlapping regions
        ---- Table '.META.': region split map
        :	[ { meta => .META.,,1.1028785192, hdfs => hdfs://localhost:58811/user/jenkins/hbase/.META./1028785192, deployed => p0420.sjc.cloudera.com,60875,1408686379690;.META.,,1.1028785192 }, ]	
        null:	
        ---- Table '.META.': overlap groups
        There are 0 overlap groups with 0 overlapping regions
        Summary:
          -ROOT- is okay.
            Number of regions: 1
            Deployed on:  p0420.sjc.cloudera.com,60875,1408686379690
          .META. is okay.
            Number of regions: 1
            Deployed on:  p0420.sjc.cloudera.com,60875,1408686379690
        0 inconsistencies detected.
        Status: OK
        Standard Error
        
        2014-08-21 22:46:46,684 INFO  [pool-1-thread-1] hbase.ResourceChecker(157): before util.TestHBaseFsck#testQuarantineMissingHFile: 385 threads, 600 file descriptors 5 connections, 
        2014-08-21 22:46:46,711 DEBUG [IPC Server handler 4 on 37883] client.ClientScanner(90): Creating scanner over .META. starting at key 'testQuarantineMissingHFile,,'
        2014-08-21 22:46:46,712 DEBUG [IPC Server handler 4 on 37883] client.ClientScanner(203): Advancing internal scanner to startKey at 'testQuarantineMissingHFile,,'
        2014-08-21 22:46:46,714 DEBUG [IPC Server handler 4 on 37883] client.ClientScanner(190): Finished with scanning at {NAME => '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED => 1028785192,}
        2014-08-21 22:46:46,757 INFO  [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.CreateTableHandler(126): Attempting to create the table testQuarantineMissingHFile
        2014-08-21 22:46:46,759 DEBUG [Thread-609] client.MetaScanner(182): Scanning .META. starting at row=testQuarantineMissingHFile,,00000000000000 for max=2147483647 rows using org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033
        2014-08-21 22:46:46,795 INFO  [IPC Server handler 0 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40206 is added to blk_7267598665009752386_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:40670|RBW], ReplicaUnderConstruction[127.0.0.1:34823|RBW], ReplicaUnderConstruction[127.0.0.1:40206|RBW]]} size 0
        2014-08-21 22:46:46,796 INFO  [IPC Server handler 7 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34823 is added to blk_7267598665009752386_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:40670|RBW], ReplicaUnderConstruction[127.0.0.1:34823|RBW], ReplicaUnderConstruction[127.0.0.1:40206|RBW]]} size 0
        2014-08-21 22:46:46,797 INFO  [IPC Server handler 5 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40670 is added to blk_7267598665009752386_1086 size 707
        2014-08-21 22:46:46,844 INFO  [RegionOpenAndInitThread-testQuarantineMissingHFile-1] regionserver.HRegion(4341): creating HRegion testQuarantineMissingHFile HTD == 'testQuarantineMissingHFile', {NAME => 'fam', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '3', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => '2147483647', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', ENCODE_ON_DISK => 'true', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:58811/user/jenkins/hbase/.tmp Table name == testQuarantineMissingHFile
        2014-08-21 22:46:46,845 INFO  [RegionOpenAndInitThread-testQuarantineMissingHFile-3] regionserver.HRegion(4341): creating HRegion testQuarantineMissingHFile HTD == 'testQuarantineMissingHFile', {NAME => 'fam', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '3', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => '2147483647', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', ENCODE_ON_DISK => 'true', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:58811/user/jenkins/hbase/.tmp Table name == testQuarantineMissingHFile
        2014-08-21 22:46:46,845 INFO  [RegionOpenAndInitThread-testQuarantineMissingHFile-4] regionserver.HRegion(4341): creating HRegion testQuarantineMissingHFile HTD == 'testQuarantineMissingHFile', {NAME => 'fam', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '3', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => '2147483647', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', ENCODE_ON_DISK => 'true', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:58811/user/jenkins/hbase/.tmp Table name == testQuarantineMissingHFile
        2014-08-21 22:46:46,844 INFO  [RegionOpenAndInitThread-testQuarantineMissingHFile-2] regionserver.HRegion(4341): creating HRegion testQuarantineMissingHFile HTD == 'testQuarantineMissingHFile', {NAME => 'fam', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '3', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => '2147483647', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', ENCODE_ON_DISK => 'true', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:58811/user/jenkins/hbase/.tmp Table name == testQuarantineMissingHFile
        2014-08-21 22:46:46,887 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-1] util.FSUtils(157): Creating file=hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/.tmp/.regioninfo with permission=rwxrwxrwx
        2014-08-21 22:46:46,888 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-4] util.FSUtils(157): Creating file=hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/.tmp/.regioninfo with permission=rwxrwxrwx
        2014-08-21 22:46:46,896 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-2] util.FSUtils(157): Creating file=hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/.tmp/.regioninfo with permission=rwxrwxrwx
        2014-08-21 22:46:46,897 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-3] util.FSUtils(157): Creating file=hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/.tmp/.regioninfo with permission=rwxrwxrwx
        2014-08-21 22:46:46,952 INFO  [IPC Server handler 6 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40206 is added to blk_1232571622821848185_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:34823|RBW], ReplicaUnderConstruction[127.0.0.1:40670|RBW], ReplicaUnderConstruction[127.0.0.1:40206|RBW]]} size 0
        2014-08-21 22:46:46,954 INFO  [IPC Server handler 0 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40670 is added to blk_1232571622821848185_1091 size 287
        2014-08-21 22:46:46,956 INFO  [IPC Server handler 9 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40206 is added to blk_-8586672548042035946_1092{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:34823|RBW], ReplicaUnderConstruction[127.0.0.1:40670|RBW], ReplicaUnderConstruction[127.0.0.1:40206|RBW]]} size 289
        2014-08-21 22:46:46,956 INFO  [IPC Server handler 2 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34823 is added to blk_1232571622821848185_1091 size 287
        2014-08-21 22:46:46,957 INFO  [IPC Server handler 4 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40670 is added to blk_-8586672548042035946_1092 size 289
        2014-08-21 22:46:46,960 INFO  [IPC Server handler 3 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34823 is added to blk_-8586672548042035946_1092 size 289
        2014-08-21 22:46:46,963 INFO  [IPC Server handler 0 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34823 is added to blk_214010544537184802_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:40206|RBW], ReplicaUnderConstruction[127.0.0.1:34823|RBW], ReplicaUnderConstruction[127.0.0.1:40670|RBW]]} size 0
        2014-08-21 22:46:46,964 INFO  [IPC Server handler 5 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40206 is added to blk_214010544537184802_1093 size 291
        2014-08-21 22:46:46,965 INFO  [IPC Server handler 2 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40670 is added to blk_214010544537184802_1093 size 291
        2014-08-21 22:46:46,977 INFO  [IPC Server handler 5 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40206 is added to blk_4217073309354766419_1094{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:40206|RBW], ReplicaUnderConstruction[127.0.0.1:40670|RBW], ReplicaUnderConstruction[127.0.0.1:34823|RBW]]} size 291
        2014-08-21 22:46:46,977 INFO  [IPC Server handler 0 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40670 is added to blk_4217073309354766419_1094 size 291
        2014-08-21 22:46:46,977 INFO  [IPC Server handler 2 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34823 is added to blk_4217073309354766419_1094 size 291
        2014-08-21 22:46:47,036 INFO  [RegionOpenAndInitThread-testQuarantineMissingHFile-2] regionserver.HRegion(512): Setting up tabledescriptor config now ...
        2014-08-21 22:46:47,036 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-2] regionserver.HRegion(506): Instantiated testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.
        2014-08-21 22:46:47,036 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-2] regionserver.HRegion(1018): Closing testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.: disabling compactions & flushes
        2014-08-21 22:46:47,037 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-2] regionserver.HRegion(1045): Updates disabled for region testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.
        2014-08-21 22:46:47,037 INFO  [RegionOpenAndInitThread-testQuarantineMissingHFile-2] regionserver.HRegion(1117): Closed testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.
        2014-08-21 22:46:47,061 INFO  [RegionOpenAndInitThread-testQuarantineMissingHFile-1] regionserver.HRegion(512): Setting up tabledescriptor config now ...
        2014-08-21 22:46:47,061 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-1] regionserver.HRegion(506): Instantiated testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.
        2014-08-21 22:46:47,061 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-1] regionserver.HRegion(1018): Closing testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.: disabling compactions & flushes
        2014-08-21 22:46:47,062 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-1] regionserver.HRegion(1045): Updates disabled for region testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.
        2014-08-21 22:46:47,062 INFO  [RegionOpenAndInitThread-testQuarantineMissingHFile-1] regionserver.HRegion(1117): Closed testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.
        2014-08-21 22:46:47,377 INFO  [RegionOpenAndInitThread-testQuarantineMissingHFile-4] regionserver.HRegion(512): Setting up tabledescriptor config now ...
        2014-08-21 22:46:47,378 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-4] regionserver.HRegion(506): Instantiated testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.
        2014-08-21 22:46:47,378 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-4] regionserver.HRegion(1018): Closing testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.: disabling compactions & flushes
        2014-08-21 22:46:47,378 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-4] regionserver.HRegion(1045): Updates disabled for region testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.
        2014-08-21 22:46:47,378 INFO  [RegionOpenAndInitThread-testQuarantineMissingHFile-4] regionserver.HRegion(1117): Closed testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.
        2014-08-21 22:46:47,394 INFO  [RegionOpenAndInitThread-testQuarantineMissingHFile-3] regionserver.HRegion(512): Setting up tabledescriptor config now ...
        2014-08-21 22:46:47,395 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-3] regionserver.HRegion(506): Instantiated testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.
        2014-08-21 22:46:47,395 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-3] regionserver.HRegion(1018): Closing testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.: disabling compactions & flushes
        2014-08-21 22:46:47,395 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-3] regionserver.HRegion(1045): Updates disabled for region testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.
        2014-08-21 22:46:47,395 INFO  [RegionOpenAndInitThread-testQuarantineMissingHFile-3] regionserver.HRegion(1117): Closed testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.
        2014-08-21 22:46:47,406 INFO  [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] catalog.MetaEditor(199): Added 4 regions in META
        2014-08-21 22:46:47,407 INFO  [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] master.AssignmentManager(2413): Bulk assigning 4 region(s) round-robin across 3 server(s)
        2014-08-21 22:46:47,407 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-StartupBulkAssigner-0] master.AssignmentManager(1440): Bulk assigning 1 region(s) to p0420.sjc.cloudera.com,54158,1408686379607
        2014-08-21 22:46:47,407 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-StartupBulkAssigner-1] master.AssignmentManager(1440): Bulk assigning 2 region(s) to p0420.sjc.cloudera.com,56883,1408686379653
        2014-08-21 22:46:47,408 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-StartupBulkAssigner-0] zookeeper.ZKAssign(169): master:37883-0x147fc404e830000 Async create of unassigned node for c425f751446d62d8f4a9d9f5d8811214 with OFFLINE state
        2014-08-21 22:46:47,408 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-StartupBulkAssigner-1] zookeeper.ZKAssign(169): master:37883-0x147fc404e830000 Async create of unassigned node for 1eeb1332ce0a2f3b96882b0ec1572dc5 with OFFLINE state
        2014-08-21 22:46:47,407 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] master.AssignmentManager$StartupBulkAssigner(2549): Timeout-on-RIT=1000
        2014-08-21 22:46:47,407 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-StartupBulkAssigner-2] master.AssignmentManager(1440): Bulk assigning 1 region(s) to p0420.sjc.cloudera.com,60875,1408686379690
        2014-08-21 22:46:47,408 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-StartupBulkAssigner-1] zookeeper.ZKAssign(169): master:37883-0x147fc404e830000 Async create of unassigned node for 1644a212531c3b43dde748d401c7e212 with OFFLINE state
        2014-08-21 22:46:47,408 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-StartupBulkAssigner-2] zookeeper.ZKAssign(169): master:37883-0x147fc404e830000 Async create of unassigned node for a8edbdfb2e9b02881ebc1702752b2372 with OFFLINE state
        2014-08-21 22:46:47,416 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/unassigned
        2014-08-21 22:46:47,425 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212 and set watcher; region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_OFFLINE
        2014-08-21 22:46:47,426 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214 and set watcher; region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_OFFLINE
        2014-08-21 22:46:47,426 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 133 byte(s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372 and set watcher; region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_OFFLINE
        2014-08-21 22:46:47,427 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5 and set watcher; region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_OFFLINE
        2014-08-21 22:46:47,427 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager$CreateUnassignedAsyncCallback(1564): rs=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. state=OFFLINE, ts=1408686407407, server=null, server=p0420.sjc.cloudera.com,54158,1408686379607
        2014-08-21 22:46:47,427 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager$CreateUnassignedAsyncCallback(1564): rs=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. state=OFFLINE, ts=1408686407408, server=null, server=p0420.sjc.cloudera.com,56883,1408686379653
        2014-08-21 22:46:47,427 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager$CreateUnassignedAsyncCallback(1564): rs=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. state=OFFLINE, ts=1408686407408, server=null, server=p0420.sjc.cloudera.com,56883,1408686379653
        2014-08-21 22:46:47,428 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager$CreateUnassignedAsyncCallback(1564): rs=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. state=OFFLINE, ts=1408686407408, server=null, server=p0420.sjc.cloudera.com,60875,1408686379690
        2014-08-21 22:46:47,428 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager$ExistsUnassignedAsyncCallback(1604): rs=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. state=OFFLINE, ts=1408686407407, server=null
        2014-08-21 22:46:47,428 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager$ExistsUnassignedAsyncCallback(1604): rs=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. state=OFFLINE, ts=1408686407408, server=null
        2014-08-21 22:46:47,428 INFO  [p0420.sjc.cloudera.com,37883,1408686379181-StartupBulkAssigner-0] master.AssignmentManager(1473): p0420.sjc.cloudera.com,54158,1408686379607 outstanding calls=1 of total=1
        2014-08-21 22:46:47,428 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager$ExistsUnassignedAsyncCallback(1604): rs=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. state=OFFLINE, ts=1408686407408, server=null
        2014-08-21 22:46:47,428 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager$ExistsUnassignedAsyncCallback(1604): rs=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. state=OFFLINE, ts=1408686407408, server=null
        2014-08-21 22:46:47,429 INFO  [p0420.sjc.cloudera.com,37883,1408686379181-StartupBulkAssigner-1] master.AssignmentManager(1473): p0420.sjc.cloudera.com,56883,1408686379653 outstanding calls=2 of total=2
        2014-08-21 22:46:47,429 INFO  [PRI IPC Server handler 1 on 54158] regionserver.HRegionServer(3158): Received request to open 1 region(s)
        2014-08-21 22:46:47,429 INFO  [PRI IPC Server handler 1 on 54158] regionserver.HRegionServer(3056): Received request to open region: testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.
        2014-08-21 22:46:47,429 INFO  [p0420.sjc.cloudera.com,37883,1408686379181-StartupBulkAssigner-2] master.AssignmentManager(1473): p0420.sjc.cloudera.com,60875,1408686379690 outstanding calls=1 of total=1
        2014-08-21 22:46:47,429 INFO  [PRI IPC Server handler 3 on 56883] regionserver.HRegionServer(3158): Received request to open 2 region(s)
        2014-08-21 22:46:47,429 INFO  [PRI IPC Server handler 1 on 60875] regionserver.HRegionServer(3158): Received request to open 1 region(s)
        2014-08-21 22:46:47,430 INFO  [PRI IPC Server handler 3 on 56883] regionserver.HRegionServer(3056): Received request to open region: testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.
        2014-08-21 22:46:47,430 INFO  [PRI IPC Server handler 1 on 60875] regionserver.HRegionServer(3056): Received request to open region: testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.
        2014-08-21 22:46:47,436 DEBUG [PRI IPC Server handler 1 on 54158] zookeeper.ZKAssign(757): regionserver:54158-0x147fc404e830001 Attempting to transition node c425f751446d62d8f4a9d9f5d8811214 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,436 DEBUG [PRI IPC Server handler 3 on 56883] zookeeper.ZKAssign(757): regionserver:56883-0x147fc404e830002 Attempting to transition node 1eeb1332ce0a2f3b96882b0ec1572dc5 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,437 DEBUG [PRI IPC Server handler 1 on 54158] zookeeper.ZKUtil(1599): regionserver:54158-0x147fc404e830001 Retrieved 134 byte(s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214; data=region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_OFFLINE
        2014-08-21 22:46:47,437 DEBUG [PRI IPC Server handler 3 on 56883] zookeeper.ZKUtil(1599): regionserver:56883-0x147fc404e830002 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5; data=region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_OFFLINE
        2014-08-21 22:46:47,441 DEBUG [PRI IPC Server handler 1 on 54158] zookeeper.ZKAssign(820): regionserver:54158-0x147fc404e830001 Successfully transitioned node c425f751446d62d8f4a9d9f5d8811214 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,441 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214
        2014-08-21 22:46:47,441 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] regionserver.HRegion(4413): Opening region: {NAME => 'testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.', STARTKEY => 'C', ENDKEY => '', ENCODED => c425f751446d62d8f4a9d9f5d8811214,}
        2014-08-21 22:46:47,441 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-StartupBulkAssigner-0] master.AssignmentManager(1525): Bulk assigning done for p0420.sjc.cloudera.com,54158,1408686379607
        2014-08-21 22:46:47,442 INFO  [RS_OPEN_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] regionserver.HRegion(512): Setting up tabledescriptor config now ...
        2014-08-21 22:46:47,442 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] regionserver.HRegion(506): Instantiated testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.
        2014-08-21 22:46:47,443 DEBUG [PRI IPC Server handler 1 on 60875] zookeeper.ZKAssign(757): regionserver:60875-0x147fc404e830003 Attempting to transition node a8edbdfb2e9b02881ebc1702752b2372 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,449 DEBUG [PRI IPC Server handler 3 on 56883] zookeeper.ZKAssign(820): regionserver:56883-0x147fc404e830002 Successfully transitioned node 1eeb1332ce0a2f3b96882b0ec1572dc5 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,449 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214 and set watcher; region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,54158,1408686379607, state=RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,449 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] regionserver.HRegion(4413): Opening region: {NAME => 'testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.', STARTKEY => 'A', ENDKEY => 'B', ENCODED => 1eeb1332ce0a2f3b96882b0ec1572dc5,}
        2014-08-21 22:46:47,450 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_OPENING, server=p0420.sjc.cloudera.com,54158,1408686379607, region=c425f751446d62d8f4a9d9f5d8811214
        2014-08-21 22:46:47,449 INFO  [PRI IPC Server handler 3 on 56883] regionserver.HRegionServer(3056): Received request to open region: testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.
        2014-08-21 22:46:47,449 DEBUG [PRI IPC Server handler 1 on 60875] zookeeper.ZKUtil(1599): regionserver:60875-0x147fc404e830003 Retrieved 133 byte(s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372; data=region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_OFFLINE
        2014-08-21 22:46:47,450 DEBUG [PRI IPC Server handler 3 on 56883] zookeeper.ZKAssign(757): regionserver:56883-0x147fc404e830002 Attempting to transition node 1644a212531c3b43dde748d401c7e212 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,450 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5
        2014-08-21 22:46:47,450 INFO  [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] regionserver.HRegion(512): Setting up tabledescriptor config now ...
        2014-08-21 22:46:47,451 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] regionserver.HRegion(506): Instantiated testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.
        2014-08-21 22:46:47,477 INFO  [StoreOpenerThread-testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.-1] regionserver.Store(227): time to purge deletes set to 0ms in store fam
        2014-08-21 22:46:47,478 INFO  [StoreOpenerThread-testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.-1] regionserver.Store(237): hbase.hstore.compaction.min = 3
        2014-08-21 22:46:47,482 INFO  [RS_OPEN_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] regionserver.HRegion(667): Onlined testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.; next sequenceid=1
        2014-08-21 22:46:47,482 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] zookeeper.ZKAssign(757): regionserver:54158-0x147fc404e830001 Attempting to transition node c425f751446d62d8f4a9d9f5d8811214 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,487 DEBUG [PRI IPC Server handler 1 on 60875] zookeeper.ZKAssign(820): regionserver:60875-0x147fc404e830003 Successfully transitioned node a8edbdfb2e9b02881ebc1702752b2372 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,488 DEBUG [PRI IPC Server handler 3 on 56883] zookeeper.ZKUtil(1599): regionserver:56883-0x147fc404e830002 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212; data=region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_OFFLINE
        2014-08-21 22:46:47,488 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] zookeeper.ZKUtil(1599): regionserver:54158-0x147fc404e830001 Retrieved 134 byte(s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214; data=region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,54158,1408686379607, state=RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,488 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] regionserver.HRegion(4413): Opening region: {NAME => 'testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.', STARTKEY => '', ENDKEY => 'A', ENCODED => a8edbdfb2e9b02881ebc1702752b2372,}
        2014-08-21 22:46:47,488 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-StartupBulkAssigner-2] master.AssignmentManager(1525): Bulk assigning done for p0420.sjc.cloudera.com,60875,1408686379690
        2014-08-21 22:46:47,488 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5 and set watcher; region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,489 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_OPENING, server=p0420.sjc.cloudera.com,56883,1408686379653, region=1eeb1332ce0a2f3b96882b0ec1572dc5
        2014-08-21 22:46:47,489 INFO  [RS_OPEN_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] regionserver.HRegion(512): Setting up tabledescriptor config now ...
        2014-08-21 22:46:47,489 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372
        2014-08-21 22:46:47,489 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] regionserver.HRegion(506): Instantiated testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.
        2014-08-21 22:46:47,507 DEBUG [PRI IPC Server handler 3 on 56883] zookeeper.ZKAssign(820): regionserver:56883-0x147fc404e830002 Successfully transitioned node 1644a212531c3b43dde748d401c7e212 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,508 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-StartupBulkAssigner-1] master.AssignmentManager(1525): Bulk assigning done for p0420.sjc.cloudera.com,56883,1408686379653
        2014-08-21 22:46:47,508 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] regionserver.HRegion(4413): Opening region: {NAME => 'testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.', STARTKEY => 'B', ENDKEY => 'C', ENCODED => 1644a212531c3b43dde748d401c7e212,}
        2014-08-21 22:46:47,509 INFO  [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] regionserver.HRegion(512): Setting up tabledescriptor config now ...
        2014-08-21 22:46:47,510 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] regionserver.HRegion(506): Instantiated testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.
        2014-08-21 22:46:47,516 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] zookeeper.ZKAssign(820): regionserver:54158-0x147fc404e830001 Successfully transitioned node c425f751446d62d8f4a9d9f5d8811214 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,516 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 133 byte(s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372 and set watcher; region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,60875,1408686379690, state=RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,516 INFO  [PostOpenDeployTasks:c425f751446d62d8f4a9d9f5d8811214] regionserver.HRegionServer(1849): Post open deploy tasks for region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., daughter=false
        2014-08-21 22:46:47,516 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_OPENING, server=p0420.sjc.cloudera.com,60875,1408686379690, region=a8edbdfb2e9b02881ebc1702752b2372
        2014-08-21 22:46:47,517 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/1644a212531c3b43dde748d401c7e212
        2014-08-21 22:46:47,517 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212 and set watcher; region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,518 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_OPENING, server=p0420.sjc.cloudera.com,56883,1408686379653, region=1644a212531c3b43dde748d401c7e212
        2014-08-21 22:46:47,518 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214
        2014-08-21 22:46:47,518 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214 and set watcher; region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,54158,1408686379607, state=RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,519 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_OPENING, server=p0420.sjc.cloudera.com,54158,1408686379607, region=c425f751446d62d8f4a9d9f5d8811214
        2014-08-21 22:46:47,520 INFO  [PostOpenDeployTasks:c425f751446d62d8f4a9d9f5d8811214] catalog.MetaEditor(297): Updated row testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. with server=p0420.sjc.cloudera.com,54158,1408686379607
        2014-08-21 22:46:47,521 INFO  [PostOpenDeployTasks:c425f751446d62d8f4a9d9f5d8811214] regionserver.HRegionServer(1874): Done with post open deploy task for region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., daughter=false
        2014-08-21 22:46:47,525 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] zookeeper.ZKAssign(757): regionserver:54158-0x147fc404e830001 Attempting to transition node c425f751446d62d8f4a9d9f5d8811214 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED
        2014-08-21 22:46:47,526 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] zookeeper.ZKUtil(1599): regionserver:54158-0x147fc404e830001 Retrieved 134 byte(s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214; data=region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,54158,1408686379607, state=RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,527 INFO  [StoreOpenerThread-testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.-1] regionserver.Store(227): time to purge deletes set to 0ms in store fam
        2014-08-21 22:46:47,527 INFO  [StoreOpenerThread-testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.-1] regionserver.Store(237): hbase.hstore.compaction.min = 3
        2014-08-21 22:46:47,532 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] zookeeper.ZKAssign(820): regionserver:54158-0x147fc404e830001 Successfully transitioned node c425f751446d62d8f4a9d9f5d8811214 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED
        2014-08-21 22:46:47,532 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214
        2014-08-21 22:46:47,533 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] handler.OpenRegionHandler(287): region transitioned to opened in zookeeper: {NAME => 'testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.', STARTKEY => 'C', ENDKEY => '', ENCODED => c425f751446d62d8f4a9d9f5d8811214,}, server: p0420.sjc.cloudera.com,54158,1408686379607
        2014-08-21 22:46:47,533 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] handler.OpenRegionHandler(138): Opened testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. on server:p0420.sjc.cloudera.com,54158,1408686379607
        2014-08-21 22:46:47,534 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214 and set watcher; region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,54158,1408686379607, state=RS_ZK_REGION_OPENED
        2014-08-21 22:46:47,534 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_OPENED, server=p0420.sjc.cloudera.com,54158,1408686379607, region=c425f751446d62d8f4a9d9f5d8811214
        2014-08-21 22:46:47,534 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.OpenedRegionHandler(147): Handling OPENED event for testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. from p0420.sjc.cloudera.com,54158,1408686379607; deleting unassigned node
        2014-08-21 22:46:47,534 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-0] zookeeper.ZKAssign(483): master:37883-0x147fc404e830000 Deleting existing unassigned node for c425f751446d62d8f4a9d9f5d8811214 that is in expected state RS_ZK_REGION_OPENED
        2014-08-21 22:46:47,535 INFO  [StoreOpenerThread-testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.-1] regionserver.Store(227): time to purge deletes set to 0ms in store fam
        2014-08-21 22:46:47,535 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-0] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214; data=region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,54158,1408686379607, state=RS_ZK_REGION_OPENED
        2014-08-21 22:46:47,536 INFO  [StoreOpenerThread-testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.-1] regionserver.Store(237): hbase.hstore.compaction.min = 3
        2014-08-21 22:46:47,540 INFO  [RS_OPEN_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] regionserver.HRegion(667): Onlined testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.; next sequenceid=1
        2014-08-21 22:46:47,540 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] zookeeper.ZKAssign(757): regionserver:60875-0x147fc404e830003 Attempting to transition node a8edbdfb2e9b02881ebc1702752b2372 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,549 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214
        2014-08-21 22:46:47,549 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-0] zookeeper.ZKAssign(512): master:37883-0x147fc404e830000 Successfully deleted unassigned node for region c425f751446d62d8f4a9d9f5d8811214 in expected state RS_ZK_REGION_OPENED
        2014-08-21 22:46:47,549 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] zookeeper.ZKUtil(1599): regionserver:60875-0x147fc404e830003 Retrieved 133 byte(s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372; data=region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,60875,1408686379690, state=RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,549 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(1176): The znode of region testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. has been deleted.
        2014-08-21 22:46:47,550 INFO  [pool-1-thread-1-EventThread] master.AssignmentManager(1188): The master has opened the region testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. that was online on p0420.sjc.cloudera.com,54158,1408686379607
        2014-08-21 22:46:47,550 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/unassigned
        2014-08-21 22:46:47,557 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] zookeeper.ZKAssign(820): regionserver:60875-0x147fc404e830003 Successfully transitioned node a8edbdfb2e9b02881ebc1702752b2372 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,558 INFO  [PostOpenDeployTasks:a8edbdfb2e9b02881ebc1702752b2372] regionserver.HRegionServer(1849): Post open deploy tasks for region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., daughter=false
        2014-08-21 22:46:47,558 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212 and set watcher; region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,559 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 133 byte(s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372 and set watcher; region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,60875,1408686379690, state=RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,560 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5 and set watcher; region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,560 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372
        2014-08-21 22:46:47,561 INFO  [StoreOpenerThread-testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.-1] regionserver.Store(227): time to purge deletes set to 0ms in store fam
        2014-08-21 22:46:47,561 INFO  [StoreOpenerThread-testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.-1] regionserver.Store(237): hbase.hstore.compaction.min = 3
        2014-08-21 22:46:47,561 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 133 byte(s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372 and set watcher; region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,60875,1408686379690, state=RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,562 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_OPENING, server=p0420.sjc.cloudera.com,60875,1408686379690, region=a8edbdfb2e9b02881ebc1702752b2372
        2014-08-21 22:46:47,562 INFO  [PostOpenDeployTasks:a8edbdfb2e9b02881ebc1702752b2372] catalog.MetaEditor(297): Updated row testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. with server=p0420.sjc.cloudera.com,60875,1408686379690
        2014-08-21 22:46:47,562 INFO  [PostOpenDeployTasks:a8edbdfb2e9b02881ebc1702752b2372] regionserver.HRegionServer(1874): Done with post open deploy task for region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., daughter=false
        2014-08-21 22:46:47,562 INFO  [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] regionserver.HRegion(667): Onlined testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.; next sequenceid=1
        2014-08-21 22:46:47,562 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] zookeeper.ZKAssign(757): regionserver:60875-0x147fc404e830003 Attempting to transition node a8edbdfb2e9b02881ebc1702752b2372 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED
        2014-08-21 22:46:47,563 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] zookeeper.ZKAssign(757): regionserver:56883-0x147fc404e830002 Attempting to transition node 1eeb1332ce0a2f3b96882b0ec1572dc5 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,564 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] zookeeper.ZKUtil(1599): regionserver:60875-0x147fc404e830003 Retrieved 133 byte(s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372; data=region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,60875,1408686379690, state=RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,565 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] zookeeper.ZKUtil(1599): regionserver:56883-0x147fc404e830002 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5; data=region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,565 INFO  [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] regionserver.HRegion(667): Onlined testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.; next sequenceid=1
        2014-08-21 22:46:47,565 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] zookeeper.ZKAssign(757): regionserver:56883-0x147fc404e830002 Attempting to transition node 1644a212531c3b43dde748d401c7e212 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,574 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372
        2014-08-21 22:46:47,574 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] zookeeper.ZKAssign(820): regionserver:60875-0x147fc404e830003 Successfully transitioned node a8edbdfb2e9b02881ebc1702752b2372 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED
        2014-08-21 22:46:47,574 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] handler.OpenRegionHandler(287): region transitioned to opened in zookeeper: {NAME => 'testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.', STARTKEY => '', ENDKEY => 'A', ENCODED => a8edbdfb2e9b02881ebc1702752b2372,}, server: p0420.sjc.cloudera.com,60875,1408686379690
        2014-08-21 22:46:47,575 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] handler.OpenRegionHandler(138): Opened testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. on server:p0420.sjc.cloudera.com,60875,1408686379690
        2014-08-21 22:46:47,608 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 133 byte(s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372 and set watcher; region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,60875,1408686379690, state=RS_ZK_REGION_OPENED
        2014-08-21 22:46:47,608 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] zookeeper.ZKAssign(820): regionserver:56883-0x147fc404e830002 Successfully transitioned node 1eeb1332ce0a2f3b96882b0ec1572dc5 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,608 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_OPENED, server=p0420.sjc.cloudera.com,60875,1408686379690, region=a8edbdfb2e9b02881ebc1702752b2372
        2014-08-21 22:46:47,608 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] zookeeper.ZKUtil(1599): regionserver:56883-0x147fc404e830002 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212; data=region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,608 INFO  [PostOpenDeployTasks:1eeb1332ce0a2f3b96882b0ec1572dc5] regionserver.HRegionServer(1849): Post open deploy tasks for region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., daughter=false
        2014-08-21 22:46:47,608 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-1] handler.OpenedRegionHandler(147): Handling OPENED event for testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. from p0420.sjc.cloudera.com,60875,1408686379690; deleting unassigned node
        2014-08-21 22:46:47,608 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5
        2014-08-21 22:46:47,609 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-1] zookeeper.ZKAssign(483): master:37883-0x147fc404e830000 Deleting existing unassigned node for a8edbdfb2e9b02881ebc1702752b2372 that is in expected state RS_ZK_REGION_OPENED
        2014-08-21 22:46:47,612 INFO  [PostOpenDeployTasks:1eeb1332ce0a2f3b96882b0ec1572dc5] catalog.MetaEditor(297): Updated row testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. with server=p0420.sjc.cloudera.com,56883,1408686379653
        2014-08-21 22:46:47,612 INFO  [PostOpenDeployTasks:1eeb1332ce0a2f3b96882b0ec1572dc5] regionserver.HRegionServer(1874): Done with post open deploy task for region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., daughter=false
        2014-08-21 22:46:47,612 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] zookeeper.ZKAssign(757): regionserver:56883-0x147fc404e830002 Attempting to transition node 1eeb1332ce0a2f3b96882b0ec1572dc5 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED
        2014-08-21 22:46:47,616 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] zookeeper.ZKAssign(820): regionserver:56883-0x147fc404e830002 Successfully transitioned node 1644a212531c3b43dde748d401c7e212 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,616 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5 and set watcher; region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,616 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] zookeeper.ZKUtil(1599): regionserver:56883-0x147fc404e830002 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5; data=region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,616 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_OPENING, server=p0420.sjc.cloudera.com,56883,1408686379653, region=1eeb1332ce0a2f3b96882b0ec1572dc5
        2014-08-21 22:46:47,616 INFO  [PostOpenDeployTasks:1644a212531c3b43dde748d401c7e212] regionserver.HRegionServer(1849): Post open deploy tasks for region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., daughter=false
        2014-08-21 22:46:47,616 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-1] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 133 byte(s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372; data=region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,60875,1408686379690, state=RS_ZK_REGION_OPENED
        2014-08-21 22:46:47,617 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/1644a212531c3b43dde748d401c7e212
        2014-08-21 22:46:47,620 INFO  [PostOpenDeployTasks:1644a212531c3b43dde748d401c7e212] catalog.MetaEditor(297): Updated row testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. with server=p0420.sjc.cloudera.com,56883,1408686379653
        2014-08-21 22:46:47,620 INFO  [PostOpenDeployTasks:1644a212531c3b43dde748d401c7e212] regionserver.HRegionServer(1874): Done with post open deploy task for region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., daughter=false
        2014-08-21 22:46:47,621 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] zookeeper.ZKAssign(757): regionserver:56883-0x147fc404e830002 Attempting to transition node 1644a212531c3b43dde748d401c7e212 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED
        2014-08-21 22:46:47,624 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] zookeeper.ZKAssign(820): regionserver:56883-0x147fc404e830002 Successfully transitioned node 1eeb1332ce0a2f3b96882b0ec1572dc5 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED
        2014-08-21 22:46:47,624 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] handler.OpenRegionHandler(287): region transitioned to opened in zookeeper: {NAME => 'testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.', STARTKEY => 'A', ENDKEY => 'B', ENCODED => 1eeb1332ce0a2f3b96882b0ec1572dc5,}, server: p0420.sjc.cloudera.com,56883,1408686379653
        2014-08-21 22:46:47,624 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] handler.OpenRegionHandler(138): Opened testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. on server:p0420.sjc.cloudera.com,56883,1408686379653
        2014-08-21 22:46:47,632 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-1] zookeeper.ZKAssign(512): master:37883-0x147fc404e830000 Successfully deleted unassigned node for region a8edbdfb2e9b02881ebc1702752b2372 in expected state RS_ZK_REGION_OPENED
        2014-08-21 22:46:47,633 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212 and set watcher; region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,633 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] zookeeper.ZKUtil(1599): regionserver:56883-0x147fc404e830002 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212; data=region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENING
        2014-08-21 22:46:47,633 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_OPENING, server=p0420.sjc.cloudera.com,56883,1408686379653, region=1644a212531c3b43dde748d401c7e212
        2014-08-21 22:46:47,633 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5
        2014-08-21 22:46:47,641 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] zookeeper.ZKAssign(820): regionserver:56883-0x147fc404e830002 Successfully transitioned node 1644a212531c3b43dde748d401c7e212 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED
        2014-08-21 22:46:47,641 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5 and set watcher; region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENED
        2014-08-21 22:46:47,641 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] handler.OpenRegionHandler(287): region transitioned to opened in zookeeper: {NAME => 'testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.', STARTKEY => 'B', ENDKEY => 'C', ENCODED => 1644a212531c3b43dde748d401c7e212,}, server: p0420.sjc.cloudera.com,56883,1408686379653
        2014-08-21 22:46:47,641 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_OPENED, server=p0420.sjc.cloudera.com,56883,1408686379653, region=1eeb1332ce0a2f3b96882b0ec1572dc5
        2014-08-21 22:46:47,641 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] handler.OpenRegionHandler(138): Opened testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. on server:p0420.sjc.cloudera.com,56883,1408686379653
        2014-08-21 22:46:47,641 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372
        2014-08-21 22:46:47,641 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-2] handler.OpenedRegionHandler(147): Handling OPENED event for testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. from p0420.sjc.cloudera.com,56883,1408686379653; deleting unassigned node
        2014-08-21 22:46:47,642 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(1176): The znode of region testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. has been deleted.
        2014-08-21 22:46:47,642 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-2] zookeeper.ZKAssign(483): master:37883-0x147fc404e830000 Deleting existing unassigned node for 1eeb1332ce0a2f3b96882b0ec1572dc5 that is in expected state RS_ZK_REGION_OPENED
        2014-08-21 22:46:47,642 INFO  [pool-1-thread-1-EventThread] master.AssignmentManager(1188): The master has opened the region testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. that was online on p0420.sjc.cloudera.com,60875,1408686379690
        2014-08-21 22:46:47,642 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/unassigned
        2014-08-21 22:46:47,644 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-2] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5; data=region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENED
        2014-08-21 22:46:47,644 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212 and set watcher; region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENED
        2014-08-21 22:46:47,649 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-2] zookeeper.ZKAssign(512): master:37883-0x147fc404e830000 Successfully deleted unassigned node for region 1eeb1332ce0a2f3b96882b0ec1572dc5 in expected state RS_ZK_REGION_OPENED
        2014-08-21 22:46:47,649 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(713): master:37883-0x147fc404e830000 Unable to get data of znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5 because node does not exist (not an error)
        2014-08-21 22:46:47,650 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/1644a212531c3b43dde748d401c7e212
        2014-08-21 22:46:47,650 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212 and set watcher; region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENED
        2014-08-21 22:46:47,650 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_OPENED, server=p0420.sjc.cloudera.com,56883,1408686379653, region=1644a212531c3b43dde748d401c7e212
        2014-08-21 22:46:47,651 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5
        2014-08-21 22:46:47,651 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-3] handler.OpenedRegionHandler(147): Handling OPENED event for testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. from p0420.sjc.cloudera.com,56883,1408686379653; deleting unassigned node
        2014-08-21 22:46:47,651 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(1176): The znode of region testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. has been deleted.
        2014-08-21 22:46:47,651 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-3] zookeeper.ZKAssign(483): master:37883-0x147fc404e830000 Deleting existing unassigned node for 1644a212531c3b43dde748d401c7e212 that is in expected state RS_ZK_REGION_OPENED
        2014-08-21 22:46:47,651 INFO  [pool-1-thread-1-EventThread] master.AssignmentManager(1188): The master has opened the region testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. that was online on p0420.sjc.cloudera.com,56883,1408686379653
        2014-08-21 22:46:47,651 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/unassigned
        2014-08-21 22:46:47,652 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-3] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212; data=region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENED
        2014-08-21 22:46:47,657 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-3] zookeeper.ZKAssign(512): master:37883-0x147fc404e830000 Successfully deleted unassigned node for region 1644a212531c3b43dde748d401c7e212 in expected state RS_ZK_REGION_OPENED
        2014-08-21 22:46:47,658 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(713): master:37883-0x147fc404e830000 Unable to get data of znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212 because node does not exist (not an error)
        2014-08-21 22:46:47,658 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/unassigned/1644a212531c3b43dde748d401c7e212
        2014-08-21 22:46:47,658 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(1176): The znode of region testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. has been deleted.
        2014-08-21 22:46:47,658 INFO  [pool-1-thread-1-EventThread] master.AssignmentManager(1188): The master has opened the region testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. that was online on p0420.sjc.cloudera.com,56883,1408686379653
        2014-08-21 22:46:47,658 INFO  [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] master.AssignmentManager(2418): Bulk assigning done
        2014-08-21 22:46:47,658 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/unassigned
        2014-08-21 22:46:47,763 DEBUG [Thread-609] client.MetaScanner(182): Scanning .META. starting at row=testQuarantineMissingHFile,,00000000000000 for max=2147483647 rows using org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033
        2014-08-21 22:46:47,768 DEBUG [Thread-609] zookeeper.ZKUtil(120): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 opening connection to ZooKeeper with ensemble (localhost:63891)
        2014-08-21 22:46:47,770 INFO  [Thread-609] zookeeper.RecoverableZooKeeper(104): The identifier of this process is 10184@p0420.sjc.cloudera.com
        2014-08-21 22:46:47,771 DEBUG [Thread-609] catalog.CatalogTracker(210): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@799aae6a
        2014-08-21 22:46:47,774 DEBUG [Thread-609-EventThread] zookeeper.ZooKeeperWatcher(294): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Received ZooKeeper Event, type=None, state=SyncConnected, path=null
        2014-08-21 22:46:47,775 DEBUG [Thread-609] zookeeper.ZKUtil(423): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Set watcher on existing znode /hbase/root-region-server
        2014-08-21 22:46:47,775 DEBUG [Thread-609] zookeeper.ZKUtil(1599): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Retrieved 42 byte(s) of data from znode /hbase/root-region-server and set watcher; p0420.sjc.cloudera.com,60875,...
        2014-08-21 22:46:47,775 DEBUG [Thread-609-EventThread] zookeeper.ZooKeeperWatcher(371): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830020 connected
        2014-08-21 22:46:47,776 DEBUG [Thread-609] zookeeper.ZKUtil(425): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830020 /hbase/unassigned/1028785192 does not exist. Watcher is set.
        2014-08-21 22:46:47,776 DEBUG [Thread-609] client.ClientScanner(90): Creating scanner over .META. starting at key 'testQuarantineMissingHFile,,'
        2014-08-21 22:46:47,777 DEBUG [Thread-609] client.ClientScanner(203): Advancing internal scanner to startKey at 'testQuarantineMissingHFile,,'
        2014-08-21 22:46:47,779 DEBUG [Thread-609] catalog.CatalogTracker(227): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@799aae6a
        2014-08-21 22:46:47,784 DEBUG [Thread-609] zookeeper.ZKUtil(658): hconnection-0x147fc404e830007 Unable to get data of znode /hbase/table/testQuarantineMissingHFile because node does not exist (not an error)
        2014-08-21 22:46:47,786 DEBUG [Thread-609] client.MetaScanner(182): Scanning .META. starting at row=testQuarantineMissingHFile,,00000000000000 for max=10 rows using org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033
        2014-08-21 22:46:47,789 DEBUG [Thread-609] client.HConnectionManager$HConnectionImplementation(1404): Cached location for testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. is p0420.sjc.cloudera.com:60875
        2014-08-21 22:46:47,789 DEBUG [Thread-609] client.HConnectionManager$HConnectionImplementation(1404): Cached location for testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. is p0420.sjc.cloudera.com:56883
        2014-08-21 22:46:47,789 DEBUG [Thread-609] client.HConnectionManager$HConnectionImplementation(1404): Cached location for testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. is p0420.sjc.cloudera.com:56883
        2014-08-21 22:46:47,790 DEBUG [Thread-609] client.HConnectionManager$HConnectionImplementation(1404): Cached location for testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. is p0420.sjc.cloudera.com:54158
        2014-08-21 22:46:47,798 DEBUG [Thread-609] zookeeper.ZKUtil(120): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 opening connection to ZooKeeper with ensemble (localhost:63891)
        2014-08-21 22:46:47,801 INFO  [Thread-609] zookeeper.RecoverableZooKeeper(104): The identifier of this process is 10184@p0420.sjc.cloudera.com
        2014-08-21 22:46:47,801 DEBUG [Thread-609] catalog.CatalogTracker(210): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@615ece16
        2014-08-21 22:46:47,808 DEBUG [Thread-609-EventThread] zookeeper.ZooKeeperWatcher(294): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Received ZooKeeper Event, type=None, state=SyncConnected, path=null
        2014-08-21 22:46:47,809 DEBUG [Thread-609-EventThread] zookeeper.ZooKeeperWatcher(371): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830021 connected
        2014-08-21 22:46:47,809 DEBUG [Thread-609] zookeeper.ZKUtil(423): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830021 Set watcher on existing znode /hbase/root-region-server
        2014-08-21 22:46:47,810 DEBUG [Thread-609] zookeeper.ZKUtil(1599): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830021 Retrieved 42 byte(s) of data from znode /hbase/root-region-server and set watcher; p0420.sjc.cloudera.com,60875,...
        2014-08-21 22:46:47,811 DEBUG [Thread-609] zookeeper.ZKUtil(425): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830021 /hbase/unassigned/1028785192 does not exist. Watcher is set.
        2014-08-21 22:46:47,811 DEBUG [Thread-609] client.ClientScanner(90): Creating scanner over .META. starting at key 'testQuarantineMissingHFile,,'
        2014-08-21 22:46:47,811 DEBUG [Thread-609] client.ClientScanner(203): Advancing internal scanner to startKey at 'testQuarantineMissingHFile,,'
        2014-08-21 22:46:47,814 DEBUG [Thread-609] catalog.CatalogTracker(227): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@615ece16
        2014-08-21 22:46:47,827 DEBUG [Thread-609] zookeeper.ZKUtil(658): hconnection-0x147fc404e830007 Unable to get data of znode /hbase/table/testQuarantineMissingHFile because node does not exist (not an error)
        2014-08-21 22:46:47,827 DEBUG [Thread-609] client.ClientScanner(90): Creating scanner over testQuarantineMissingHFile starting at key ''
        2014-08-21 22:46:47,827 DEBUG [Thread-609] client.ClientScanner(203): Advancing internal scanner to startKey at ''
        2014-08-21 22:46:47,831 DEBUG [Thread-609] client.ClientScanner(196): Finished with region {NAME => 'testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.', STARTKEY => '', ENDKEY => 'A', ENCODED => a8edbdfb2e9b02881ebc1702752b2372,}
        2014-08-21 22:46:47,832 DEBUG [Thread-609] client.ClientScanner(203): Advancing internal scanner to startKey at 'A'
        2014-08-21 22:46:47,835 DEBUG [Thread-609] client.ClientScanner(196): Finished with region {NAME => 'testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.', STARTKEY => 'A', ENDKEY => 'B', ENCODED => 1eeb1332ce0a2f3b96882b0ec1572dc5,}
        2014-08-21 22:46:47,836 DEBUG [Thread-609] client.ClientScanner(203): Advancing internal scanner to startKey at 'B'
        2014-08-21 22:46:47,840 DEBUG [Thread-609] client.ClientScanner(196): Finished with region {NAME => 'testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.', STARTKEY => 'B', ENDKEY => 'C', ENCODED => 1644a212531c3b43dde748d401c7e212,}
        2014-08-21 22:46:47,840 DEBUG [Thread-609] client.ClientScanner(203): Advancing internal scanner to startKey at 'C'
        2014-08-21 22:46:47,844 DEBUG [Thread-609] client.ClientScanner(190): Finished with scanning at {NAME => 'testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.', STARTKEY => 'C', ENDKEY => '', ENCODED => c425f751446d62d8f4a9d9f5d8811214,}
        2014-08-21 22:46:47,845 DEBUG [Thread-609] zookeeper.ZKUtil(120): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 opening connection to ZooKeeper with ensemble (localhost:63891)
        2014-08-21 22:46:47,848 INFO  [Thread-609] zookeeper.RecoverableZooKeeper(104): The identifier of this process is 10184@p0420.sjc.cloudera.com
        2014-08-21 22:46:47,848 DEBUG [Thread-609] catalog.CatalogTracker(210): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@42081f25
        2014-08-21 22:46:47,858 DEBUG [Thread-609-EventThread] zookeeper.ZooKeeperWatcher(294): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Received ZooKeeper Event, type=None, state=SyncConnected, path=null
        2014-08-21 22:46:47,858 DEBUG [Thread-609] zookeeper.ZKUtil(423): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Set watcher on existing znode /hbase/root-region-server
        2014-08-21 22:46:47,859 DEBUG [Thread-609] zookeeper.ZKUtil(1599): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Retrieved 42 byte(s) of data from znode /hbase/root-region-server and set watcher; p0420.sjc.cloudera.com,60875,...
        2014-08-21 22:46:47,859 DEBUG [Thread-609-EventThread] zookeeper.ZooKeeperWatcher(371): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830022 connected
        2014-08-21 22:46:47,859 DEBUG [Thread-609] zookeeper.ZKUtil(425): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830022 /hbase/unassigned/1028785192 does not exist. Watcher is set.
        2014-08-21 22:46:47,862 DEBUG [Thread-609] client.MetaScanner(182): Scanning .META. starting at row= for max=2147483647 rows using org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033
        2014-08-21 22:46:47,871 DEBUG [Thread-609] client.ClientScanner(90): Creating scanner over .META. starting at key 'testQuarantineMissingHFile,,'
        2014-08-21 22:46:47,871 DEBUG [Thread-609] client.ClientScanner(203): Advancing internal scanner to startKey at 'testQuarantineMissingHFile,,'
        2014-08-21 22:46:47,874 DEBUG [Thread-609] client.ClientScanner(90): Creating scanner over .META. starting at key 'testQuarantineMissingHFile,,'
        2014-08-21 22:46:47,875 DEBUG [Thread-609] client.ClientScanner(203): Advancing internal scanner to startKey at 'testQuarantineMissingHFile,,'
        2014-08-21 22:46:47,881 DEBUG [Thread-609] client.ClientScanner(190): Finished with scanning at {NAME => '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED => 1028785192,}
        2014-08-21 22:46:47,882 INFO  [PRI IPC Server handler 7 on 60875] regionserver.HRegionServer(3307): Flushing testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.
        2014-08-21 22:46:47,883 DEBUG [PRI IPC Server handler 7 on 60875] regionserver.HRegion(1605): Started memstore flush for testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., current region memstore size 320
        2014-08-21 22:46:47,883 DEBUG [PRI IPC Server handler 7 on 60875] regionserver.HRegion(1655): Finished snapshotting testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., syncing WAL and waiting on mvcc, flushsize=320
        2014-08-21 22:46:47,884 DEBUG [PRI IPC Server handler 7 on 60875] regionserver.HRegion(1671): Finished snapshotting, commencing flushing stores
        2014-08-21 22:46:47,895 DEBUG [PRI IPC Server handler 7 on 60875] util.FSUtils(157): Creating file=hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/.tmp/231f0c27ede84a77a6e0a64aeb8887ce with permission=rwxrwxrwx
        2014-08-21 22:46:47,904 DEBUG [PRI IPC Server handler 7 on 60875] hfile.HFileWriterV2(149): Initialized with CacheConfig:enabled [cacheDataOnRead=true] [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false]
        2014-08-21 22:46:47,905 INFO  [PRI IPC Server handler 7 on 60875] regionserver.StoreFile$Writer(1095): Delete Family Bloom filter type for hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/.tmp/231f0c27ede84a77a6e0a64aeb8887ce: CompoundBloomFilterWriter
        2014-08-21 22:46:47,915 INFO  [IPC Server handler 6 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40206 is added to blk_-6303039399968837419_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:40670|RBW], ReplicaUnderConstruction[127.0.0.1:34823|RBW], ReplicaUnderConstruction[127.0.0.1:40206|RBW]]} size 0
        2014-08-21 22:46:47,916 INFO  [IPC Server handler 1 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34823 is added to blk_-6303039399968837419_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:40670|RBW], ReplicaUnderConstruction[127.0.0.1:34823|RBW], ReplicaUnderConstruction[127.0.0.1:40206|RBW]]} size 0
        2014-08-21 22:46:47,917 INFO  [IPC Server handler 9 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40670 is added to blk_-6303039399968837419_1096 size 722
        2014-08-21 22:46:47,927 INFO  [PRI IPC Server handler 7 on 60875] regionserver.StoreFile$Writer(1315): NO General Bloom and NO DeleteFamily was added to HFile (hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/.tmp/231f0c27ede84a77a6e0a64aeb8887ce) 
        2014-08-21 22:46:47,927 INFO  [PRI IPC Server handler 7 on 60875] regionserver.Store(925): Flushed , sequenceid=48, memsize=320, into tmp file hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/.tmp/231f0c27ede84a77a6e0a64aeb8887ce
        2014-08-21 22:46:47,938 DEBUG [PRI IPC Server handler 7 on 60875] regionserver.Store(949): Renaming flushed file at hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/.tmp/231f0c27ede84a77a6e0a64aeb8887ce to hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/fam/231f0c27ede84a77a6e0a64aeb8887ce
        2014-08-21 22:46:47,963 INFO  [PRI IPC Server handler 7 on 60875] regionserver.Store(972): Added hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/fam/231f0c27ede84a77a6e0a64aeb8887ce, entries=2, sequenceid=48, filesize=722
        2014-08-21 22:46:47,965 INFO  [PRI IPC Server handler 7 on 60875] regionserver.HRegion(1745): Finished memstore flush of ~320/320, currentsize=0/0 for region testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. in 82ms, sequenceid=48, compaction requested=false
        2014-08-21 22:46:47,966 INFO  [PRI IPC Server handler 4 on 56883] regionserver.HRegionServer(3307): Flushing testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.
        2014-08-21 22:46:47,969 DEBUG [PRI IPC Server handler 4 on 56883] regionserver.HRegion(1605): Started memstore flush for testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., current region memstore size 320
        2014-08-21 22:46:47,970 DEBUG [PRI IPC Server handler 4 on 56883] regionserver.HRegion(1655): Finished snapshotting testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., syncing WAL and waiting on mvcc, flushsize=320
        2014-08-21 22:46:47,971 DEBUG [PRI IPC Server handler 4 on 56883] regionserver.HRegion(1671): Finished snapshotting, commencing flushing stores
        2014-08-21 22:46:47,995 DEBUG [PRI IPC Server handler 4 on 56883] util.FSUtils(157): Creating file=hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/.tmp/7cec52ed390b4af3a2a3b04be32b91ed with permission=rwxrwxrwx
        2014-08-21 22:46:48,019 DEBUG [PRI IPC Server handler 4 on 56883] hfile.HFileWriterV2(149): Initialized with CacheConfig:enabled [cacheDataOnRead=true] [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false]
        2014-08-21 22:46:48,020 INFO  [PRI IPC Server handler 4 on 56883] regionserver.StoreFile$Writer(1095): Delete Family Bloom filter type for hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/.tmp/7cec52ed390b4af3a2a3b04be32b91ed: CompoundBloomFilterWriter
        2014-08-21 22:46:48,033 INFO  [IPC Server handler 5 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40206 is added to blk_-7146604580806320095_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:34823|RBW], ReplicaUnderConstruction[127.0.0.1:40670|RBW], ReplicaUnderConstruction[127.0.0.1:40206|RBW]]} size 0
        2014-08-21 22:46:48,034 INFO  [IPC Server handler 8 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40670 is added to blk_-7146604580806320095_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:34823|RBW], ReplicaUnderConstruction[127.0.0.1:40670|RBW], ReplicaUnderConstruction[127.0.0.1:40206|RBW]]} size 0
        2014-08-21 22:46:48,035 INFO  [IPC Server handler 0 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34823 is added to blk_-7146604580806320095_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:34823|RBW], ReplicaUnderConstruction[127.0.0.1:40670|RBW], ReplicaUnderConstruction[127.0.0.1:40206|RBW]]} size 0
        2014-08-21 22:46:48,044 INFO  [PRI IPC Server handler 4 on 56883] regionserver.StoreFile$Writer(1315): NO General Bloom and NO DeleteFamily was added to HFile (hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/.tmp/7cec52ed390b4af3a2a3b04be32b91ed) 
        2014-08-21 22:46:48,044 INFO  [PRI IPC Server handler 4 on 56883] regionserver.Store(925): Flushed , sequenceid=15, memsize=320, into tmp file hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/.tmp/7cec52ed390b4af3a2a3b04be32b91ed
        2014-08-21 22:46:48,056 DEBUG [PRI IPC Server handler 4 on 56883] regionserver.Store(949): Renaming flushed file at hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/.tmp/7cec52ed390b4af3a2a3b04be32b91ed to hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/fam/7cec52ed390b4af3a2a3b04be32b91ed
        2014-08-21 22:46:48,079 INFO  [PRI IPC Server handler 4 on 56883] regionserver.Store(972): Added hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/fam/7cec52ed390b4af3a2a3b04be32b91ed, entries=2, sequenceid=15, filesize=722
        2014-08-21 22:46:48,081 INFO  [PRI IPC Server handler 4 on 56883] regionserver.HRegion(1745): Finished memstore flush of ~320/320, currentsize=0/0 for region testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. in 112ms, sequenceid=15, compaction requested=false
        2014-08-21 22:46:48,085 INFO  [PRI IPC Server handler 5 on 56883] regionserver.HRegionServer(3307): Flushing testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.
        2014-08-21 22:46:48,085 DEBUG [PRI IPC Server handler 5 on 56883] regionserver.HRegion(1605): Started memstore flush for testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., current region memstore size 320
        2014-08-21 22:46:48,086 DEBUG [PRI IPC Server handler 5 on 56883] regionserver.HRegion(1655): Finished snapshotting testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., syncing WAL and waiting on mvcc, flushsize=320
        2014-08-21 22:46:48,086 DEBUG [PRI IPC Server handler 5 on 56883] regionserver.HRegion(1671): Finished snapshotting, commencing flushing stores
        2014-08-21 22:46:48,120 DEBUG [PRI IPC Server handler 5 on 56883] util.FSUtils(157): Creating file=hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/.tmp/92484a47b8f14c338314b70c98ebc0dc with permission=rwxrwxrwx
        2014-08-21 22:46:48,128 DEBUG [PRI IPC Server handler 5 on 56883] hfile.HFileWriterV2(149): Initialized with CacheConfig:enabled [cacheDataOnRead=true] [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false]
        2014-08-21 22:46:48,128 INFO  [PRI IPC Server handler 5 on 56883] regionserver.StoreFile$Writer(1095): Delete Family Bloom filter type for hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/.tmp/92484a47b8f14c338314b70c98ebc0dc: CompoundBloomFilterWriter
        2014-08-21 22:46:48,140 INFO  [IPC Server handler 9 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40670 is added to blk_-8202252735549624962_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:40206|RBW], ReplicaUnderConstruction[127.0.0.1:34823|RBW], ReplicaUnderConstruction[127.0.0.1:40670|RBW]]} size 0
        2014-08-21 22:46:48,141 INFO  [IPC Server handler 7 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34823 is added to blk_-8202252735549624962_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:40206|RBW], ReplicaUnderConstruction[127.0.0.1:34823|RBW], ReplicaUnderConstruction[127.0.0.1:40670|RBW]]} size 0
        2014-08-21 22:46:48,141 INFO  [IPC Server handler 4 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40206 is added to blk_-8202252735549624962_1100 size 722
        2014-08-21 22:46:48,152 INFO  [PRI IPC Server handler 5 on 56883] regionserver.StoreFile$Writer(1315): NO General Bloom and NO DeleteFamily was added to HFile (hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/.tmp/92484a47b8f14c338314b70c98ebc0dc) 
        2014-08-21 22:46:48,152 INFO  [PRI IPC Server handler 5 on 56883] regionserver.Store(925): Flushed , sequenceid=16, memsize=320, into tmp file hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/.tmp/92484a47b8f14c338314b70c98ebc0dc
        2014-08-21 22:46:48,165 DEBUG [PRI IPC Server handler 5 on 56883] regionserver.Store(949): Renaming flushed file at hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/.tmp/92484a47b8f14c338314b70c98ebc0dc to hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/fam/92484a47b8f14c338314b70c98ebc0dc
        2014-08-21 22:46:48,188 INFO  [PRI IPC Server handler 5 on 56883] regionserver.Store(972): Added hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/fam/92484a47b8f14c338314b70c98ebc0dc, entries=2, sequenceid=16, filesize=722
        2014-08-21 22:46:48,190 INFO  [PRI IPC Server handler 5 on 56883] regionserver.HRegion(1745): Finished memstore flush of ~320/320, currentsize=0/0 for region testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. in 105ms, sequenceid=16, compaction requested=false
        2014-08-21 22:46:48,191 INFO  [PRI IPC Server handler 2 on 54158] regionserver.HRegionServer(3307): Flushing testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.
        2014-08-21 22:46:48,191 DEBUG [PRI IPC Server handler 2 on 54158] regionserver.HRegion(1605): Started memstore flush for testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., current region memstore size 320
        2014-08-21 22:46:48,192 DEBUG [PRI IPC Server handler 2 on 54158] regionserver.HRegion(1655): Finished snapshotting testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., syncing WAL and waiting on mvcc, flushsize=320
        2014-08-21 22:46:48,192 DEBUG [PRI IPC Server handler 2 on 54158] regionserver.HRegion(1671): Finished snapshotting, commencing flushing stores
        2014-08-21 22:46:48,203 DEBUG [PRI IPC Server handler 2 on 54158] util.FSUtils(157): Creating file=hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/.tmp/e81f27e4ffbf435cb38dca815be340e8 with permission=rwxrwxrwx
        2014-08-21 22:46:48,211 DEBUG [PRI IPC Server handler 2 on 54158] hfile.HFileWriterV2(149): Initialized with CacheConfig:enabled [cacheDataOnRead=true] [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false]
        2014-08-21 22:46:48,211 INFO  [PRI IPC Server handler 2 on 54158] regionserver.StoreFile$Writer(1095): Delete Family Bloom filter type for hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/.tmp/e81f27e4ffbf435cb38dca815be340e8: CompoundBloomFilterWriter
        2014-08-21 22:46:48,222 INFO  [IPC Server handler 2 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34823 is added to blk_8136300766489353090_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:40206|RBW], ReplicaUnderConstruction[127.0.0.1:40670|RBW], ReplicaUnderConstruction[127.0.0.1:34823|RBW]]} size 0
        2014-08-21 22:46:48,223 INFO  [IPC Server handler 6 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40670 is added to blk_8136300766489353090_1102 size 722
        2014-08-21 22:46:48,224 INFO  [IPC Server handler 1 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40206 is added to blk_8136300766489353090_1102 size 722
        2014-08-21 22:46:48,227 INFO  [PRI IPC Server handler 2 on 54158] regionserver.StoreFile$Writer(1315): NO General Bloom and NO DeleteFamily was added to HFile (hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/.tmp/e81f27e4ffbf435cb38dca815be340e8) 
        2014-08-21 22:46:48,227 INFO  [PRI IPC Server handler 2 on 54158] regionserver.Store(925): Flushed , sequenceid=15, memsize=320, into tmp file hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/.tmp/e81f27e4ffbf435cb38dca815be340e8
        2014-08-21 22:46:48,240 DEBUG [PRI IPC Server handler 2 on 54158] regionserver.Store(949): Renaming flushed file at hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/.tmp/e81f27e4ffbf435cb38dca815be340e8 to hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/fam/e81f27e4ffbf435cb38dca815be340e8
        2014-08-21 22:46:48,264 INFO  [PRI IPC Server handler 2 on 54158] regionserver.Store(972): Added hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/fam/e81f27e4ffbf435cb38dca815be340e8, entries=2, sequenceid=15, filesize=722
        2014-08-21 22:46:48,266 INFO  [PRI IPC Server handler 2 on 54158] regionserver.HRegion(1745): Finished memstore flush of ~320/320, currentsize=0/0 for region testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. in 75ms, sequenceid=15, compaction requested=false
        2014-08-21 22:46:48,267 DEBUG [Thread-609] catalog.CatalogTracker(227): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@42081f25
        2014-08-21 22:46:48,277 DEBUG [IPC Server handler 0 on 37883] client.ClientScanner(90): Creating scanner over .META. starting at key 'testQuarantineMissingHFile,,'
        2014-08-21 22:46:48,277 DEBUG [IPC Server handler 0 on 37883] client.ClientScanner(203): Advancing internal scanner to startKey at 'testQuarantineMissingHFile,,'
        2014-08-21 22:46:48,299 INFO  [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DisableTableHandler(97): Attemping to disable table testQuarantineMissingHFile
        2014-08-21 22:46:48,299 INFO  [Thread-609] client.HBaseAdmin(858): Started disable of testQuarantineMissingHFile
        2014-08-21 22:46:48,301 DEBUG [Thread-609] zookeeper.ZKUtil(120): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 opening connection to ZooKeeper with ensemble (localhost:63891)
        2014-08-21 22:46:48,303 INFO  [Thread-609] zookeeper.RecoverableZooKeeper(104): The identifier of this process is 10184@p0420.sjc.cloudera.com
        2014-08-21 22:46:48,303 DEBUG [Thread-609] catalog.CatalogTracker(210): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@b6a6597
        2014-08-21 22:46:48,330 INFO  [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DisableTableHandler(121): Offlining 4 regions.
        2014-08-21 22:46:48,331 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-0] master.AssignmentManager(2140): Starting unassignment of region testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. (offlining)
        2014-08-21 22:46:48,331 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-1] master.AssignmentManager(2140): Starting unassignment of region testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. (offlining)
        2014-08-21 22:46:48,331 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-2] master.AssignmentManager(2140): Starting unassignment of region testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. (offlining)
        2014-08-21 22:46:48,331 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-0] zookeeper.ZKAssign(561): master:37883-0x147fc404e830000 Creating unassigned node for a8edbdfb2e9b02881ebc1702752b2372 in a CLOSING state
        2014-08-21 22:46:48,341 DEBUG [Thread-609-EventThread] zookeeper.ZooKeeperWatcher(294): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Received ZooKeeper Event, type=None, state=SyncConnected, path=null
        2014-08-21 22:46:48,343 DEBUG [Thread-609-EventThread] zookeeper.ZooKeeperWatcher(371): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830023 connected
        2014-08-21 22:46:48,349 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/unassigned
        2014-08-21 22:46:48,349 DEBUG [Thread-609] zookeeper.ZKUtil(423): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830023 Set watcher on existing znode /hbase/root-region-server
        2014-08-21 22:46:48,349 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-2] zookeeper.ZKAssign(561): master:37883-0x147fc404e830000 Creating unassigned node for 1644a212531c3b43dde748d401c7e212 in a CLOSING state
        2014-08-21 22:46:48,350 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 133 byte(s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372 and set watcher; region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_CLOSING
        2014-08-21 22:46:48,350 DEBUG [Thread-609] zookeeper.ZKUtil(1599): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830023 Retrieved 42 byte(s) of data from znode /hbase/root-region-server and set watcher; p0420.sjc.cloudera.com,60875,...
        2014-08-21 22:46:48,351 INFO  [PRI IPC Server handler 0 on 60875] regionserver.HRegionServer(3195): Received close region: testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.. Version of ZK closing node:0
        2014-08-21 22:46:48,351 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] handler.CloseRegionHandler(105): Processing close of testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.
        2014-08-21 22:46:48,351 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-0] master.AssignmentManager(2239): Sent CLOSE to p0420.sjc.cloudera.com,60875,1408686379690 for region testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.
        2014-08-21 22:46:48,351 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] regionserver.HRegion(1018): Closing testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.: disabling compactions & flushes
        2014-08-21 22:46:48,351 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] regionserver.HRegion(1045): Updates disabled for region testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.
        2014-08-21 22:46:48,357 INFO  [StoreCloserThread-testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.-1] regionserver.Store(754): Closed fam
        2014-08-21 22:46:48,357 INFO  [RS_CLOSE_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] regionserver.HRegion(1117): Closed testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.
        2014-08-21 22:46:48,357 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] zookeeper.ZKAssign(757): regionserver:60875-0x147fc404e830003 Attempting to transition node a8edbdfb2e9b02881ebc1702752b2372 from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,357 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/unassigned
        2014-08-21 22:46:48,357 DEBUG [Thread-609] zookeeper.ZKUtil(425): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830023 /hbase/unassigned/1028785192 does not exist. Watcher is set.
        2014-08-21 22:46:48,358 DEBUG [Thread-609] client.ClientScanner(90): Creating scanner over .META. starting at key 'testQuarantineMissingHFile,,'
        2014-08-21 22:46:48,358 DEBUG [Thread-609] client.ClientScanner(203): Advancing internal scanner to startKey at 'testQuarantineMissingHFile,,'
        2014-08-21 22:46:48,358 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] zookeeper.ZKUtil(1599): regionserver:60875-0x147fc404e830003 Retrieved 133 byte(s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372; data=region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_CLOSING
        2014-08-21 22:46:48,359 INFO  [PRI IPC Server handler 6 on 56883] regionserver.HRegionServer(3195): Received close region: testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.. Version of ZK closing node:0
        2014-08-21 22:46:48,359 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] handler.CloseRegionHandler(105): Processing close of testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.
        2014-08-21 22:46:48,359 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-2] master.AssignmentManager(2239): Sent CLOSE to p0420.sjc.cloudera.com,56883,1408686379653 for region testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.
        2014-08-21 22:46:48,360 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] regionserver.HRegion(1018): Closing testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.: disabling compactions & flushes
        2014-08-21 22:46:48,359 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-1] zookeeper.ZKAssign(561): master:37883-0x147fc404e830000 Creating unassigned node for 1eeb1332ce0a2f3b96882b0ec1572dc5 in a CLOSING state
        2014-08-21 22:46:48,360 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] regionserver.HRegion(1045): Updates disabled for region testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.
        2014-08-21 22:46:48,359 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212 and set watcher; region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_CLOSING
        2014-08-21 22:46:48,362 DEBUG [Thread-609] catalog.CatalogTracker(227): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@b6a6597
        2014-08-21 22:46:48,368 INFO  [StoreCloserThread-testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.-1] regionserver.Store(754): Closed fam
        2014-08-21 22:46:48,368 INFO  [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] regionserver.HRegion(1117): Closed testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.
        2014-08-21 22:46:48,369 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] zookeeper.ZKAssign(820): regionserver:60875-0x147fc404e830003 Successfully transitioned node a8edbdfb2e9b02881ebc1702752b2372 from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,369 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] zookeeper.ZKAssign(757): regionserver:56883-0x147fc404e830002 Attempting to transition node 1644a212531c3b43dde748d401c7e212 from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,369 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] handler.CloseRegionHandler(140): set region closed state in zk successfully for region testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. sn name: p0420.sjc.cloudera.com,60875,1408686379690
        2014-08-21 22:46:48,369 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] handler.CloseRegionHandler(149): Closed region testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.
        2014-08-21 22:46:48,376 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] zookeeper.ZKUtil(1599): regionserver:56883-0x147fc404e830002 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212; data=region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_CLOSING
        2014-08-21 22:46:48,376 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 133 byte(s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372 and set watcher; region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,60875,1408686379690, state=RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,376 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372
        2014-08-21 22:46:48,376 DEBUG [Thread-609] zookeeper.ZKUtil(1599): hconnection-0x147fc404e830007 Retrieved 9 byte(s) of data from znode /hbase/table/testQuarantineMissingHFile; data=DISABLING
        2014-08-21 22:46:48,377 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-3] master.AssignmentManager(2140): Starting unassignment of region testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. (offlining)
        2014-08-21 22:46:48,377 DEBUG [Thread-609] client.HBaseAdmin(889): Sleeping= 1000ms, waiting for all regions to be disabled in testQuarantineMissingHFile
        2014-08-21 22:46:48,377 INFO  [PRI IPC Server handler 7 on 56883] regionserver.HRegionServer(3195): Received close region: testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.. Version of ZK closing node:0
        2014-08-21 22:46:48,377 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-3] zookeeper.ZKAssign(561): master:37883-0x147fc404e830000 Creating unassigned node for c425f751446d62d8f4a9d9f5d8811214 in a CLOSING state
        2014-08-21 22:46:48,377 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] handler.CloseRegionHandler(105): Processing close of testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.
        2014-08-21 22:46:48,377 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-1] master.AssignmentManager(2239): Sent CLOSE to p0420.sjc.cloudera.com,56883,1408686379653 for region testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.
        2014-08-21 22:46:48,378 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] regionserver.HRegion(1018): Closing testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.: disabling compactions & flushes
        2014-08-21 22:46:48,378 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] regionserver.HRegion(1045): Updates disabled for region testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.
        2014-08-21 22:46:48,382 INFO  [StoreCloserThread-testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.-1] regionserver.Store(754): Closed fam
        2014-08-21 22:46:48,382 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] zookeeper.ZKAssign(820): regionserver:56883-0x147fc404e830002 Successfully transitioned node 1644a212531c3b43dde748d401c7e212 from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,382 INFO  [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] regionserver.HRegion(1117): Closed testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.
        2014-08-21 22:46:48,383 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 133 byte(s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372 and set watcher; region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,60875,1408686379690, state=RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,382 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] handler.CloseRegionHandler(140): set region closed state in zk successfully for region testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. sn name: p0420.sjc.cloudera.com,56883,1408686379653
        2014-08-21 22:46:48,383 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] zookeeper.ZKAssign(757): regionserver:56883-0x147fc404e830002 Attempting to transition node 1eeb1332ce0a2f3b96882b0ec1572dc5 from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,383 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] handler.CloseRegionHandler(149): Closed region testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.
        2014-08-21 22:46:48,391 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] zookeeper.ZKUtil(1599): regionserver:56883-0x147fc404e830002 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5; data=region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_CLOSING
        2014-08-21 22:46:48,391 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_CLOSED, server=p0420.sjc.cloudera.com,60875,1408686379690, region=a8edbdfb2e9b02881ebc1702752b2372
        2014-08-21 22:46:48,392 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/unassigned
        2014-08-21 22:46:48,392 INFO  [PRI IPC Server handler 3 on 54158] regionserver.HRegionServer(3195): Received close region: testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.. Version of ZK closing node:0
        2014-08-21 22:46:48,392 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.ClosedRegionHandler(92): Handling CLOSED event for a8edbdfb2e9b02881ebc1702752b2372
        2014-08-21 22:46:48,392 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] handler.CloseRegionHandler(105): Processing close of testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.
        2014-08-21 22:46:48,392 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-3] master.AssignmentManager(2239): Sent CLOSE to p0420.sjc.cloudera.com,54158,1408686379607 for region testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.
        2014-08-21 22:46:48,392 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] regionserver.HRegion(1018): Closing testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.: disabling compactions & flushes
        2014-08-21 22:46:48,392 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-0] master.AssignmentManager(1355): Table being disabled so deleting ZK node and removing from regions in transition, skipping assignment of region testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.
        2014-08-21 22:46:48,393 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] regionserver.HRegion(1045): Updates disabled for region testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.
        2014-08-21 22:46:48,393 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-0] zookeeper.ZKAssign(483): master:37883-0x147fc404e830000 Deleting existing unassigned node for a8edbdfb2e9b02881ebc1702752b2372 that is in expected state RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,394 INFO  [StoreCloserThread-testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.-1] regionserver.Store(754): Closed fam
        2014-08-21 22:46:48,394 INFO  [RS_CLOSE_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] regionserver.HRegion(1117): Closed testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.
        2014-08-21 22:46:48,394 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] zookeeper.ZKAssign(757): regionserver:54158-0x147fc404e830001 Attempting to transition node c425f751446d62d8f4a9d9f5d8811214 from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,399 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] zookeeper.ZKAssign(820): regionserver:56883-0x147fc404e830002 Successfully transitioned node 1eeb1332ce0a2f3b96882b0ec1572dc5 from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,399 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] handler.CloseRegionHandler(140): set region closed state in zk successfully for region testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. sn name: p0420.sjc.cloudera.com,56883,1408686379653
        2014-08-21 22:46:48,399 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] handler.CloseRegionHandler(149): Closed region testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.
        2014-08-21 22:46:48,399 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-0] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 133 byte(s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372; data=region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,60875,1408686379690, state=RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,400 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212 and set watcher; region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,400 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] zookeeper.ZKUtil(1599): regionserver:54158-0x147fc404e830001 Retrieved 134 byte(s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214; data=region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_CLOSING
        2014-08-21 22:46:48,407 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-0] zookeeper.ZKAssign(512): master:37883-0x147fc404e830000 Successfully deleted unassigned node for region a8edbdfb2e9b02881ebc1702752b2372 in expected state RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,408 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214 and set watcher; region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_CLOSING
        2014-08-21 22:46:48,416 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] zookeeper.ZKAssign(820): regionserver:54158-0x147fc404e830001 Successfully transitioned node c425f751446d62d8f4a9d9f5d8811214 from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,416 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(713): master:37883-0x147fc404e830000 Unable to get data of znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372 because node does not exist (not an error)
        2014-08-21 22:46:48,416 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] handler.CloseRegionHandler(140): set region closed state in zk successfully for region testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. sn name: p0420.sjc.cloudera.com,54158,1408686379607
        2014-08-21 22:46:48,416 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] handler.CloseRegionHandler(149): Closed region testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.
        2014-08-21 22:46:48,417 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5 and set watcher; region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,417 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/1644a212531c3b43dde748d401c7e212
        2014-08-21 22:46:48,417 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212 and set watcher; region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,418 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_CLOSED, server=p0420.sjc.cloudera.com,56883,1408686379653, region=1644a212531c3b43dde748d401c7e212
        2014-08-21 22:46:48,418 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5
        2014-08-21 22:46:48,418 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-1] handler.ClosedRegionHandler(92): Handling CLOSED event for 1644a212531c3b43dde748d401c7e212
        2014-08-21 22:46:48,418 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-1] master.AssignmentManager(1355): Table being disabled so deleting ZK node and removing from regions in transition, skipping assignment of region testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.
        2014-08-21 22:46:48,418 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-1] zookeeper.ZKAssign(483): master:37883-0x147fc404e830000 Deleting existing unassigned node for 1644a212531c3b43dde748d401c7e212 that is in expected state RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,419 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5 and set watcher; region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,419 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_CLOSED, server=p0420.sjc.cloudera.com,56883,1408686379653, region=1eeb1332ce0a2f3b96882b0ec1572dc5
        2014-08-21 22:46:48,419 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372
        2014-08-21 22:46:48,419 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-1] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212; data=region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,419 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/unassigned
        2014-08-21 22:46:48,419 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-2] handler.ClosedRegionHandler(92): Handling CLOSED event for 1eeb1332ce0a2f3b96882b0ec1572dc5
        2014-08-21 22:46:48,419 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-2] master.AssignmentManager(1355): Table being disabled so deleting ZK node and removing from regions in transition, skipping assignment of region testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.
        2014-08-21 22:46:48,420 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-2] zookeeper.ZKAssign(483): master:37883-0x147fc404e830000 Deleting existing unassigned node for 1eeb1332ce0a2f3b96882b0ec1572dc5 that is in expected state RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,424 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-1] zookeeper.ZKAssign(512): master:37883-0x147fc404e830000 Successfully deleted unassigned node for region 1644a212531c3b43dde748d401c7e212 in expected state RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,424 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-2] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5; data=region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,425 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214 and set watcher; region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,54158,1408686379607, state=RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,427 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DisableTableHandler$BulkDisabler(173): Disable waiting until done; 300000 ms remaining; [{NAME => 'testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.', STARTKEY => 'A', ENDKEY => 'B', ENCODED => 1eeb1332ce0a2f3b96882b0ec1572dc5,}, {NAME => 'testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.', STARTKEY => 'C', ENDKEY => '', ENCODED => c425f751446d62d8f4a9d9f5d8811214,}]
        2014-08-21 22:46:48,432 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-2] zookeeper.ZKAssign(512): master:37883-0x147fc404e830000 Successfully deleted unassigned node for region 1eeb1332ce0a2f3b96882b0ec1572dc5 in expected state RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,432 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(713): master:37883-0x147fc404e830000 Unable to get data of znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5 because node does not exist (not an error)
        2014-08-21 22:46:48,433 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214
        2014-08-21 22:46:48,434 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214 and set watcher; region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,54158,1408686379607, state=RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,434 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_CLOSED, server=p0420.sjc.cloudera.com,54158,1408686379607, region=c425f751446d62d8f4a9d9f5d8811214
        2014-08-21 22:46:48,434 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/unassigned/1644a212531c3b43dde748d401c7e212
        2014-08-21 22:46:48,434 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-3] handler.ClosedRegionHandler(92): Handling CLOSED event for c425f751446d62d8f4a9d9f5d8811214
        2014-08-21 22:46:48,434 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5
        2014-08-21 22:46:48,434 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-3] master.AssignmentManager(1355): Table being disabled so deleting ZK node and removing from regions in transition, skipping assignment of region testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.
        2014-08-21 22:46:48,434 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/unassigned
        2014-08-21 22:46:48,435 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-3] zookeeper.ZKAssign(483): master:37883-0x147fc404e830000 Deleting existing unassigned node for c425f751446d62d8f4a9d9f5d8811214 that is in expected state RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,436 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-3] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214; data=region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,54158,1408686379607, state=RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,436 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte(s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214 and set watcher; region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,54158,1408686379607, state=RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,441 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214
        2014-08-21 22:46:48,441 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-3] zookeeper.ZKAssign(512): master:37883-0x147fc404e830000 Successfully deleted unassigned node for region c425f751446d62d8f4a9d9f5d8811214 in expected state RS_ZK_REGION_CLOSED
        2014-08-21 22:46:48,441 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(1176): The znode of region testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. has been deleted.
        2014-08-21 22:46:48,441 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/unassigned
        2014-08-21 22:46:48,477 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DisableTableHandler$BulkDisabler(173): Disable waiting until done; 299949 ms remaining; []
        2014-08-21 22:46:48,482 INFO  [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DisableTableHandler(137): Disabled table is done=true
        2014-08-21 22:46:49,378 DEBUG [Thread-609] zookeeper.ZKUtil(120): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 opening connection to ZooKeeper with ensemble (localhost:63891)
        2014-08-21 22:46:49,381 INFO  [Thread-609] zookeeper.RecoverableZooKeeper(104): The identifier of this process is 10184@p0420.sjc.cloudera.com
        2014-08-21 22:46:49,381 DEBUG [Thread-609] catalog.CatalogTracker(210): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@46480e23
        2014-08-21 22:46:49,391 DEBUG [Thread-609-EventThread] zookeeper.ZooKeeperWatcher(294): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Received ZooKeeper Event, type=None, state=SyncConnected, path=null
        2014-08-21 22:46:49,391 DEBUG [Thread-609] zookeeper.ZKUtil(423): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Set watcher on existing znode /hbase/root-region-server
        2014-08-21 22:46:49,392 DEBUG [Thread-609] zookeeper.ZKUtil(1599): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Retrieved 42 byte(s) of data from znode /hbase/root-region-server and set watcher; p0420.sjc.cloudera.com,60875,...
        2014-08-21 22:46:49,392 DEBUG [Thread-609-EventThread] zookeeper.ZooKeeperWatcher(371): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830024 connected
        2014-08-21 22:46:49,393 DEBUG [Thread-609] zookeeper.ZKUtil(425): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830024 /hbase/unassigned/1028785192 does not exist. Watcher is set.
        2014-08-21 22:46:49,393 DEBUG [Thread-609] client.ClientScanner(90): Creating scanner over .META. starting at key 'testQuarantineMissingHFile,,'
        2014-08-21 22:46:49,393 DEBUG [Thread-609] client.ClientScanner(203): Advancing internal scanner to startKey at 'testQuarantineMissingHFile,,'
        2014-08-21 22:46:49,396 DEBUG [Thread-609] catalog.CatalogTracker(227): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@46480e23
        2014-08-21 22:46:49,400 DEBUG [Thread-609] zookeeper.ZKUtil(1599): hconnection-0x147fc404e830007 Retrieved 8 byte(s) of data from znode /hbase/table/testQuarantineMissingHFile; data=DISABLED
        2014-08-21 22:46:49,401 INFO  [Thread-609] client.HBaseAdmin(905): Disabled testQuarantineMissingHFile
        2014-08-21 22:46:49,422 WARN  [Thread-609] conf.Configuration(981): fs.default.name is deprecated. Instead, use fs.defaultFS
        2014-08-21 22:46:49,426 INFO  [Thread-609] util.HBaseFsck(3665): Checking all hfiles for corruption
        2014-08-21 22:46:49,460 INFO  [IPC Server handler 6 on 58811] blockmanagement.BlockManager(989): BLOCK* addToInvalidates: blk_-8202252735549624962_1100 127.0.0.1:34823 127.0.0.1:40670 127.0.0.1:40206 
        2014-08-21 22:46:49,462 ERROR [IPC Server handler 9 on 58811] security.UserGroupInformation(1461): PriviledgedActionException as:jenkins (auth:SIMPLE) cause:java.io.FileNotFoundException: File does not exist: /user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/fam/92484a47b8f14c338314b70c98ebc0dc
        2014-08-21 22:46:49,464 WARN  [pool-67-thread-1] hbck.HFileCorruptionChecker(108): HFile hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/fam/92484a47b8f14c338314b70c98ebc0dc was missing.  Likely removed due to compaction/split?
        2014-08-21 22:46:49,468 INFO  [IPC Server handler 1 on 58811] blockmanagement.BlockManager(989): BLOCK* addToInvalidates: blk_8136300766489353090_1102 127.0.0.1:34823 127.0.0.1:40670 127.0.0.1:40206 
        2014-08-21 22:46:49,508 ERROR [IPC Server handler 5 on 58811] security.UserGroupInformation(1461): PriviledgedActionException as:jenkins (auth:SIMPLE) cause:java.io.FileNotFoundException: File does not exist: /user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/fam/e81f27e4ffbf435cb38dca815be340e8
        2014-08-21 22:46:49,509 WARN  [pool-67-thread-4] hbck.HFileCorruptionChecker(108): HFile hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/fam/e81f27e4ffbf435cb38dca815be340e8 was missing.  Likely removed due to compaction/split?
        2014-08-21 22:46:49,512 INFO  [Thread-609] util.HBaseFsck(358): Loading regioninfos HDFS
        2014-08-21 22:46:49,513 INFO  [Thread-609] util.HBaseFsck(573): Loading HBase regioninfo from HDFS...
        2014-08-21 22:46:49,515 DEBUG [Thread-609] util.HBaseFsck(1310): Loading region dirs from hdfs://localhost:58811/user/jenkins/hbase/-ROOT-
        2014-08-21 22:46:49,515 DEBUG [Thread-609] util.HBaseFsck(1310): Loading region dirs from hdfs://localhost:58811/user/jenkins/hbase/.META.
        2014-08-21 22:46:49,516 DEBUG [Thread-609] util.HBaseFsck(1310): Loading region dirs from hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile
        2014-08-21 22:46:49,518 DEBUG [pool-67-thread-1] util.HBaseFsck$WorkItemHdfsDir(3133): Loading region info from hdfs:hdfs://localhost:58811/user/jenkins/hbase/-ROOT-/70236052
        2014-08-21 22:46:49,518 DEBUG [pool-67-thread-5] util.HBaseFsck$WorkItemHdfsDir(3133): Loading region info from hdfs:hdfs://localhost:58811/user/jenkins/hbase/.META./1028785192
        2014-08-21 22:46:49,519 DEBUG [pool-67-thread-6] util.HBaseFsck$WorkItemHdfsDir(3133): Loading region info from hdfs:hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212
        2014-08-21 22:46:49,561 DEBUG [pool-67-thread-6] util.HBaseFsck$WorkItemHdfsDir(3133): Loading region info from hdfs:hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5
        2014-08-21 22:46:49,564 DEBUG [pool-67-thread-6] util.HBaseFsck$WorkItemHdfsDir(3133): Loading region info from hdfs:hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372
        2014-08-21 22:46:49,569 DEBUG [pool-67-thread-6] util.HBaseFsck$WorkItemHdfsDir(3133): Loading region info from hdfs:hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214
        2014-08-21 22:46:49,576 DEBUG [pool-67-thread-7] util.HBaseFsck(734): HRegionInfo read: {NAME => '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED => 1028785192,}
        2014-08-21 22:46:49,577 DEBUG [pool-67-thread-9] util.HBaseFsck(734): HRegionInfo read: {NAME => 'testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.', STARTKEY => 'A', ENDKEY => 'B', ENCODED => 1eeb1332ce0a2f3b96882b0ec1572dc5,}
        2014-08-21 22:46:49,616 DEBUG [pool-67-thread-6] util.HBaseFsck(734): HRegionInfo read: {NAME => '-ROOT-,,0', STARTKEY => '', ENDKEY => '', ENCODED => 70236052,}
        2014-08-21 22:46:49,617 DEBUG [pool-67-thread-5] util.HBaseFsck(734): HRegionInfo read: {NAME => 'testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.', STARTKEY => 'B', ENDKEY => 'C', ENCODED => 1644a212531c3b43dde748d401c7e212,}
        2014-08-21 22:46:49,617 DEBUG [pool-67-thread-10] util.HBaseFsck(734): HRegionInfo read: {NAME => 'testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.', STARTKEY => '', ENDKEY => 'A', ENCODED => a8edbdfb2e9b02881ebc1702752b2372,}
        2014-08-21 22:46:49,617 DEBUG [pool-67-thread-8] util.HBaseFsck(734): HRegionInfo read: {NAME => 'testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.', STARTKEY => 'C', ENDKEY => '', ENCODED => c425f751446d62d8f4a9d9f5d8811214,}
        2014-08-21 22:46:49,625 INFO  [Thread-609] util.HBaseFsck(1072): Checking HBase region split map from HDFS data...
        2014-08-21 22:46:49,626 INFO  [Thread-609] util.HBaseFsck(582): No integrity errors.  We are done with this phase. Glorious.
        2014-08-21 22:46:49,627 INFO  [IPC Server handler 3 on 37883] master.HMaster(1249): BalanceSwitch=false
        2014-08-21 22:46:49,627 INFO  [Thread-609] util.HBaseFsck(394): Loading regionsinfo from the .META. table
        2014-08-21 22:46:49,628 DEBUG [Thread-609] zookeeper.ZKUtil(1599): hconnection-0x147fc404e830007 Retrieved 42 byte(s) of data from znode /hbase/root-region-server and set watcher; p0420.sjc.cloudera.com,60875,...
        2014-08-21 22:46:49,629 DEBUG [Thread-609] client.HConnectionManager$HConnectionImplementation(987): Looked up root region location, connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033; serverName=p0420.sjc.cloudera.com,60875,1408686379690
        2014-08-21 22:46:49,629 DEBUG [Thread-609] zookeeper.ZKUtil(423): hconnection-0x147fc404e830007 Set watcher on existing znode /hbase/root-region-server
        2014-08-21 22:46:49,630 DEBUG [Thread-609] zookeeper.ZKUtil(1599): hconnection-0x147fc404e830007 Retrieved 42 byte(s) of data from znode /hbase/root-region-server and set watcher; p0420.sjc.cloudera.com,60875,...
        2014-08-21 22:46:49,630 DEBUG [Thread-609] zookeeper.ZKUtil(1599): hconnection-0x147fc404e830007 Retrieved 42 byte(s) of data from znode /hbase/root-region-server and set watcher; p0420.sjc.cloudera.com,60875,...
        2014-08-21 22:46:49,631 DEBUG [Thread-609] client.MetaScanner(182): Scanning -ROOT- starting at row= for max=2147483647 rows using org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033
        2014-08-21 22:46:49,632 DEBUG [Thread-609] zookeeper.ZKUtil(1599): hconnection-0x147fc404e830007 Retrieved 42 byte(s) of data from znode /hbase/root-region-server and set watcher; p0420.sjc.cloudera.com,60875,...
        2014-08-21 22:46:49,632 DEBUG [Thread-609] client.HConnectionManager$HConnectionImplementation(987): Looked up root region location, connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033; serverName=p0420.sjc.cloudera.com,60875,1408686379690
        2014-08-21 22:46:49,636 DEBUG [Thread-609] client.MetaScanner(182): Scanning .META. starting at row= for max=2147483647 rows using org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033
        2014-08-21 22:46:49,646 INFO  [Thread-609] util.HBaseFsck(2464): getHTableDescriptors == tableNames => []
        2014-08-21 22:46:49,667 WARN  [Thread-609] conf.Configuration(981): fs.default.name is deprecated. Instead, use fs.defaultFS
        2014-08-21 22:46:49,673 DEBUG [Thread-609] util.HBaseFsck(1310): Loading region dirs from hdfs://localhost:58811/user/jenkins/hbase/-ROOT-
        2014-08-21 22:46:49,674 DEBUG [Thread-609] util.HBaseFsck(1310): Loading region dirs from hdfs://localhost:58811/user/jenkins/hbase/.META.
        2014-08-21 22:46:49,674 DEBUG [Thread-609] util.HBaseFsck(1310): Loading region dirs from hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile
        2014-08-21 22:46:49,676 DEBUG [pool-67-thread-1] util.HBaseFsck$WorkItemHdfsDir(3133): Loading region info from hdfs:hdfs://localhost:58811/user/jenkins/hbase/-ROOT-/70236052
        2014-08-21 22:46:49,677 DEBUG [pool-67-thread-7] util.HBaseFsck$WorkItemHdfsDir(3133): Loading region info from hdfs:hdfs://localhost:58811/user/jenkins/hbase/.META./1028785192
        2014-08-21 22:46:49,681 DEBUG [pool-67-thread-9] util.HBaseFsck$WorkItemHdfsDir(3133): Loading region info from hdfs:hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212
        2014-08-21 22:46:49,724 DEBUG [pool-67-thread-9] util.HBaseFsck$WorkItemHdfsDir(3133): Loading region info from hdfs:hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5
        2014-08-21 22:46:49,727 DEBUG [pool-67-thread-9] util.HBaseFsck$WorkItemHdfsDir(3133): Loading region info from hdfs:hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372
        2014-08-21 22:46:49,729 DEBUG [pool-67-thread-9] util.HBaseFsck$WorkItemHdfsDir(3133): Loading region info from hdfs:hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214
        2014-08-21 22:46:49,736 DEBUG [pool-67-thread-6] util.HBaseFsck(734): HRegionInfo read: {NAME => '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED => 1028785192,}
        2014-08-21 22:46:49,737 DEBUG [pool-67-thread-3] util.HBaseFsck(734): HRegionInfo read: {NAME => 'testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.', STARTKEY => 'C', ENDKEY => '', ENCODED => c425f751446d62d8f4a9d9f5d8811214,}
        2014-08-21 22:46:49,777 DEBUG [pool-67-thread-5] util.HBaseFsck(734): HRegionInfo read: {NAME => 'testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.', STARTKEY => 'B', ENDKEY => 'C', ENCODED => 1644a212531c3b43dde748d401c7e212,}
        2014-08-21 22:46:49,777 DEBUG [pool-67-thread-4] util.HBaseFsck(734): HRegionInfo read: {NAME => 'testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.', STARTKEY => '', ENDKEY => 'A', ENCODED => a8edbdfb2e9b02881ebc1702752b2372,}
        2014-08-21 22:46:49,777 DEBUG [pool-67-thread-8] util.HBaseFsck(734): HRegionInfo read: {NAME => '-ROOT-,,0', STARTKEY => '', ENDKEY => '', ENCODED => 70236052,}
        2014-08-21 22:46:49,777 DEBUG [pool-67-thread-10] util.HBaseFsck(734): HRegionInfo read: {NAME => 'testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.', STARTKEY => 'A', ENDKEY => 'B', ENCODED => 1eeb1332ce0a2f3b96882b0ec1572dc5,}
        2014-08-21 22:46:49,785 DEBUG [Thread-609] zookeeper.ZKUtil(1599): hconnection-0x147fc404e830007 Retrieved 8 byte(s) of data from znode /hbase/table/testQuarantineMissingHFile; data=DISABLED
        2014-08-21 22:46:49,786 INFO  [Thread-609] util.HBaseFsck(1623): Region { meta => testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., hdfs => hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212, deployed =>  } is in META, and in a disabled tabled that is not deployed
        2014-08-21 22:46:49,786 INFO  [Thread-609] util.HBaseFsck(1623): Region { meta => testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., hdfs => hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5, deployed =>  } is in META, and in a disabled tabled that is not deployed
        2014-08-21 22:46:49,786 INFO  [Thread-609] util.HBaseFsck(1623): Region { meta => testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., hdfs => hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372, deployed =>  } is in META, and in a disabled tabled that is not deployed
        2014-08-21 22:46:49,786 INFO  [Thread-609] util.HBaseFsck(1623): Region { meta => testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., hdfs => hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214, deployed =>  } is in META, and in a disabled tabled that is not deployed
        2014-08-21 22:46:49,786 DEBUG [Thread-609] util.HBaseFsck(1777): There are 6 region info entries
        2014-08-21 22:46:49,788 INFO  [IPC Server handler 4 on 37883] master.HMaster(1249): BalanceSwitch=true
        2014-08-21 22:46:49,874 WARN  [Thread-609] conf.Configuration(981): fs.default.name is deprecated. Instead, use fs.defaultFS
        2014-08-21 22:46:49,877 DEBUG [Thread-609] zookeeper.ZKUtil(120): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 opening connection to ZooKeeper with ensemble (localhost:63891)
        2014-08-21 22:46:49,886 DEBUG [Thread-609-EventThread] zookeeper.ZooKeeperWatcher(294): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Received ZooKeeper Event, type=None, state=SyncConnected, path=null
        2014-08-21 22:46:49,888 INFO  [Thread-609] zookeeper.RecoverableZooKeeper(104): The identifier of this process is 10184@p0420.sjc.cloudera.com
        2014-08-21 22:46:49,888 DEBUG [Thread-609] catalog.CatalogTracker(210): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@6b5a0316
        2014-08-21 22:46:49,888 DEBUG [Thread-609-EventThread] zookeeper.ZooKeeperWatcher(371): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830025 connected
        2014-08-21 22:46:49,891 DEBUG [Thread-609] zookeeper.ZKUtil(423): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830025 Set watcher on existing znode /hbase/root-region-server
        2014-08-21 22:46:49,892 DEBUG [Thread-609] zookeeper.ZKUtil(1599): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830025 Retrieved 42 byte(s) of data from znode /hbase/root-region-server and set watcher; p0420.sjc.cloudera.com,60875,...
        2014-08-21 22:46:49,892 DEBUG [Thread-609] zookeeper.ZKUtil(425): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830025 /hbase/unassigned/1028785192 does not exist. Watcher is set.
        2014-08-21 22:46:49,894 DEBUG [Thread-609] zookeeper.ZKUtil(1599): hconnection-0x147fc404e830007 Retrieved 42 byte(s) of data from znode /hbase/root-region-server and set watcher; p0420.sjc.cloudera.com,60875,...
        2014-08-21 22:46:49,894 DEBUG [Thread-609] client.HConnectionManager$HConnectionImplementation(987): Looked up root region location, connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033; serverName=p0420.sjc.cloudera.com,60875,1408686379690
        2014-08-21 22:46:49,896 DEBUG [Thread-609] client.HConnectionManager$HConnectionImplementation(1404): Cached location for .META.,,1.1028785192 is p0420.sjc.cloudera.com:60875
        2014-08-21 22:46:49,897 DEBUG [Thread-609] client.ClientScanner(90): Creating scanner over .META. starting at key 'testQuarantineMissingHFile,,'
        2014-08-21 22:46:49,897 DEBUG [Thread-609] client.ClientScanner(203): Advancing internal scanner to startKey at 'testQuarantineMissingHFile,,'
        2014-08-21 22:46:49,900 DEBUG [Thread-609] catalog.CatalogTracker(227): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@6b5a0316
        2014-08-21 22:46:49,909 DEBUG [Thread-609] zookeeper.ZKUtil(1599): hconnection-0x147fc404e830007 Retrieved 8 byte(s) of data from znode /hbase/table/testQuarantineMissingHFile; data=DISABLED
        2014-08-21 22:46:49,910 DEBUG [Thread-609] zookeeper.ZKUtil(120): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 opening connection to ZooKeeper with ensemble (localhost:63891)
        2014-08-21 22:46:49,912 INFO  [Thread-609] zookeeper.RecoverableZooKeeper(104): The identifier of this process is 10184@p0420.sjc.cloudera.com
        2014-08-21 22:46:49,912 DEBUG [Thread-609] catalog.CatalogTracker(210): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@51cb3ec4
        2014-08-21 22:46:49,924 DEBUG [Thread-609-EventThread] zookeeper.ZooKeeperWatcher(294): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Received ZooKeeper Event, type=None, state=SyncConnected, path=null
        2014-08-21 22:46:49,925 DEBUG [Thread-609] zookeeper.ZKUtil(423): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Set watcher on existing znode /hbase/root-region-server
        2014-08-21 22:46:49,925 DEBUG [Thread-609] zookeeper.ZKUtil(1599): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Retrieved 42 byte(s) of data from znode /hbase/root-region-server and set watcher; p0420.sjc.cloudera.com,60875,...
        2014-08-21 22:46:49,926 DEBUG [Thread-609] zookeeper.ZKUtil(425): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830026 /hbase/unassigned/1028785192 does not exist. Watcher is set.
        2014-08-21 22:46:49,927 DEBUG [Thread-609] client.ClientScanner(90): Creating scanner over .META. starting at key 'testQuarantineMissingHFile,,'
        2014-08-21 22:46:49,927 DEBUG [Thread-609] client.ClientScanner(203): Advancing internal scanner to startKey at 'testQuarantineMissingHFile,,'
        2014-08-21 22:46:49,927 DEBUG [Thread-609-EventThread] zookeeper.ZooKeeperWatcher(371): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830026 connected
        2014-08-21 22:46:49,930 DEBUG [Thread-609] catalog.CatalogTracker(227): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@51cb3ec4
        2014-08-21 22:46:49,942 DEBUG [Thread-609] zookeeper.ZKUtil(1599): hconnection-0x147fc404e830007 Retrieved 8 byte(s) of data from znode /hbase/table/testQuarantineMissingHFile; data=DISABLED
        2014-08-21 22:46:49,945 DEBUG [IPC Server handler 1 on 37883] client.ClientScanner(90): Creating scanner over .META. starting at key 'testQuarantineMissingHFile,,'
        2014-08-21 22:46:49,945 DEBUG [IPC Server handler 1 on 37883] client.ClientScanner(203): Advancing internal scanner to startKey at 'testQuarantineMissingHFile,,'
        2014-08-21 22:46:49,957 INFO  [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.TableEventHandler(93): Handling table operation C_M_DELETE_TABLE on table testQuarantineMissingHFile
        2014-08-21 22:46:49,958 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] client.ClientScanner(90): Creating scanner over .META. starting at key 'testQuarantineMissingHFile,,'
        2014-08-21 22:46:49,958 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] client.ClientScanner(203): Advancing internal scanner to startKey at 'testQuarantineMissingHFile,,'
        2014-08-21 22:46:49,963 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] client.ClientScanner(190): Finished with scanning at {NAME => '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED => 1028785192,}
        2014-08-21 22:46:49,964 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DeleteTableHandler(75): Deleting regions from META
        2014-08-21 22:46:49,968 INFO  [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] catalog.MetaEditor(328): Deleted from META, regions: [{NAME => 'testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.', STARTKEY => '', ENDKEY => 'A', ENCODED => a8edbdfb2e9b02881ebc1702752b2372,}, {NAME => 'testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.', STARTKEY => 'A', ENDKEY => 'B', ENCODED => 1eeb1332ce0a2f3b96882b0ec1572dc5,}, {NAME => 'testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.', STARTKEY => 'B', ENDKEY => 'C', ENCODED => 1644a212531c3b43dde748d401c7e212,}, {NAME => 'testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.', STARTKEY => 'C', ENDKEY => '', ENCODED => c425f751446d62d8f4a9d9f5d8811214,}]
        2014-08-21 22:46:49,968 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DeleteTableHandler(79): Moving table directory to a temp directory
        2014-08-21 22:46:49,986 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DeleteTableHandler(87): Archiving region testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. from FS
        2014-08-21 22:46:49,986 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(95): ARCHIVING region hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372
        2014-08-21 22:46:49,986 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(113): Have an archive directory, preparing to move files
        2014-08-21 22:46:49,990 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(135): Archiving:[class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/fam]
        2014-08-21 22:46:49,991 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(284): Starting to archive files:[class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/fam]
        2014-08-21 22:46:49,991 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(318): moving files to the archive directory: hdfs://localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372
        2014-08-21 22:46:50,044 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(326): Created archive directory:hdfs://localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372
        2014-08-21 22:46:50,044 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(334): Archiving:class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/fam
        2014-08-21 22:46:50,045 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(343): class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/fam is a directory, archiving children files
        2014-08-21 22:46:50,047 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(318): moving files to the archive directory: hdfs://localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/fam
        2014-08-21 22:46:50,094 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(326): Created archive directory:hdfs://localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/fam
        2014-08-21 22:46:50,094 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(334): Archiving:class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/fam/231f0c27ede84a77a6e0a64aeb8887ce
        2014-08-21 22:46:50,096 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(402): No existing file in archive for:hdfs://localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/fam/231f0c27ede84a77a6e0a64aeb8887ce, free to archive original file.
        2014-08-21 22:46:50,119 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(437): Finished archiving file from: class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/fam/231f0c27ede84a77a6e0a64aeb8887ce, to: hdfs://localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/fam/231f0c27ede84a77a6e0a64aeb8887ce
        2014-08-21 22:46:50,119 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(146): Successfully resolved and archived, now can just delete region.
        2014-08-21 22:46:50,135 INFO  [IPC Server handler 5 on 58811] blockmanagement.BlockManager(989): BLOCK* addToInvalidates: blk_1232571622821848185_1091 127.0.0.1:40206 127.0.0.1:40670 127.0.0.1:34823 
        2014-08-21 22:46:50,136 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(480): Deleted all region files in: hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372
        2014-08-21 22:46:50,136 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DeleteTableHandler(87): Archiving region testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. from FS
        2014-08-21 22:46:50,136 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(95): ARCHIVING region hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5
        2014-08-21 22:46:50,137 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(113): Have an archive directory, preparing to move files
        2014-08-21 22:46:50,142 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(135): Archiving:[class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/fam]
        2014-08-21 22:46:50,142 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(284): Starting to archive files:[class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/fam]
        2014-08-21 22:46:50,142 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(318): moving files to the archive directory: hdfs://localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5
        2014-08-21 22:46:50,169 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(326): Created archive directory:hdfs://localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5
        2014-08-21 22:46:50,169 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(334): Archiving:class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/fam
        2014-08-21 22:46:50,170 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(343): class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/fam is a directory, archiving children files
        2014-08-21 22:46:50,173 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(318): moving files to the archive directory: hdfs://localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/fam
        2014-08-21 22:46:50,202 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(326): Created archive directory:hdfs://localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/fam
        2014-08-21 22:46:50,202 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(334): Archiving:class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/fam/7cec52ed390b4af3a2a3b04be32b91ed
        2014-08-21 22:46:50,204 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(402): No existing file in archive for:hdfs://localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/fam/7cec52ed390b4af3a2a3b04be32b91ed, free to archive original file.
        2014-08-21 22:46:50,269 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(437): Finished archiving file from: class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/fam/7cec52ed390b4af3a2a3b04be32b91ed, to: hdfs://localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/fam/7cec52ed390b4af3a2a3b04be32b91ed
        2014-08-21 22:46:50,269 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(146): Successfully resolved and archived, now can just delete region.
        2014-08-21 22:46:50,293 INFO  [IPC Server handler 3 on 58811] blockmanagement.BlockManager(989): BLOCK* addToInvalidates: blk_214010544537184802_1093 127.0.0.1:34823 127.0.0.1:40206 127.0.0.1:40670 
        2014-08-21 22:46:50,294 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(480): Deleted all region files in: hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5
        2014-08-21 22:46:50,295 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DeleteTableHandler(87): Archiving region testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. from FS
        2014-08-21 22:46:50,295 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(95): ARCHIVING region hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212
        2014-08-21 22:46:50,295 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(113): Have an archive directory, preparing to move files
        2014-08-21 22:46:50,299 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(135): Archiving:[class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/fam]
        2014-08-21 22:46:50,299 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(284): Starting to archive files:[class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/fam]
        2014-08-21 22:46:50,299 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(318): moving files to the archive directory: hdfs://localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212
        2014-08-21 22:46:50,385 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(326): Created archive directory:hdfs://localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212
        2014-08-21 22:46:50,386 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(334): Archiving:class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/fam
        2014-08-21 22:46:50,387 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(343): class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/fam is a directory, archiving children files
        2014-08-21 22:46:50,389 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(146): Successfully resolved and archived, now can just delete region.
        2014-08-21 22:46:50,410 INFO  [IPC Server handler 3 on 58811] blockmanagement.BlockManager(989): BLOCK* addToInvalidates: blk_4217073309354766419_1094 127.0.0.1:40206 127.0.0.1:40670 127.0.0.1:34823 
        2014-08-21 22:46:50,411 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(480): Deleted all region files in: hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212
        2014-08-21 22:46:50,411 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DeleteTableHandler(87): Archiving region testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. from FS
        2014-08-21 22:46:50,411 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(95): ARCHIVING region hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214
        2014-08-21 22:46:50,412 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(113): Have an archive directory, preparing to move files
        2014-08-21 22:46:50,415 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(135): Archiving:[class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/fam]
        2014-08-21 22:46:50,416 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(284): Starting to archive files:[class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/fam]
        2014-08-21 22:46:50,416 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(318): moving files to the archive directory: hdfs://localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214
        2014-08-21 22:46:50,469 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(326): Created archive directory:hdfs://localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214
        2014-08-21 22:46:50,469 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(334): Archiving:class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/fam
        2014-08-21 22:46:50,470 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(343): class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/fam is a directory, archiving children files
        2014-08-21 22:46:50,472 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(146): Successfully resolved and archived, now can just delete region.
        2014-08-21 22:46:50,502 INFO  [IPC Server handler 3 on 58811] blockmanagement.BlockManager(989): BLOCK* addToInvalidates: blk_-8586672548042035946_1092 127.0.0.1:40206 127.0.0.1:40670 127.0.0.1:34823 
        2014-08-21 22:46:50,503 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(480): Deleted all region files in: hdfs://localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214
        2014-08-21 22:46:50,527 INFO  [IPC Server handler 1 on 58811] blockmanagement.BlockManager(989): BLOCK* addToInvalidates: blk_7267598665009752386_1086 127.0.0.1:34823 127.0.0.1:40206 127.0.0.1:40670 
        2014-08-21 22:46:50,528 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DeleteTableHandler(97): Table 'testQuarantineMissingHFile' archived!
        2014-08-21 22:46:50,528 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DeleteTableHandler(100): Removing 'testQuarantineMissingHFile' descriptor.
        2014-08-21 22:46:50,529 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DeleteTableHandler(104): Marking 'testQuarantineMissingHFile' as deleted.
        2014-08-21 22:46:50,968 INFO  [Thread-609] client.HBaseAdmin(656): Deleted testQuarantineMissingHFile
        2014-08-21 22:46:50,982 INFO  [pool-1-thread-1] hbase.ResourceChecker(157): after util.TestHBaseFsck#testQuarantineMissingHFile: 398 threads (was 385), 603 file descriptors (was 600). 5 connections (was 5),  -thread leak?-  -file handle leak?- 
        2014-08-21 22:46:50,995 INFO  [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - DataXceiver for client DFSClient_NONMAPREDUCE_-1466515135_8 at /127.0.0.1:43833 [Waiting for operation #6]
        2014-08-21 22:46:50,995 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        2014-08-21 22:46:50,996 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
        2014-08-21 22:46:50,996 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
        2014-08-21 22:46:50,996 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
        2014-08-21 22:46:50,996 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
        2014-08-21 22:46:50,996 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:336)
        2014-08-21 22:46:50,996 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:158)
        2014-08-21 22:46:50,997 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:156)
        2014-08-21 22:46:50,997 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:129)
        2014-08-21 22:46:50,997 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
        2014-08-21 22:46:50,997 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.io.BufferedInputStream.read(BufferedInputStream.java:237)
        2014-08-21 22:46:50,997 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.io.DataInputStream.readShort(DataInputStream.java:295)
        2014-08-21 22:46:50,998 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:51)
        2014-08-21 22:46:50,998 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:198)
        2014-08-21 22:46:50,998 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.lang.Thread.run(Thread.java:662)
        2014-08-21 22:46:50,998 INFO  [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - pool-67-thread-3
        2014-08-21 22:46:50,998 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.misc.Unsafe.park(Native Method)
        2014-08-21 22:46:50,999 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)
        2014-08-21 22:46:50,999 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
        2014-08-21 22:46:50,999 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
        2014-08-21 22:46:50,999 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
        2014-08-21 22:46:50,999 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
        2014-08-21 22:46:50,999 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
        2014-08-21 22:46:51,000 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
        2014-08-21 22:46:51,000 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.lang.Thread.run(Thread.java:662)
        2014-08-21 22:46:51,000 INFO  [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - DataXceiver for client DFSClient_NONMAPREDUCE_-1466515135_8 at /127.0.0.1:34869 [Waiting for operation #5]
        2014-08-21 22:46:51,000 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        2014-08-21 22:46:51,000 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
        2014-08-21 22:46:51,001 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
        2014-08-21 22:46:51,001 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
        2014-08-21 22:46:51,001 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
        2014-08-21 22:46:51,001 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:336)
        2014-08-21 22:46:51,001 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:158)
        2014-08-21 22:46:51,001 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:156)
        2014-08-21 22:46:51,002 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:129)
        2014-08-21 22:46:51,002 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
        2014-08-21 22:46:51,002 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.io.BufferedInputStream.read(BufferedInputStream.java:237)
        2014-08-21 22:46:51,002 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.io.DataInputStream.readShort(DataInputStream.java:295)
        2014-08-21 22:46:51,002 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:51)
        2014-08-21 22:46:51,002 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:198)
        2014-08-21 22:46:51,003 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.lang.Thread.run(Thread.java:662)
        2014-08-21 22:46:51,003 INFO  [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - pool-67-thread-9
        2014-08-21 22:46:51,003 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.misc.Unsafe.park(Native Method)
        2014-08-21 22:46:51,003 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)
        2014-08-21 22:46:51,003 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
        2014-08-21 22:46:51,003 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
        2014-08-21 22:46:51,004 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
        2014-08-21 22:46:51,004 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
        2014-08-21 22:46:51,004 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
        2014-08-21 22:46:51,004 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
        2014-08-21 22:46:51,004 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.lang.Thread.run(Thread.java:662)
        2014-08-21 22:46:51,005 INFO  [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - DataXceiver for client DFSClient_NONMAPREDUCE_-1466515135_8 at /127.0.0.1:43845 [Waiting for operation #2]
        2014-08-21 22:46:51,005 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        2014-08-21 22:46:51,005 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
        2014-08-21 22:46:51,005 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
        2014-08-21 22:46:51,005 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
        2014-08-21 22:46:51,005 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
        2014-08-21 22:46:51,006 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:336)
        2014-08-21 22:46:51,006 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:158)
        2014-08-21 22:46:51,006 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:156)
        2014-08-21 22:46:51,006 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:129)
        2014-08-21 22:46:51,006 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
        2014-08-21 22:46:51,007 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.io.BufferedInputStream.read(BufferedInputStream.java:237)
        2014-08-21 22:46:51,007 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.io.DataInputStream.readShort(DataInputStream.java:295)
        2014-08-21 22:46:51,007 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:51)
        2014-08-21 22:46:51,007 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:198)
        2014-08-21 22:46:51,007 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.lang.Thread.run(Thread.java:662)
        2014-08-21 22:46:51,008 INFO  [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - pool-67-thread-8
        2014-08-21 22:46:51,008 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.misc.Unsafe.park(Native Method)
        2014-08-21 22:46:51,008 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)
        2014-08-21 22:46:51,008 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
        2014-08-21 22:46:51,008 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
        2014-08-21 22:46:51,008 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
        2014-08-21 22:46:51,009 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
        2014-08-21 22:46:51,009 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
        2014-08-21 22:46:51,009 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
        2014-08-21 22:46:51,009 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.lang.Thread.run(Thread.java:662)
        2014-08-21 22:46:51,009 INFO  [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - DataXceiver for client DFSClient_NONMAPREDUCE_-1466515135_8 at /127.0.0.1:34874 [Waiting for operation #4]
        2014-08-21 22:46:51,010 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        2014-08-21 22:46:51,010 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
        2014-08-21 22:46:51,010 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
        2014-08-21 22:46:51,010 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
        2014-08-21 22:46:51,010 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
        2014-08-21 22:46:51,010 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:336)
        2014-08-21 22:46:51,011 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:158)
        2014-08-21 22:46:51,011 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:156)
        2014-08-21 22:46:51,011 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:129)
        2014-08-21 22:46:51,011 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
        2014-08-21 22:46:51,011 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.io.BufferedInputStream.read(BufferedInputStream.java:237)
        2014-08-21 22:46:51,012 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.io.DataInputStream.readShort(DataInputStream.java:295)
        2014-08-21 22:46:51,012 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:51)
        2014-08-21 22:46:51,012 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:198)
        2014-08-21 22:46:51,012 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.lang.Thread.run(Thread.java:662)
        2014-08-21 22:46:51,012 INFO  [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - DataXceiver for client DFSClient_NONMAPREDUCE_-1466515135_8 at /127.0.0.1:43470 [Waiting for operation #22]
        2014-08-21 22:46:51,012 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        2014-08-21 22:46:51,013 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
        2014-08-21 22:46:51,013 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
        2014-08-21 22:46:51,013 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
        2014-08-21 22:46:51,013 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
        2014-08-21 22:46:51,013 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:336)
        2014-08-21 22:46:51,013 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:158)
        2014-08-21 22:46:51,014 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:156)
        2014-08-21 22:46:51,014 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:129)
        2014-08-21 22:46:51,014 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
        2014-08-21 22:46:51,014 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.io.BufferedInputStream.read(BufferedInputStream.java:237)
        2014-08-21 22:46:51,014 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.io.DataInputStream.readShort(DataInputStream.java:295)
        2014-08-21 22:46:51,015 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:51)
        2014-08-21 22:46:51,015 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:198)
        2014-08-21 22:46:51,015 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.lang.Thread.run(Thread.java:662)
        2014-08-21 22:46:51,015 INFO  [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - pool-67-thread-2
        2014-08-21 22:46:51,015 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.misc.Unsafe.park(Native Method)
        2014-08-21 22:46:51,016 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)
        2014-08-21 22:46:51,016 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
        2014-08-21 22:46:51,016 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
        2014-08-21 22:46:51,016 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
        2014-08-21 22:46:51,016 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
        2014-08-21 22:46:51,016 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
        2014-08-21 22:46:51,017 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
        2014-08-21 22:46:51,017 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.lang.Thread.run(Thread.java:662)
        2014-08-21 22:46:51,017 INFO  [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - pool-67-thread-1
        2014-08-21 22:46:51,017 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.misc.Unsafe.park(Native Method)
        2014-08-21 22:46:51,017 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)
        2014-08-21 22:46:51,017 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
        2014-08-21 22:46:51,018 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
        2014-08-21 22:46:51,018 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
        2014-08-21 22:46:51,018 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
        2014-08-21 22:46:51,018 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
        2014-08-21 22:46:51,018 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
        2014-08-21 22:46:51,018 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.lang.Thread.run(Thread.java:662)
        2014-08-21 22:46:51,019 INFO  [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - pool-67-thread-6
        2014-08-21 22:46:51,019 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.misc.Unsafe.park(Native Method)
        2014-08-21 22:46:51,019 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)
        2014-08-21 22:46:51,019 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
        2014-08-21 22:46:51,019 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
        2014-08-21 22:46:51,019 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
        2014-08-21 22:46:51,020 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
        2014-08-21 22:46:51,020 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
        2014-08-21 22:46:51,020 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
        2014-08-21 22:46:51,020 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.lang.Thread.run(Thread.java:662)
        2014-08-21 22:46:51,020 INFO  [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - hbase-tablepool-123-thread-2
        2014-08-21 22:46:51,020 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.misc.Unsafe.park(Native Method)
        2014-08-21 22:46:51,021 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
        2014-08-21 22:46:51,021 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:424)
        2014-08-21 22:46:51,021 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323)
        2014-08-21 22:46:51,021 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:874)
        2014-08-21 22:46:51,021 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
        2014-08-21 22:46:51,022 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
        2014-08-21 22:46:51,022 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.lang.Thread.run(Thread.java:662)
        2014-08-21 22:46:51,022 INFO  [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - pool-67-thread-7
        2014-08-21 22:46:51,022 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.misc.Unsafe.park(Native Method)
        2014-08-21 22:46:51,022 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)
        2014-08-21 22:46:51,022 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
        2014-08-21 22:46:51,023 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
        2014-08-21 22:46:51,023 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
        2014-08-21 22:46:51,023 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
        2014-08-21 22:46:51,023 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
        2014-08-21 22:46:51,023 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
        2014-08-21 22:46:51,023 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.lang.Thread.run(Thread.java:662)
        2014-08-21 22:46:51,024 INFO  [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - hbase-tablepool-123-thread-3
        2014-08-21 22:46:51,024 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.misc.Unsafe.park(Native Method)
        2014-08-21 22:46:51,024 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
        2014-08-21 22:46:51,024 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:424)
        2014-08-21 22:46:51,024 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323)
        2014-08-21 22:46:51,025 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:874)
        2014-08-21 22:46:51,025 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
        2014-08-21 22:46:51,025 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
        2014-08-21 22:46:51,025 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.lang.Thread.run(Thread.java:662)
        2014-08-21 22:46:51,025 INFO  [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - DataXceiver for client DFSClient_NONMAPREDUCE_-1466515135_8 at /127.0.0.1:55621 [Waiting for operation #2]
        2014-08-21 22:46:51,025 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        2014-08-21 22:46:51,026 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
        2014-08-21 22:46:51,026 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
        2014-08-21 22:46:51,026 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
        2014-08-21 22:46:51,026 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
        2014-08-21 22:46:51,026 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:336)
        2014-08-21 22:46:51,026 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:158)
        2014-08-21 22:46:51,027 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:156)
        2014-08-21 22:46:51,027 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:129)
        2014-08-21 22:46:51,027 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
        2014-08-21 22:46:51,027 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.io.BufferedInputStream.read(BufferedInputStream.java:237)
        2014-08-21 22:46:51,027 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.io.DataInputStream.readShort(DataInputStream.java:295)
        2014-08-21 22:46:51,028 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:51)
        2014-08-21 22:46:51,028 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:198)
        2014-08-21 22:46:51,028 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.lang.Thread.run(Thread.java:662)
        2014-08-21 22:46:51,028 INFO  [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - DataXceiver for client DFSClient_NONMAPREDUCE_-1466515135_8 at /127.0.0.1:55531 [Waiting for operation #15]
        2014-08-21 22:46:51,028 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        2014-08-21 22:46:51,028 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
        2014-08-21 22:46:51,029 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
        2014-08-21 22:46:51,029 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
        2014-08-21 22:46:51,029 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
        2014-08-21 22:46:51,029 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:336)
        2014-08-21 22:46:51,029 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:158)
        2014-08-21 22:46:51,030 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:156)
        2014-08-21 22:46:51,030 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:129)
        2014-08-21 22:46:51,030 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
        2014-08-21 22:46:51,030 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.io.BufferedInputStream.read(BufferedInputStream.java:237)
        2014-08-21 22:46:51,030 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.io.DataInputStream.readShort(DataInputStream.java:295)
        2014-08-21 22:46:51,030 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:51)
        2014-08-21 22:46:51,031 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:198)
        2014-08-21 22:46:51,031 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.lang.Thread.run(Thread.java:662)
        2014-08-21 22:46:51,031 INFO  [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - pool-67-thread-10
        2014-08-21 22:46:51,031 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.misc.Unsafe.park(Native Method)
        2014-08-21 22:46:51,031 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)
        2014-08-21 22:46:51,032 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
        2014-08-21 22:46:51,032 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
        2014-08-21 22:46:51,032 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
        2014-08-21 22:46:51,032 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
        2014-08-21 22:46:51,032 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
        2014-08-21 22:46:51,032 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
        2014-08-21 22:46:51,033 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.lang.Thread.run(Thread.java:662)
        2014-08-21 22:46:51,033 INFO  [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - hbase-tablepool-123-thread-1
        2014-08-21 22:46:51,033 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.misc.Unsafe.park(Native Method)
        2014-08-21 22:46:51,033 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
        2014-08-21 22:46:51,033 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:424)
        2014-08-21 22:46:51,034 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323)
        2014-08-21 22:46:51,034 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:874)
        2014-08-21 22:46:51,034 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
        2014-08-21 22:46:51,034 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
        2014-08-21 22:46:51,034 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.lang.Thread.run(Thread.java:662)
        2014-08-21 22:46:51,034 INFO  [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - DataXceiver for client DFSClient_NONMAPREDUCE_-1466515135_8 at /127.0.0.1:34859 [Waiting for operation #5]
        2014-08-21 22:46:51,035 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        2014-08-21 22:46:51,035 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
        2014-08-21 22:46:51,035 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
        2014-08-21 22:46:51,035 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
        2014-08-21 22:46:51,035 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
        2014-08-21 22:46:51,035 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:336)
        2014-08-21 22:46:51,036 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:158)
        2014-08-21 22:46:51,036 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:156)
        2014-08-21 22:46:51,036 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:129)
        2014-08-21 22:46:51,036 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
        2014-08-21 22:46:51,036 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.io.BufferedInputStream.read(BufferedInputStream.java:237)
        2014-08-21 22:46:51,037 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.io.DataInputStream.readShort(DataInputStream.java:295)
        2014-08-21 22:46:51,037 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:51)
        2014-08-21 22:46:51,037 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:198)
        2014-08-21 22:46:51,037 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.lang.Thread.run(Thread.java:662)
        2014-08-21 22:46:51,037 INFO  [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - pool-67-thread-5
        2014-08-21 22:46:51,037 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.misc.Unsafe.park(Native Method)
        2014-08-21 22:46:51,038 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)
        2014-08-21 22:46:51,038 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
        2014-08-21 22:46:51,038 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
        2014-08-21 22:46:51,038 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
        2014-08-21 22:46:51,038 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
        2014-08-21 22:46:51,038 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
        2014-08-21 22:46:51,039 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
        2014-08-21 22:46:51,039 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.lang.Thread.run(Thread.java:662)
        2014-08-21 22:46:51,039 INFO  [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - pool-67-thread-4
        2014-08-21 22:46:51,039 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	sun.misc.Unsafe.park(Native Method)
        2014-08-21 22:46:51,039 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)
        2014-08-21 22:46:51,040 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
        2014-08-21 22:46:51,040 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
        2014-08-21 22:46:51,040 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
        2014-08-21 22:46:51,040 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
        2014-08-21 22:46:51,040 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
        2014-08-21 22:46:51,040 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
        2014-08-21 22:46:51,041 INFO  [pool-1-thread-1] hbase.ResourceChecker(185): 	java.lang.Thread.run(Thread.java:662)
        
        Show
        stack added a comment - Happened again on our internal rig. Regression org.apache.hadoop.hbase.util.TestHBaseFsck.testQuarantineMissingHFile Failing for the past 1 build (Since Failed#700 ) Took 21 ms. add description Error Message expected:<2> but was:<1> Stacktrace java.lang.AssertionError: expected:<2> but was:<1> at org.junit.Assert.fail(Assert.java:88) at org.junit.Assert.failNotEquals(Assert.java:743) at org.junit.Assert.assertEquals(Assert.java:118) at org.junit.Assert.assertEquals(Assert.java:555) at org.junit.Assert.assertEquals(Assert.java:542) at org.apache.hadoop.hbase.util.TestHBaseFsck.doQuarantineTest(TestHBaseFsck.java:1681) at org.apache.hadoop.hbase.util.TestHBaseFsck.testQuarantineMissingHFile(TestHBaseFsck.java:1723) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74) Standard Output Allow checking/fixes for table: testQuarantineMissingHFile Checked 4 hfile for corruption HFiles corrupted: 0 HFiles successfully quarantined: 0 HFiles failed quarantine: 0 HFiles moved while checking: 2 hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/fam/92484a47b8f14c338314b70c98ebc0dc hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/fam/e81f27e4ffbf435cb38dca815be340e8 Summary: OK => OK Version: 0.94.15-cdh4.8.0-SNAPSHOT ---- Table '-ROOT-': region split map : [ { meta => null , hdfs => hdfs: //localhost:58811/user/jenkins/hbase/-ROOT-/70236052, deployed => }, ] null : ---- Table '-ROOT-': overlap groups There are 0 overlap groups with 0 overlapping regions ---- Table '.META.': region split map : [ { meta => null , hdfs => hdfs: //localhost:58811/user/jenkins/hbase/.META./1028785192, deployed => }, ] null : ---- Table '.META.': overlap groups There are 0 overlap groups with 0 overlapping regions ---- Table 'testQuarantineMissingHFile': region split map : [ { meta => null , hdfs => hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372, deployed => }, A] A: [ { meta => null , hdfs => hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5, deployed => }, B] B: [ { meta => null , hdfs => hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212, deployed => }, C] C: [ { meta => null , hdfs => hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214, deployed => }, ] null : ---- Table 'testQuarantineMissingHFile': overlap groups There are 0 overlap groups with 0 overlapping regions Number of Tables: 0 Number of Tables in flux: 2 Number of live region servers: 3 p0420.sjc.cloudera.com,60875,1408686379690 p0420.sjc.cloudera.com,54158,1408686379607 p0420.sjc.cloudera.com,56883,1408686379653 Number of dead region servers: 0 Master: p0420.sjc.cloudera.com,37883,1408686379181 Number of backup masters: 0 RegionServer: p0420.sjc.cloudera.com,54158,1408686379607 number of regions: 0 RegionServer: p0420.sjc.cloudera.com,56883,1408686379653 number of regions: 0 RegionServer: p0420.sjc.cloudera.com,60875,1408686379690 number of regions: 2 -ROOT-,,0.70236052 id: 0 encoded_name: 70236052 start: end: .META.,,1.1028785192 id: 1 encoded_name: 1028785192 start: end: Number of empty REGIONINFO_QUALIFIER rows in .META.: 0 ---- Table '-ROOT-': region split map : [ { meta => -ROOT-,,0.70236052, hdfs => hdfs: //localhost:58811/user/jenkins/hbase/-ROOT-/70236052, deployed => p0420.sjc.cloudera.com,60875,1408686379690;-ROOT-,,0.70236052 }, ] null : ---- Table '-ROOT-': overlap groups There are 0 overlap groups with 0 overlapping regions ---- Table '.META.': region split map : [ { meta => .META.,,1.1028785192, hdfs => hdfs: //localhost:58811/user/jenkins/hbase/.META./1028785192, deployed => p0420.sjc.cloudera.com,60875,1408686379690;.META.,,1.1028785192 }, ] null : ---- Table '.META.': overlap groups There are 0 overlap groups with 0 overlapping regions Summary: -ROOT- is okay. Number of regions: 1 Deployed on: p0420.sjc.cloudera.com,60875,1408686379690 .META. is okay. Number of regions: 1 Deployed on: p0420.sjc.cloudera.com,60875,1408686379690 0 inconsistencies detected. Status: OK Standard Error 2014-08-21 22:46:46,684 INFO [pool-1-thread-1] hbase.ResourceChecker(157): before util.TestHBaseFsck#testQuarantineMissingHFile: 385 threads, 600 file descriptors 5 connections, 2014-08-21 22:46:46,711 DEBUG [IPC Server handler 4 on 37883] client.ClientScanner(90): Creating scanner over .META. starting at key 'testQuarantineMissingHFile,,' 2014-08-21 22:46:46,712 DEBUG [IPC Server handler 4 on 37883] client.ClientScanner(203): Advancing internal scanner to startKey at 'testQuarantineMissingHFile,,' 2014-08-21 22:46:46,714 DEBUG [IPC Server handler 4 on 37883] client.ClientScanner(190): Finished with scanning at {NAME => '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED => 1028785192,} 2014-08-21 22:46:46,757 INFO [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.CreateTableHandler(126): Attempting to create the table testQuarantineMissingHFile 2014-08-21 22:46:46,759 DEBUG [ Thread -609] client.MetaScanner(182): Scanning .META. starting at row=testQuarantineMissingHFile,,00000000000000 for max=2147483647 rows using org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 2014-08-21 22:46:46,795 INFO [IPC Server handler 0 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40206 is added to blk_7267598665009752386_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:40670|RBW], ReplicaUnderConstruction[127.0.0.1:34823|RBW], ReplicaUnderConstruction[127.0.0.1:40206|RBW]]} size 0 2014-08-21 22:46:46,796 INFO [IPC Server handler 7 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34823 is added to blk_7267598665009752386_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:40670|RBW], ReplicaUnderConstruction[127.0.0.1:34823|RBW], ReplicaUnderConstruction[127.0.0.1:40206|RBW]]} size 0 2014-08-21 22:46:46,797 INFO [IPC Server handler 5 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40670 is added to blk_7267598665009752386_1086 size 707 2014-08-21 22:46:46,844 INFO [RegionOpenAndInitThread-testQuarantineMissingHFile-1] regionserver.HRegion(4341): creating HRegion testQuarantineMissingHFile HTD == 'testQuarantineMissingHFile', {NAME => 'fam', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '3', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => '2147483647', KEEP_DELETED_CELLS => ' false ', BLOCKSIZE => '65536', IN_MEMORY => ' false ', ENCODE_ON_DISK => ' true ', BLOCKCACHE => ' true '} RootDir = hdfs: //localhost:58811/user/jenkins/hbase/.tmp Table name == testQuarantineMissingHFile 2014-08-21 22:46:46,845 INFO [RegionOpenAndInitThread-testQuarantineMissingHFile-3] regionserver.HRegion(4341): creating HRegion testQuarantineMissingHFile HTD == 'testQuarantineMissingHFile', {NAME => 'fam', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '3', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => '2147483647', KEEP_DELETED_CELLS => ' false ', BLOCKSIZE => '65536', IN_MEMORY => ' false ', ENCODE_ON_DISK => ' true ', BLOCKCACHE => ' true '} RootDir = hdfs: //localhost:58811/user/jenkins/hbase/.tmp Table name == testQuarantineMissingHFile 2014-08-21 22:46:46,845 INFO [RegionOpenAndInitThread-testQuarantineMissingHFile-4] regionserver.HRegion(4341): creating HRegion testQuarantineMissingHFile HTD == 'testQuarantineMissingHFile', {NAME => 'fam', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '3', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => '2147483647', KEEP_DELETED_CELLS => ' false ', BLOCKSIZE => '65536', IN_MEMORY => ' false ', ENCODE_ON_DISK => ' true ', BLOCKCACHE => ' true '} RootDir = hdfs: //localhost:58811/user/jenkins/hbase/.tmp Table name == testQuarantineMissingHFile 2014-08-21 22:46:46,844 INFO [RegionOpenAndInitThread-testQuarantineMissingHFile-2] regionserver.HRegion(4341): creating HRegion testQuarantineMissingHFile HTD == 'testQuarantineMissingHFile', {NAME => 'fam', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '3', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => '2147483647', KEEP_DELETED_CELLS => ' false ', BLOCKSIZE => '65536', IN_MEMORY => ' false ', ENCODE_ON_DISK => ' true ', BLOCKCACHE => ' true '} RootDir = hdfs: //localhost:58811/user/jenkins/hbase/.tmp Table name == testQuarantineMissingHFile 2014-08-21 22:46:46,887 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-1] util.FSUtils(157): Creating file=hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/.tmp/.regioninfo with permission=rwxrwxrwx 2014-08-21 22:46:46,888 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-4] util.FSUtils(157): Creating file=hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/.tmp/.regioninfo with permission=rwxrwxrwx 2014-08-21 22:46:46,896 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-2] util.FSUtils(157): Creating file=hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/.tmp/.regioninfo with permission=rwxrwxrwx 2014-08-21 22:46:46,897 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-3] util.FSUtils(157): Creating file=hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/.tmp/.regioninfo with permission=rwxrwxrwx 2014-08-21 22:46:46,952 INFO [IPC Server handler 6 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40206 is added to blk_1232571622821848185_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:34823|RBW], ReplicaUnderConstruction[127.0.0.1:40670|RBW], ReplicaUnderConstruction[127.0.0.1:40206|RBW]]} size 0 2014-08-21 22:46:46,954 INFO [IPC Server handler 0 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40670 is added to blk_1232571622821848185_1091 size 287 2014-08-21 22:46:46,956 INFO [IPC Server handler 9 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40206 is added to blk_-8586672548042035946_1092{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:34823|RBW], ReplicaUnderConstruction[127.0.0.1:40670|RBW], ReplicaUnderConstruction[127.0.0.1:40206|RBW]]} size 289 2014-08-21 22:46:46,956 INFO [IPC Server handler 2 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34823 is added to blk_1232571622821848185_1091 size 287 2014-08-21 22:46:46,957 INFO [IPC Server handler 4 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40670 is added to blk_-8586672548042035946_1092 size 289 2014-08-21 22:46:46,960 INFO [IPC Server handler 3 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34823 is added to blk_-8586672548042035946_1092 size 289 2014-08-21 22:46:46,963 INFO [IPC Server handler 0 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34823 is added to blk_214010544537184802_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:40206|RBW], ReplicaUnderConstruction[127.0.0.1:34823|RBW], ReplicaUnderConstruction[127.0.0.1:40670|RBW]]} size 0 2014-08-21 22:46:46,964 INFO [IPC Server handler 5 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40206 is added to blk_214010544537184802_1093 size 291 2014-08-21 22:46:46,965 INFO [IPC Server handler 2 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40670 is added to blk_214010544537184802_1093 size 291 2014-08-21 22:46:46,977 INFO [IPC Server handler 5 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40206 is added to blk_4217073309354766419_1094{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:40206|RBW], ReplicaUnderConstruction[127.0.0.1:40670|RBW], ReplicaUnderConstruction[127.0.0.1:34823|RBW]]} size 291 2014-08-21 22:46:46,977 INFO [IPC Server handler 0 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40670 is added to blk_4217073309354766419_1094 size 291 2014-08-21 22:46:46,977 INFO [IPC Server handler 2 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34823 is added to blk_4217073309354766419_1094 size 291 2014-08-21 22:46:47,036 INFO [RegionOpenAndInitThread-testQuarantineMissingHFile-2] regionserver.HRegion(512): Setting up tabledescriptor config now ... 2014-08-21 22:46:47,036 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-2] regionserver.HRegion(506): Instantiated testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. 2014-08-21 22:46:47,036 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-2] regionserver.HRegion(1018): Closing testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.: disabling compactions & flushes 2014-08-21 22:46:47,037 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-2] regionserver.HRegion(1045): Updates disabled for region testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. 2014-08-21 22:46:47,037 INFO [RegionOpenAndInitThread-testQuarantineMissingHFile-2] regionserver.HRegion(1117): Closed testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. 2014-08-21 22:46:47,061 INFO [RegionOpenAndInitThread-testQuarantineMissingHFile-1] regionserver.HRegion(512): Setting up tabledescriptor config now ... 2014-08-21 22:46:47,061 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-1] regionserver.HRegion(506): Instantiated testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. 2014-08-21 22:46:47,061 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-1] regionserver.HRegion(1018): Closing testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.: disabling compactions & flushes 2014-08-21 22:46:47,062 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-1] regionserver.HRegion(1045): Updates disabled for region testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. 2014-08-21 22:46:47,062 INFO [RegionOpenAndInitThread-testQuarantineMissingHFile-1] regionserver.HRegion(1117): Closed testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. 2014-08-21 22:46:47,377 INFO [RegionOpenAndInitThread-testQuarantineMissingHFile-4] regionserver.HRegion(512): Setting up tabledescriptor config now ... 2014-08-21 22:46:47,378 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-4] regionserver.HRegion(506): Instantiated testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. 2014-08-21 22:46:47,378 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-4] regionserver.HRegion(1018): Closing testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.: disabling compactions & flushes 2014-08-21 22:46:47,378 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-4] regionserver.HRegion(1045): Updates disabled for region testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. 2014-08-21 22:46:47,378 INFO [RegionOpenAndInitThread-testQuarantineMissingHFile-4] regionserver.HRegion(1117): Closed testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. 2014-08-21 22:46:47,394 INFO [RegionOpenAndInitThread-testQuarantineMissingHFile-3] regionserver.HRegion(512): Setting up tabledescriptor config now ... 2014-08-21 22:46:47,395 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-3] regionserver.HRegion(506): Instantiated testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. 2014-08-21 22:46:47,395 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-3] regionserver.HRegion(1018): Closing testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.: disabling compactions & flushes 2014-08-21 22:46:47,395 DEBUG [RegionOpenAndInitThread-testQuarantineMissingHFile-3] regionserver.HRegion(1045): Updates disabled for region testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. 2014-08-21 22:46:47,395 INFO [RegionOpenAndInitThread-testQuarantineMissingHFile-3] regionserver.HRegion(1117): Closed testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. 2014-08-21 22:46:47,406 INFO [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] catalog.MetaEditor(199): Added 4 regions in META 2014-08-21 22:46:47,407 INFO [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] master.AssignmentManager(2413): Bulk assigning 4 region(s) round-robin across 3 server(s) 2014-08-21 22:46:47,407 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-StartupBulkAssigner-0] master.AssignmentManager(1440): Bulk assigning 1 region(s) to p0420.sjc.cloudera.com,54158,1408686379607 2014-08-21 22:46:47,407 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-StartupBulkAssigner-1] master.AssignmentManager(1440): Bulk assigning 2 region(s) to p0420.sjc.cloudera.com,56883,1408686379653 2014-08-21 22:46:47,408 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-StartupBulkAssigner-0] zookeeper.ZKAssign(169): master:37883-0x147fc404e830000 Async create of unassigned node for c425f751446d62d8f4a9d9f5d8811214 with OFFLINE state 2014-08-21 22:46:47,408 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-StartupBulkAssigner-1] zookeeper.ZKAssign(169): master:37883-0x147fc404e830000 Async create of unassigned node for 1eeb1332ce0a2f3b96882b0ec1572dc5 with OFFLINE state 2014-08-21 22:46:47,407 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] master.AssignmentManager$StartupBulkAssigner(2549): Timeout-on-RIT=1000 2014-08-21 22:46:47,407 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-StartupBulkAssigner-2] master.AssignmentManager(1440): Bulk assigning 1 region(s) to p0420.sjc.cloudera.com,60875,1408686379690 2014-08-21 22:46:47,408 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-StartupBulkAssigner-1] zookeeper.ZKAssign(169): master:37883-0x147fc404e830000 Async create of unassigned node for 1644a212531c3b43dde748d401c7e212 with OFFLINE state 2014-08-21 22:46:47,408 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-StartupBulkAssigner-2] zookeeper.ZKAssign(169): master:37883-0x147fc404e830000 Async create of unassigned node for a8edbdfb2e9b02881ebc1702752b2372 with OFFLINE state 2014-08-21 22:46:47,416 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/unassigned 2014-08-21 22:46:47,425 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212 and set watcher; region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_OFFLINE 2014-08-21 22:46:47,426 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214 and set watcher; region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_OFFLINE 2014-08-21 22:46:47,426 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 133 byte (s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372 and set watcher; region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_OFFLINE 2014-08-21 22:46:47,427 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5 and set watcher; region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_OFFLINE 2014-08-21 22:46:47,427 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager$CreateUnassignedAsyncCallback(1564): rs=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. state=OFFLINE, ts=1408686407407, server= null , server=p0420.sjc.cloudera.com,54158,1408686379607 2014-08-21 22:46:47,427 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager$CreateUnassignedAsyncCallback(1564): rs=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. state=OFFLINE, ts=1408686407408, server= null , server=p0420.sjc.cloudera.com,56883,1408686379653 2014-08-21 22:46:47,427 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager$CreateUnassignedAsyncCallback(1564): rs=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. state=OFFLINE, ts=1408686407408, server= null , server=p0420.sjc.cloudera.com,56883,1408686379653 2014-08-21 22:46:47,428 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager$CreateUnassignedAsyncCallback(1564): rs=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. state=OFFLINE, ts=1408686407408, server= null , server=p0420.sjc.cloudera.com,60875,1408686379690 2014-08-21 22:46:47,428 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager$ExistsUnassignedAsyncCallback(1604): rs=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. state=OFFLINE, ts=1408686407407, server= null 2014-08-21 22:46:47,428 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager$ExistsUnassignedAsyncCallback(1604): rs=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. state=OFFLINE, ts=1408686407408, server= null 2014-08-21 22:46:47,428 INFO [p0420.sjc.cloudera.com,37883,1408686379181-StartupBulkAssigner-0] master.AssignmentManager(1473): p0420.sjc.cloudera.com,54158,1408686379607 outstanding calls=1 of total=1 2014-08-21 22:46:47,428 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager$ExistsUnassignedAsyncCallback(1604): rs=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. state=OFFLINE, ts=1408686407408, server= null 2014-08-21 22:46:47,428 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager$ExistsUnassignedAsyncCallback(1604): rs=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. state=OFFLINE, ts=1408686407408, server= null 2014-08-21 22:46:47,429 INFO [p0420.sjc.cloudera.com,37883,1408686379181-StartupBulkAssigner-1] master.AssignmentManager(1473): p0420.sjc.cloudera.com,56883,1408686379653 outstanding calls=2 of total=2 2014-08-21 22:46:47,429 INFO [PRI IPC Server handler 1 on 54158] regionserver.HRegionServer(3158): Received request to open 1 region(s) 2014-08-21 22:46:47,429 INFO [PRI IPC Server handler 1 on 54158] regionserver.HRegionServer(3056): Received request to open region: testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. 2014-08-21 22:46:47,429 INFO [p0420.sjc.cloudera.com,37883,1408686379181-StartupBulkAssigner-2] master.AssignmentManager(1473): p0420.sjc.cloudera.com,60875,1408686379690 outstanding calls=1 of total=1 2014-08-21 22:46:47,429 INFO [PRI IPC Server handler 3 on 56883] regionserver.HRegionServer(3158): Received request to open 2 region(s) 2014-08-21 22:46:47,429 INFO [PRI IPC Server handler 1 on 60875] regionserver.HRegionServer(3158): Received request to open 1 region(s) 2014-08-21 22:46:47,430 INFO [PRI IPC Server handler 3 on 56883] regionserver.HRegionServer(3056): Received request to open region: testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. 2014-08-21 22:46:47,430 INFO [PRI IPC Server handler 1 on 60875] regionserver.HRegionServer(3056): Received request to open region: testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. 2014-08-21 22:46:47,436 DEBUG [PRI IPC Server handler 1 on 54158] zookeeper.ZKAssign(757): regionserver:54158-0x147fc404e830001 Attempting to transition node c425f751446d62d8f4a9d9f5d8811214 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-08-21 22:46:47,436 DEBUG [PRI IPC Server handler 3 on 56883] zookeeper.ZKAssign(757): regionserver:56883-0x147fc404e830002 Attempting to transition node 1eeb1332ce0a2f3b96882b0ec1572dc5 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-08-21 22:46:47,437 DEBUG [PRI IPC Server handler 1 on 54158] zookeeper.ZKUtil(1599): regionserver:54158-0x147fc404e830001 Retrieved 134 byte (s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214; data=region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_OFFLINE 2014-08-21 22:46:47,437 DEBUG [PRI IPC Server handler 3 on 56883] zookeeper.ZKUtil(1599): regionserver:56883-0x147fc404e830002 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5; data=region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_OFFLINE 2014-08-21 22:46:47,441 DEBUG [PRI IPC Server handler 1 on 54158] zookeeper.ZKAssign(820): regionserver:54158-0x147fc404e830001 Successfully transitioned node c425f751446d62d8f4a9d9f5d8811214 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-08-21 22:46:47,441 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214 2014-08-21 22:46:47,441 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] regionserver.HRegion(4413): Opening region: {NAME => 'testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.', STARTKEY => 'C', ENDKEY => '', ENCODED => c425f751446d62d8f4a9d9f5d8811214,} 2014-08-21 22:46:47,441 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-StartupBulkAssigner-0] master.AssignmentManager(1525): Bulk assigning done for p0420.sjc.cloudera.com,54158,1408686379607 2014-08-21 22:46:47,442 INFO [RS_OPEN_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] regionserver.HRegion(512): Setting up tabledescriptor config now ... 2014-08-21 22:46:47,442 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] regionserver.HRegion(506): Instantiated testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. 2014-08-21 22:46:47,443 DEBUG [PRI IPC Server handler 1 on 60875] zookeeper.ZKAssign(757): regionserver:60875-0x147fc404e830003 Attempting to transition node a8edbdfb2e9b02881ebc1702752b2372 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-08-21 22:46:47,449 DEBUG [PRI IPC Server handler 3 on 56883] zookeeper.ZKAssign(820): regionserver:56883-0x147fc404e830002 Successfully transitioned node 1eeb1332ce0a2f3b96882b0ec1572dc5 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-08-21 22:46:47,449 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214 and set watcher; region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,54158,1408686379607, state=RS_ZK_REGION_OPENING 2014-08-21 22:46:47,449 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] regionserver.HRegion(4413): Opening region: {NAME => 'testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.', STARTKEY => 'A', ENDKEY => 'B', ENCODED => 1eeb1332ce0a2f3b96882b0ec1572dc5,} 2014-08-21 22:46:47,450 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_OPENING, server=p0420.sjc.cloudera.com,54158,1408686379607, region=c425f751446d62d8f4a9d9f5d8811214 2014-08-21 22:46:47,449 INFO [PRI IPC Server handler 3 on 56883] regionserver.HRegionServer(3056): Received request to open region: testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. 2014-08-21 22:46:47,449 DEBUG [PRI IPC Server handler 1 on 60875] zookeeper.ZKUtil(1599): regionserver:60875-0x147fc404e830003 Retrieved 133 byte (s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372; data=region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_OFFLINE 2014-08-21 22:46:47,450 DEBUG [PRI IPC Server handler 3 on 56883] zookeeper.ZKAssign(757): regionserver:56883-0x147fc404e830002 Attempting to transition node 1644a212531c3b43dde748d401c7e212 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-08-21 22:46:47,450 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5 2014-08-21 22:46:47,450 INFO [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] regionserver.HRegion(512): Setting up tabledescriptor config now ... 2014-08-21 22:46:47,451 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] regionserver.HRegion(506): Instantiated testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. 2014-08-21 22:46:47,477 INFO [StoreOpenerThread-testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.-1] regionserver.Store(227): time to purge deletes set to 0ms in store fam 2014-08-21 22:46:47,478 INFO [StoreOpenerThread-testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.-1] regionserver.Store(237): hbase.hstore.compaction.min = 3 2014-08-21 22:46:47,482 INFO [RS_OPEN_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] regionserver.HRegion(667): Onlined testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.; next sequenceid=1 2014-08-21 22:46:47,482 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] zookeeper.ZKAssign(757): regionserver:54158-0x147fc404e830001 Attempting to transition node c425f751446d62d8f4a9d9f5d8811214 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENING 2014-08-21 22:46:47,487 DEBUG [PRI IPC Server handler 1 on 60875] zookeeper.ZKAssign(820): regionserver:60875-0x147fc404e830003 Successfully transitioned node a8edbdfb2e9b02881ebc1702752b2372 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-08-21 22:46:47,488 DEBUG [PRI IPC Server handler 3 on 56883] zookeeper.ZKUtil(1599): regionserver:56883-0x147fc404e830002 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212; data=region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_OFFLINE 2014-08-21 22:46:47,488 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] zookeeper.ZKUtil(1599): regionserver:54158-0x147fc404e830001 Retrieved 134 byte (s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214; data=region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,54158,1408686379607, state=RS_ZK_REGION_OPENING 2014-08-21 22:46:47,488 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] regionserver.HRegion(4413): Opening region: {NAME => 'testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.', STARTKEY => '', ENDKEY => 'A', ENCODED => a8edbdfb2e9b02881ebc1702752b2372,} 2014-08-21 22:46:47,488 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-StartupBulkAssigner-2] master.AssignmentManager(1525): Bulk assigning done for p0420.sjc.cloudera.com,60875,1408686379690 2014-08-21 22:46:47,488 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5 and set watcher; region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENING 2014-08-21 22:46:47,489 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_OPENING, server=p0420.sjc.cloudera.com,56883,1408686379653, region=1eeb1332ce0a2f3b96882b0ec1572dc5 2014-08-21 22:46:47,489 INFO [RS_OPEN_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] regionserver.HRegion(512): Setting up tabledescriptor config now ... 2014-08-21 22:46:47,489 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372 2014-08-21 22:46:47,489 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] regionserver.HRegion(506): Instantiated testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. 2014-08-21 22:46:47,507 DEBUG [PRI IPC Server handler 3 on 56883] zookeeper.ZKAssign(820): regionserver:56883-0x147fc404e830002 Successfully transitioned node 1644a212531c3b43dde748d401c7e212 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-08-21 22:46:47,508 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-StartupBulkAssigner-1] master.AssignmentManager(1525): Bulk assigning done for p0420.sjc.cloudera.com,56883,1408686379653 2014-08-21 22:46:47,508 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] regionserver.HRegion(4413): Opening region: {NAME => 'testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.', STARTKEY => 'B', ENDKEY => 'C', ENCODED => 1644a212531c3b43dde748d401c7e212,} 2014-08-21 22:46:47,509 INFO [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] regionserver.HRegion(512): Setting up tabledescriptor config now ... 2014-08-21 22:46:47,510 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] regionserver.HRegion(506): Instantiated testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. 2014-08-21 22:46:47,516 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] zookeeper.ZKAssign(820): regionserver:54158-0x147fc404e830001 Successfully transitioned node c425f751446d62d8f4a9d9f5d8811214 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENING 2014-08-21 22:46:47,516 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 133 byte (s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372 and set watcher; region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,60875,1408686379690, state=RS_ZK_REGION_OPENING 2014-08-21 22:46:47,516 INFO [PostOpenDeployTasks:c425f751446d62d8f4a9d9f5d8811214] regionserver.HRegionServer(1849): Post open deploy tasks for region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., daughter= false 2014-08-21 22:46:47,516 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_OPENING, server=p0420.sjc.cloudera.com,60875,1408686379690, region=a8edbdfb2e9b02881ebc1702752b2372 2014-08-21 22:46:47,517 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/1644a212531c3b43dde748d401c7e212 2014-08-21 22:46:47,517 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212 and set watcher; region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENING 2014-08-21 22:46:47,518 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_OPENING, server=p0420.sjc.cloudera.com,56883,1408686379653, region=1644a212531c3b43dde748d401c7e212 2014-08-21 22:46:47,518 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214 2014-08-21 22:46:47,518 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214 and set watcher; region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,54158,1408686379607, state=RS_ZK_REGION_OPENING 2014-08-21 22:46:47,519 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_OPENING, server=p0420.sjc.cloudera.com,54158,1408686379607, region=c425f751446d62d8f4a9d9f5d8811214 2014-08-21 22:46:47,520 INFO [PostOpenDeployTasks:c425f751446d62d8f4a9d9f5d8811214] catalog.MetaEditor(297): Updated row testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. with server=p0420.sjc.cloudera.com,54158,1408686379607 2014-08-21 22:46:47,521 INFO [PostOpenDeployTasks:c425f751446d62d8f4a9d9f5d8811214] regionserver.HRegionServer(1874): Done with post open deploy task for region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., daughter= false 2014-08-21 22:46:47,525 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] zookeeper.ZKAssign(757): regionserver:54158-0x147fc404e830001 Attempting to transition node c425f751446d62d8f4a9d9f5d8811214 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-08-21 22:46:47,526 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] zookeeper.ZKUtil(1599): regionserver:54158-0x147fc404e830001 Retrieved 134 byte (s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214; data=region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,54158,1408686379607, state=RS_ZK_REGION_OPENING 2014-08-21 22:46:47,527 INFO [StoreOpenerThread-testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.-1] regionserver.Store(227): time to purge deletes set to 0ms in store fam 2014-08-21 22:46:47,527 INFO [StoreOpenerThread-testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.-1] regionserver.Store(237): hbase.hstore.compaction.min = 3 2014-08-21 22:46:47,532 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] zookeeper.ZKAssign(820): regionserver:54158-0x147fc404e830001 Successfully transitioned node c425f751446d62d8f4a9d9f5d8811214 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-08-21 22:46:47,532 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214 2014-08-21 22:46:47,533 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] handler.OpenRegionHandler(287): region transitioned to opened in zookeeper: {NAME => 'testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.', STARTKEY => 'C', ENDKEY => '', ENCODED => c425f751446d62d8f4a9d9f5d8811214,}, server: p0420.sjc.cloudera.com,54158,1408686379607 2014-08-21 22:46:47,533 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] handler.OpenRegionHandler(138): Opened testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. on server:p0420.sjc.cloudera.com,54158,1408686379607 2014-08-21 22:46:47,534 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214 and set watcher; region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,54158,1408686379607, state=RS_ZK_REGION_OPENED 2014-08-21 22:46:47,534 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_OPENED, server=p0420.sjc.cloudera.com,54158,1408686379607, region=c425f751446d62d8f4a9d9f5d8811214 2014-08-21 22:46:47,534 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.OpenedRegionHandler(147): Handling OPENED event for testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. from p0420.sjc.cloudera.com,54158,1408686379607; deleting unassigned node 2014-08-21 22:46:47,534 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-0] zookeeper.ZKAssign(483): master:37883-0x147fc404e830000 Deleting existing unassigned node for c425f751446d62d8f4a9d9f5d8811214 that is in expected state RS_ZK_REGION_OPENED 2014-08-21 22:46:47,535 INFO [StoreOpenerThread-testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.-1] regionserver.Store(227): time to purge deletes set to 0ms in store fam 2014-08-21 22:46:47,535 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-0] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214; data=region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,54158,1408686379607, state=RS_ZK_REGION_OPENED 2014-08-21 22:46:47,536 INFO [StoreOpenerThread-testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.-1] regionserver.Store(237): hbase.hstore.compaction.min = 3 2014-08-21 22:46:47,540 INFO [RS_OPEN_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] regionserver.HRegion(667): Onlined testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.; next sequenceid=1 2014-08-21 22:46:47,540 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] zookeeper.ZKAssign(757): regionserver:60875-0x147fc404e830003 Attempting to transition node a8edbdfb2e9b02881ebc1702752b2372 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENING 2014-08-21 22:46:47,549 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214 2014-08-21 22:46:47,549 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-0] zookeeper.ZKAssign(512): master:37883-0x147fc404e830000 Successfully deleted unassigned node for region c425f751446d62d8f4a9d9f5d8811214 in expected state RS_ZK_REGION_OPENED 2014-08-21 22:46:47,549 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] zookeeper.ZKUtil(1599): regionserver:60875-0x147fc404e830003 Retrieved 133 byte (s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372; data=region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,60875,1408686379690, state=RS_ZK_REGION_OPENING 2014-08-21 22:46:47,549 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(1176): The znode of region testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. has been deleted. 2014-08-21 22:46:47,550 INFO [pool-1-thread-1-EventThread] master.AssignmentManager(1188): The master has opened the region testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. that was online on p0420.sjc.cloudera.com,54158,1408686379607 2014-08-21 22:46:47,550 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/unassigned 2014-08-21 22:46:47,557 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] zookeeper.ZKAssign(820): regionserver:60875-0x147fc404e830003 Successfully transitioned node a8edbdfb2e9b02881ebc1702752b2372 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENING 2014-08-21 22:46:47,558 INFO [PostOpenDeployTasks:a8edbdfb2e9b02881ebc1702752b2372] regionserver.HRegionServer(1849): Post open deploy tasks for region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., daughter= false 2014-08-21 22:46:47,558 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212 and set watcher; region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENING 2014-08-21 22:46:47,559 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 133 byte (s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372 and set watcher; region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,60875,1408686379690, state=RS_ZK_REGION_OPENING 2014-08-21 22:46:47,560 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5 and set watcher; region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENING 2014-08-21 22:46:47,560 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372 2014-08-21 22:46:47,561 INFO [StoreOpenerThread-testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.-1] regionserver.Store(227): time to purge deletes set to 0ms in store fam 2014-08-21 22:46:47,561 INFO [StoreOpenerThread-testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.-1] regionserver.Store(237): hbase.hstore.compaction.min = 3 2014-08-21 22:46:47,561 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 133 byte (s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372 and set watcher; region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,60875,1408686379690, state=RS_ZK_REGION_OPENING 2014-08-21 22:46:47,562 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_OPENING, server=p0420.sjc.cloudera.com,60875,1408686379690, region=a8edbdfb2e9b02881ebc1702752b2372 2014-08-21 22:46:47,562 INFO [PostOpenDeployTasks:a8edbdfb2e9b02881ebc1702752b2372] catalog.MetaEditor(297): Updated row testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. with server=p0420.sjc.cloudera.com,60875,1408686379690 2014-08-21 22:46:47,562 INFO [PostOpenDeployTasks:a8edbdfb2e9b02881ebc1702752b2372] regionserver.HRegionServer(1874): Done with post open deploy task for region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., daughter= false 2014-08-21 22:46:47,562 INFO [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] regionserver.HRegion(667): Onlined testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.; next sequenceid=1 2014-08-21 22:46:47,562 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] zookeeper.ZKAssign(757): regionserver:60875-0x147fc404e830003 Attempting to transition node a8edbdfb2e9b02881ebc1702752b2372 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-08-21 22:46:47,563 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] zookeeper.ZKAssign(757): regionserver:56883-0x147fc404e830002 Attempting to transition node 1eeb1332ce0a2f3b96882b0ec1572dc5 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENING 2014-08-21 22:46:47,564 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] zookeeper.ZKUtil(1599): regionserver:60875-0x147fc404e830003 Retrieved 133 byte (s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372; data=region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,60875,1408686379690, state=RS_ZK_REGION_OPENING 2014-08-21 22:46:47,565 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] zookeeper.ZKUtil(1599): regionserver:56883-0x147fc404e830002 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5; data=region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENING 2014-08-21 22:46:47,565 INFO [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] regionserver.HRegion(667): Onlined testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.; next sequenceid=1 2014-08-21 22:46:47,565 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] zookeeper.ZKAssign(757): regionserver:56883-0x147fc404e830002 Attempting to transition node 1644a212531c3b43dde748d401c7e212 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENING 2014-08-21 22:46:47,574 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372 2014-08-21 22:46:47,574 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] zookeeper.ZKAssign(820): regionserver:60875-0x147fc404e830003 Successfully transitioned node a8edbdfb2e9b02881ebc1702752b2372 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-08-21 22:46:47,574 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] handler.OpenRegionHandler(287): region transitioned to opened in zookeeper: {NAME => 'testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.', STARTKEY => '', ENDKEY => 'A', ENCODED => a8edbdfb2e9b02881ebc1702752b2372,}, server: p0420.sjc.cloudera.com,60875,1408686379690 2014-08-21 22:46:47,575 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] handler.OpenRegionHandler(138): Opened testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. on server:p0420.sjc.cloudera.com,60875,1408686379690 2014-08-21 22:46:47,608 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 133 byte (s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372 and set watcher; region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,60875,1408686379690, state=RS_ZK_REGION_OPENED 2014-08-21 22:46:47,608 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] zookeeper.ZKAssign(820): regionserver:56883-0x147fc404e830002 Successfully transitioned node 1eeb1332ce0a2f3b96882b0ec1572dc5 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENING 2014-08-21 22:46:47,608 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_OPENED, server=p0420.sjc.cloudera.com,60875,1408686379690, region=a8edbdfb2e9b02881ebc1702752b2372 2014-08-21 22:46:47,608 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] zookeeper.ZKUtil(1599): regionserver:56883-0x147fc404e830002 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212; data=region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENING 2014-08-21 22:46:47,608 INFO [PostOpenDeployTasks:1eeb1332ce0a2f3b96882b0ec1572dc5] regionserver.HRegionServer(1849): Post open deploy tasks for region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., daughter= false 2014-08-21 22:46:47,608 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-1] handler.OpenedRegionHandler(147): Handling OPENED event for testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. from p0420.sjc.cloudera.com,60875,1408686379690; deleting unassigned node 2014-08-21 22:46:47,608 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5 2014-08-21 22:46:47,609 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-1] zookeeper.ZKAssign(483): master:37883-0x147fc404e830000 Deleting existing unassigned node for a8edbdfb2e9b02881ebc1702752b2372 that is in expected state RS_ZK_REGION_OPENED 2014-08-21 22:46:47,612 INFO [PostOpenDeployTasks:1eeb1332ce0a2f3b96882b0ec1572dc5] catalog.MetaEditor(297): Updated row testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. with server=p0420.sjc.cloudera.com,56883,1408686379653 2014-08-21 22:46:47,612 INFO [PostOpenDeployTasks:1eeb1332ce0a2f3b96882b0ec1572dc5] regionserver.HRegionServer(1874): Done with post open deploy task for region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., daughter= false 2014-08-21 22:46:47,612 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] zookeeper.ZKAssign(757): regionserver:56883-0x147fc404e830002 Attempting to transition node 1eeb1332ce0a2f3b96882b0ec1572dc5 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-08-21 22:46:47,616 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] zookeeper.ZKAssign(820): regionserver:56883-0x147fc404e830002 Successfully transitioned node 1644a212531c3b43dde748d401c7e212 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENING 2014-08-21 22:46:47,616 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5 and set watcher; region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENING 2014-08-21 22:46:47,616 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] zookeeper.ZKUtil(1599): regionserver:56883-0x147fc404e830002 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5; data=region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENING 2014-08-21 22:46:47,616 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_OPENING, server=p0420.sjc.cloudera.com,56883,1408686379653, region=1eeb1332ce0a2f3b96882b0ec1572dc5 2014-08-21 22:46:47,616 INFO [PostOpenDeployTasks:1644a212531c3b43dde748d401c7e212] regionserver.HRegionServer(1849): Post open deploy tasks for region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., daughter= false 2014-08-21 22:46:47,616 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-1] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 133 byte (s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372; data=region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,60875,1408686379690, state=RS_ZK_REGION_OPENED 2014-08-21 22:46:47,617 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/1644a212531c3b43dde748d401c7e212 2014-08-21 22:46:47,620 INFO [PostOpenDeployTasks:1644a212531c3b43dde748d401c7e212] catalog.MetaEditor(297): Updated row testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. with server=p0420.sjc.cloudera.com,56883,1408686379653 2014-08-21 22:46:47,620 INFO [PostOpenDeployTasks:1644a212531c3b43dde748d401c7e212] regionserver.HRegionServer(1874): Done with post open deploy task for region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., daughter= false 2014-08-21 22:46:47,621 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] zookeeper.ZKAssign(757): regionserver:56883-0x147fc404e830002 Attempting to transition node 1644a212531c3b43dde748d401c7e212 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-08-21 22:46:47,624 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] zookeeper.ZKAssign(820): regionserver:56883-0x147fc404e830002 Successfully transitioned node 1eeb1332ce0a2f3b96882b0ec1572dc5 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-08-21 22:46:47,624 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] handler.OpenRegionHandler(287): region transitioned to opened in zookeeper: {NAME => 'testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.', STARTKEY => 'A', ENDKEY => 'B', ENCODED => 1eeb1332ce0a2f3b96882b0ec1572dc5,}, server: p0420.sjc.cloudera.com,56883,1408686379653 2014-08-21 22:46:47,624 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] handler.OpenRegionHandler(138): Opened testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. on server:p0420.sjc.cloudera.com,56883,1408686379653 2014-08-21 22:46:47,632 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-1] zookeeper.ZKAssign(512): master:37883-0x147fc404e830000 Successfully deleted unassigned node for region a8edbdfb2e9b02881ebc1702752b2372 in expected state RS_ZK_REGION_OPENED 2014-08-21 22:46:47,633 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212 and set watcher; region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENING 2014-08-21 22:46:47,633 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] zookeeper.ZKUtil(1599): regionserver:56883-0x147fc404e830002 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212; data=region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENING 2014-08-21 22:46:47,633 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_OPENING, server=p0420.sjc.cloudera.com,56883,1408686379653, region=1644a212531c3b43dde748d401c7e212 2014-08-21 22:46:47,633 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5 2014-08-21 22:46:47,641 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] zookeeper.ZKAssign(820): regionserver:56883-0x147fc404e830002 Successfully transitioned node 1644a212531c3b43dde748d401c7e212 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-08-21 22:46:47,641 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5 and set watcher; region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENED 2014-08-21 22:46:47,641 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] handler.OpenRegionHandler(287): region transitioned to opened in zookeeper: {NAME => 'testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.', STARTKEY => 'B', ENDKEY => 'C', ENCODED => 1644a212531c3b43dde748d401c7e212,}, server: p0420.sjc.cloudera.com,56883,1408686379653 2014-08-21 22:46:47,641 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_OPENED, server=p0420.sjc.cloudera.com,56883,1408686379653, region=1eeb1332ce0a2f3b96882b0ec1572dc5 2014-08-21 22:46:47,641 DEBUG [RS_OPEN_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] handler.OpenRegionHandler(138): Opened testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. on server:p0420.sjc.cloudera.com,56883,1408686379653 2014-08-21 22:46:47,641 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372 2014-08-21 22:46:47,641 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-2] handler.OpenedRegionHandler(147): Handling OPENED event for testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. from p0420.sjc.cloudera.com,56883,1408686379653; deleting unassigned node 2014-08-21 22:46:47,642 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(1176): The znode of region testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. has been deleted. 2014-08-21 22:46:47,642 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-2] zookeeper.ZKAssign(483): master:37883-0x147fc404e830000 Deleting existing unassigned node for 1eeb1332ce0a2f3b96882b0ec1572dc5 that is in expected state RS_ZK_REGION_OPENED 2014-08-21 22:46:47,642 INFO [pool-1-thread-1-EventThread] master.AssignmentManager(1188): The master has opened the region testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. that was online on p0420.sjc.cloudera.com,60875,1408686379690 2014-08-21 22:46:47,642 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/unassigned 2014-08-21 22:46:47,644 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-2] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5; data=region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENED 2014-08-21 22:46:47,644 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212 and set watcher; region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENED 2014-08-21 22:46:47,649 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-2] zookeeper.ZKAssign(512): master:37883-0x147fc404e830000 Successfully deleted unassigned node for region 1eeb1332ce0a2f3b96882b0ec1572dc5 in expected state RS_ZK_REGION_OPENED 2014-08-21 22:46:47,649 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(713): master:37883-0x147fc404e830000 Unable to get data of znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5 because node does not exist (not an error) 2014-08-21 22:46:47,650 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/1644a212531c3b43dde748d401c7e212 2014-08-21 22:46:47,650 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212 and set watcher; region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENED 2014-08-21 22:46:47,650 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_OPENED, server=p0420.sjc.cloudera.com,56883,1408686379653, region=1644a212531c3b43dde748d401c7e212 2014-08-21 22:46:47,651 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5 2014-08-21 22:46:47,651 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-3] handler.OpenedRegionHandler(147): Handling OPENED event for testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. from p0420.sjc.cloudera.com,56883,1408686379653; deleting unassigned node 2014-08-21 22:46:47,651 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(1176): The znode of region testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. has been deleted. 2014-08-21 22:46:47,651 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-3] zookeeper.ZKAssign(483): master:37883-0x147fc404e830000 Deleting existing unassigned node for 1644a212531c3b43dde748d401c7e212 that is in expected state RS_ZK_REGION_OPENED 2014-08-21 22:46:47,651 INFO [pool-1-thread-1-EventThread] master.AssignmentManager(1188): The master has opened the region testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. that was online on p0420.sjc.cloudera.com,56883,1408686379653 2014-08-21 22:46:47,651 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/unassigned 2014-08-21 22:46:47,652 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-3] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212; data=region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_OPENED 2014-08-21 22:46:47,657 DEBUG [MASTER_OPEN_REGION-p0420.sjc.cloudera.com,37883,1408686379181-3] zookeeper.ZKAssign(512): master:37883-0x147fc404e830000 Successfully deleted unassigned node for region 1644a212531c3b43dde748d401c7e212 in expected state RS_ZK_REGION_OPENED 2014-08-21 22:46:47,658 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(713): master:37883-0x147fc404e830000 Unable to get data of znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212 because node does not exist (not an error) 2014-08-21 22:46:47,658 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/unassigned/1644a212531c3b43dde748d401c7e212 2014-08-21 22:46:47,658 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(1176): The znode of region testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. has been deleted. 2014-08-21 22:46:47,658 INFO [pool-1-thread-1-EventThread] master.AssignmentManager(1188): The master has opened the region testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. that was online on p0420.sjc.cloudera.com,56883,1408686379653 2014-08-21 22:46:47,658 INFO [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] master.AssignmentManager(2418): Bulk assigning done 2014-08-21 22:46:47,658 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/unassigned 2014-08-21 22:46:47,763 DEBUG [ Thread -609] client.MetaScanner(182): Scanning .META. starting at row=testQuarantineMissingHFile,,00000000000000 for max=2147483647 rows using org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 2014-08-21 22:46:47,768 DEBUG [ Thread -609] zookeeper.ZKUtil(120): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 opening connection to ZooKeeper with ensemble (localhost:63891) 2014-08-21 22:46:47,770 INFO [ Thread -609] zookeeper.RecoverableZooKeeper(104): The identifier of this process is 10184@p0420.sjc.cloudera.com 2014-08-21 22:46:47,771 DEBUG [ Thread -609] catalog.CatalogTracker(210): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@799aae6a 2014-08-21 22:46:47,774 DEBUG [ Thread -609-EventThread] zookeeper.ZooKeeperWatcher(294): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Received ZooKeeper Event, type=None, state=SyncConnected, path= null 2014-08-21 22:46:47,775 DEBUG [ Thread -609] zookeeper.ZKUtil(423): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Set watcher on existing znode /hbase/root-region-server 2014-08-21 22:46:47,775 DEBUG [ Thread -609] zookeeper.ZKUtil(1599): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Retrieved 42 byte (s) of data from znode /hbase/root-region-server and set watcher; p0420.sjc.cloudera.com,60875,... 2014-08-21 22:46:47,775 DEBUG [ Thread -609-EventThread] zookeeper.ZooKeeperWatcher(371): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830020 connected 2014-08-21 22:46:47,776 DEBUG [ Thread -609] zookeeper.ZKUtil(425): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830020 /hbase/unassigned/1028785192 does not exist. Watcher is set. 2014-08-21 22:46:47,776 DEBUG [ Thread -609] client.ClientScanner(90): Creating scanner over .META. starting at key 'testQuarantineMissingHFile,,' 2014-08-21 22:46:47,777 DEBUG [ Thread -609] client.ClientScanner(203): Advancing internal scanner to startKey at 'testQuarantineMissingHFile,,' 2014-08-21 22:46:47,779 DEBUG [ Thread -609] catalog.CatalogTracker(227): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@799aae6a 2014-08-21 22:46:47,784 DEBUG [ Thread -609] zookeeper.ZKUtil(658): hconnection-0x147fc404e830007 Unable to get data of znode /hbase/table/testQuarantineMissingHFile because node does not exist (not an error) 2014-08-21 22:46:47,786 DEBUG [ Thread -609] client.MetaScanner(182): Scanning .META. starting at row=testQuarantineMissingHFile,,00000000000000 for max=10 rows using org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 2014-08-21 22:46:47,789 DEBUG [ Thread -609] client.HConnectionManager$HConnectionImplementation(1404): Cached location for testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. is p0420.sjc.cloudera.com:60875 2014-08-21 22:46:47,789 DEBUG [ Thread -609] client.HConnectionManager$HConnectionImplementation(1404): Cached location for testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. is p0420.sjc.cloudera.com:56883 2014-08-21 22:46:47,789 DEBUG [ Thread -609] client.HConnectionManager$HConnectionImplementation(1404): Cached location for testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. is p0420.sjc.cloudera.com:56883 2014-08-21 22:46:47,790 DEBUG [ Thread -609] client.HConnectionManager$HConnectionImplementation(1404): Cached location for testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. is p0420.sjc.cloudera.com:54158 2014-08-21 22:46:47,798 DEBUG [ Thread -609] zookeeper.ZKUtil(120): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 opening connection to ZooKeeper with ensemble (localhost:63891) 2014-08-21 22:46:47,801 INFO [ Thread -609] zookeeper.RecoverableZooKeeper(104): The identifier of this process is 10184@p0420.sjc.cloudera.com 2014-08-21 22:46:47,801 DEBUG [ Thread -609] catalog.CatalogTracker(210): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@615ece16 2014-08-21 22:46:47,808 DEBUG [ Thread -609-EventThread] zookeeper.ZooKeeperWatcher(294): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Received ZooKeeper Event, type=None, state=SyncConnected, path= null 2014-08-21 22:46:47,809 DEBUG [ Thread -609-EventThread] zookeeper.ZooKeeperWatcher(371): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830021 connected 2014-08-21 22:46:47,809 DEBUG [ Thread -609] zookeeper.ZKUtil(423): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830021 Set watcher on existing znode /hbase/root-region-server 2014-08-21 22:46:47,810 DEBUG [ Thread -609] zookeeper.ZKUtil(1599): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830021 Retrieved 42 byte (s) of data from znode /hbase/root-region-server and set watcher; p0420.sjc.cloudera.com,60875,... 2014-08-21 22:46:47,811 DEBUG [ Thread -609] zookeeper.ZKUtil(425): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830021 /hbase/unassigned/1028785192 does not exist. Watcher is set. 2014-08-21 22:46:47,811 DEBUG [ Thread -609] client.ClientScanner(90): Creating scanner over .META. starting at key 'testQuarantineMissingHFile,,' 2014-08-21 22:46:47,811 DEBUG [ Thread -609] client.ClientScanner(203): Advancing internal scanner to startKey at 'testQuarantineMissingHFile,,' 2014-08-21 22:46:47,814 DEBUG [ Thread -609] catalog.CatalogTracker(227): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@615ece16 2014-08-21 22:46:47,827 DEBUG [ Thread -609] zookeeper.ZKUtil(658): hconnection-0x147fc404e830007 Unable to get data of znode /hbase/table/testQuarantineMissingHFile because node does not exist (not an error) 2014-08-21 22:46:47,827 DEBUG [ Thread -609] client.ClientScanner(90): Creating scanner over testQuarantineMissingHFile starting at key '' 2014-08-21 22:46:47,827 DEBUG [ Thread -609] client.ClientScanner(203): Advancing internal scanner to startKey at '' 2014-08-21 22:46:47,831 DEBUG [ Thread -609] client.ClientScanner(196): Finished with region {NAME => 'testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.', STARTKEY => '', ENDKEY => 'A', ENCODED => a8edbdfb2e9b02881ebc1702752b2372,} 2014-08-21 22:46:47,832 DEBUG [ Thread -609] client.ClientScanner(203): Advancing internal scanner to startKey at 'A' 2014-08-21 22:46:47,835 DEBUG [ Thread -609] client.ClientScanner(196): Finished with region {NAME => 'testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.', STARTKEY => 'A', ENDKEY => 'B', ENCODED => 1eeb1332ce0a2f3b96882b0ec1572dc5,} 2014-08-21 22:46:47,836 DEBUG [ Thread -609] client.ClientScanner(203): Advancing internal scanner to startKey at 'B' 2014-08-21 22:46:47,840 DEBUG [ Thread -609] client.ClientScanner(196): Finished with region {NAME => 'testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.', STARTKEY => 'B', ENDKEY => 'C', ENCODED => 1644a212531c3b43dde748d401c7e212,} 2014-08-21 22:46:47,840 DEBUG [ Thread -609] client.ClientScanner(203): Advancing internal scanner to startKey at 'C' 2014-08-21 22:46:47,844 DEBUG [ Thread -609] client.ClientScanner(190): Finished with scanning at {NAME => 'testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.', STARTKEY => 'C', ENDKEY => '', ENCODED => c425f751446d62d8f4a9d9f5d8811214,} 2014-08-21 22:46:47,845 DEBUG [ Thread -609] zookeeper.ZKUtil(120): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 opening connection to ZooKeeper with ensemble (localhost:63891) 2014-08-21 22:46:47,848 INFO [ Thread -609] zookeeper.RecoverableZooKeeper(104): The identifier of this process is 10184@p0420.sjc.cloudera.com 2014-08-21 22:46:47,848 DEBUG [ Thread -609] catalog.CatalogTracker(210): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@42081f25 2014-08-21 22:46:47,858 DEBUG [ Thread -609-EventThread] zookeeper.ZooKeeperWatcher(294): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Received ZooKeeper Event, type=None, state=SyncConnected, path= null 2014-08-21 22:46:47,858 DEBUG [ Thread -609] zookeeper.ZKUtil(423): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Set watcher on existing znode /hbase/root-region-server 2014-08-21 22:46:47,859 DEBUG [ Thread -609] zookeeper.ZKUtil(1599): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Retrieved 42 byte (s) of data from znode /hbase/root-region-server and set watcher; p0420.sjc.cloudera.com,60875,... 2014-08-21 22:46:47,859 DEBUG [ Thread -609-EventThread] zookeeper.ZooKeeperWatcher(371): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830022 connected 2014-08-21 22:46:47,859 DEBUG [ Thread -609] zookeeper.ZKUtil(425): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830022 /hbase/unassigned/1028785192 does not exist. Watcher is set. 2014-08-21 22:46:47,862 DEBUG [ Thread -609] client.MetaScanner(182): Scanning .META. starting at row= for max=2147483647 rows using org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 2014-08-21 22:46:47,871 DEBUG [ Thread -609] client.ClientScanner(90): Creating scanner over .META. starting at key 'testQuarantineMissingHFile,,' 2014-08-21 22:46:47,871 DEBUG [ Thread -609] client.ClientScanner(203): Advancing internal scanner to startKey at 'testQuarantineMissingHFile,,' 2014-08-21 22:46:47,874 DEBUG [ Thread -609] client.ClientScanner(90): Creating scanner over .META. starting at key 'testQuarantineMissingHFile,,' 2014-08-21 22:46:47,875 DEBUG [ Thread -609] client.ClientScanner(203): Advancing internal scanner to startKey at 'testQuarantineMissingHFile,,' 2014-08-21 22:46:47,881 DEBUG [ Thread -609] client.ClientScanner(190): Finished with scanning at {NAME => '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED => 1028785192,} 2014-08-21 22:46:47,882 INFO [PRI IPC Server handler 7 on 60875] regionserver.HRegionServer(3307): Flushing testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. 2014-08-21 22:46:47,883 DEBUG [PRI IPC Server handler 7 on 60875] regionserver.HRegion(1605): Started memstore flush for testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., current region memstore size 320 2014-08-21 22:46:47,883 DEBUG [PRI IPC Server handler 7 on 60875] regionserver.HRegion(1655): Finished snapshotting testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., syncing WAL and waiting on mvcc, flushsize=320 2014-08-21 22:46:47,884 DEBUG [PRI IPC Server handler 7 on 60875] regionserver.HRegion(1671): Finished snapshotting, commencing flushing stores 2014-08-21 22:46:47,895 DEBUG [PRI IPC Server handler 7 on 60875] util.FSUtils(157): Creating file=hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/.tmp/231f0c27ede84a77a6e0a64aeb8887ce with permission=rwxrwxrwx 2014-08-21 22:46:47,904 DEBUG [PRI IPC Server handler 7 on 60875] hfile.HFileWriterV2(149): Initialized with CacheConfig:enabled [cacheDataOnRead= true ] [cacheDataOnWrite= false ] [cacheIndexesOnWrite= false ] [cacheBloomsOnWrite= false ] [cacheEvictOnClose= false ] [cacheCompressed= false ] 2014-08-21 22:46:47,905 INFO [PRI IPC Server handler 7 on 60875] regionserver.StoreFile$Writer(1095): Delete Family Bloom filter type for hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/.tmp/231f0c27ede84a77a6e0a64aeb8887ce: CompoundBloomFilterWriter 2014-08-21 22:46:47,915 INFO [IPC Server handler 6 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40206 is added to blk_-6303039399968837419_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:40670|RBW], ReplicaUnderConstruction[127.0.0.1:34823|RBW], ReplicaUnderConstruction[127.0.0.1:40206|RBW]]} size 0 2014-08-21 22:46:47,916 INFO [IPC Server handler 1 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34823 is added to blk_-6303039399968837419_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:40670|RBW], ReplicaUnderConstruction[127.0.0.1:34823|RBW], ReplicaUnderConstruction[127.0.0.1:40206|RBW]]} size 0 2014-08-21 22:46:47,917 INFO [IPC Server handler 9 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40670 is added to blk_-6303039399968837419_1096 size 722 2014-08-21 22:46:47,927 INFO [PRI IPC Server handler 7 on 60875] regionserver.StoreFile$Writer(1315): NO General Bloom and NO DeleteFamily was added to HFile (hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/.tmp/231f0c27ede84a77a6e0a64aeb8887ce) 2014-08-21 22:46:47,927 INFO [PRI IPC Server handler 7 on 60875] regionserver.Store(925): Flushed , sequenceid=48, memsize=320, into tmp file hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/.tmp/231f0c27ede84a77a6e0a64aeb8887ce 2014-08-21 22:46:47,938 DEBUG [PRI IPC Server handler 7 on 60875] regionserver.Store(949): Renaming flushed file at hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/.tmp/231f0c27ede84a77a6e0a64aeb8887ce to hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/fam/231f0c27ede84a77a6e0a64aeb8887ce 2014-08-21 22:46:47,963 INFO [PRI IPC Server handler 7 on 60875] regionserver.Store(972): Added hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/fam/231f0c27ede84a77a6e0a64aeb8887ce, entries=2, sequenceid=48, filesize=722 2014-08-21 22:46:47,965 INFO [PRI IPC Server handler 7 on 60875] regionserver.HRegion(1745): Finished memstore flush of ~320/320, currentsize=0/0 for region testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. in 82ms, sequenceid=48, compaction requested= false 2014-08-21 22:46:47,966 INFO [PRI IPC Server handler 4 on 56883] regionserver.HRegionServer(3307): Flushing testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. 2014-08-21 22:46:47,969 DEBUG [PRI IPC Server handler 4 on 56883] regionserver.HRegion(1605): Started memstore flush for testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., current region memstore size 320 2014-08-21 22:46:47,970 DEBUG [PRI IPC Server handler 4 on 56883] regionserver.HRegion(1655): Finished snapshotting testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., syncing WAL and waiting on mvcc, flushsize=320 2014-08-21 22:46:47,971 DEBUG [PRI IPC Server handler 4 on 56883] regionserver.HRegion(1671): Finished snapshotting, commencing flushing stores 2014-08-21 22:46:47,995 DEBUG [PRI IPC Server handler 4 on 56883] util.FSUtils(157): Creating file=hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/.tmp/7cec52ed390b4af3a2a3b04be32b91ed with permission=rwxrwxrwx 2014-08-21 22:46:48,019 DEBUG [PRI IPC Server handler 4 on 56883] hfile.HFileWriterV2(149): Initialized with CacheConfig:enabled [cacheDataOnRead= true ] [cacheDataOnWrite= false ] [cacheIndexesOnWrite= false ] [cacheBloomsOnWrite= false ] [cacheEvictOnClose= false ] [cacheCompressed= false ] 2014-08-21 22:46:48,020 INFO [PRI IPC Server handler 4 on 56883] regionserver.StoreFile$Writer(1095): Delete Family Bloom filter type for hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/.tmp/7cec52ed390b4af3a2a3b04be32b91ed: CompoundBloomFilterWriter 2014-08-21 22:46:48,033 INFO [IPC Server handler 5 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40206 is added to blk_-7146604580806320095_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:34823|RBW], ReplicaUnderConstruction[127.0.0.1:40670|RBW], ReplicaUnderConstruction[127.0.0.1:40206|RBW]]} size 0 2014-08-21 22:46:48,034 INFO [IPC Server handler 8 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40670 is added to blk_-7146604580806320095_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:34823|RBW], ReplicaUnderConstruction[127.0.0.1:40670|RBW], ReplicaUnderConstruction[127.0.0.1:40206|RBW]]} size 0 2014-08-21 22:46:48,035 INFO [IPC Server handler 0 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34823 is added to blk_-7146604580806320095_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:34823|RBW], ReplicaUnderConstruction[127.0.0.1:40670|RBW], ReplicaUnderConstruction[127.0.0.1:40206|RBW]]} size 0 2014-08-21 22:46:48,044 INFO [PRI IPC Server handler 4 on 56883] regionserver.StoreFile$Writer(1315): NO General Bloom and NO DeleteFamily was added to HFile (hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/.tmp/7cec52ed390b4af3a2a3b04be32b91ed) 2014-08-21 22:46:48,044 INFO [PRI IPC Server handler 4 on 56883] regionserver.Store(925): Flushed , sequenceid=15, memsize=320, into tmp file hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/.tmp/7cec52ed390b4af3a2a3b04be32b91ed 2014-08-21 22:46:48,056 DEBUG [PRI IPC Server handler 4 on 56883] regionserver.Store(949): Renaming flushed file at hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/.tmp/7cec52ed390b4af3a2a3b04be32b91ed to hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/fam/7cec52ed390b4af3a2a3b04be32b91ed 2014-08-21 22:46:48,079 INFO [PRI IPC Server handler 4 on 56883] regionserver.Store(972): Added hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/fam/7cec52ed390b4af3a2a3b04be32b91ed, entries=2, sequenceid=15, filesize=722 2014-08-21 22:46:48,081 INFO [PRI IPC Server handler 4 on 56883] regionserver.HRegion(1745): Finished memstore flush of ~320/320, currentsize=0/0 for region testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. in 112ms, sequenceid=15, compaction requested= false 2014-08-21 22:46:48,085 INFO [PRI IPC Server handler 5 on 56883] regionserver.HRegionServer(3307): Flushing testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. 2014-08-21 22:46:48,085 DEBUG [PRI IPC Server handler 5 on 56883] regionserver.HRegion(1605): Started memstore flush for testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., current region memstore size 320 2014-08-21 22:46:48,086 DEBUG [PRI IPC Server handler 5 on 56883] regionserver.HRegion(1655): Finished snapshotting testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., syncing WAL and waiting on mvcc, flushsize=320 2014-08-21 22:46:48,086 DEBUG [PRI IPC Server handler 5 on 56883] regionserver.HRegion(1671): Finished snapshotting, commencing flushing stores 2014-08-21 22:46:48,120 DEBUG [PRI IPC Server handler 5 on 56883] util.FSUtils(157): Creating file=hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/.tmp/92484a47b8f14c338314b70c98ebc0dc with permission=rwxrwxrwx 2014-08-21 22:46:48,128 DEBUG [PRI IPC Server handler 5 on 56883] hfile.HFileWriterV2(149): Initialized with CacheConfig:enabled [cacheDataOnRead= true ] [cacheDataOnWrite= false ] [cacheIndexesOnWrite= false ] [cacheBloomsOnWrite= false ] [cacheEvictOnClose= false ] [cacheCompressed= false ] 2014-08-21 22:46:48,128 INFO [PRI IPC Server handler 5 on 56883] regionserver.StoreFile$Writer(1095): Delete Family Bloom filter type for hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/.tmp/92484a47b8f14c338314b70c98ebc0dc: CompoundBloomFilterWriter 2014-08-21 22:46:48,140 INFO [IPC Server handler 9 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40670 is added to blk_-8202252735549624962_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:40206|RBW], ReplicaUnderConstruction[127.0.0.1:34823|RBW], ReplicaUnderConstruction[127.0.0.1:40670|RBW]]} size 0 2014-08-21 22:46:48,141 INFO [IPC Server handler 7 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34823 is added to blk_-8202252735549624962_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:40206|RBW], ReplicaUnderConstruction[127.0.0.1:34823|RBW], ReplicaUnderConstruction[127.0.0.1:40670|RBW]]} size 0 2014-08-21 22:46:48,141 INFO [IPC Server handler 4 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40206 is added to blk_-8202252735549624962_1100 size 722 2014-08-21 22:46:48,152 INFO [PRI IPC Server handler 5 on 56883] regionserver.StoreFile$Writer(1315): NO General Bloom and NO DeleteFamily was added to HFile (hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/.tmp/92484a47b8f14c338314b70c98ebc0dc) 2014-08-21 22:46:48,152 INFO [PRI IPC Server handler 5 on 56883] regionserver.Store(925): Flushed , sequenceid=16, memsize=320, into tmp file hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/.tmp/92484a47b8f14c338314b70c98ebc0dc 2014-08-21 22:46:48,165 DEBUG [PRI IPC Server handler 5 on 56883] regionserver.Store(949): Renaming flushed file at hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/.tmp/92484a47b8f14c338314b70c98ebc0dc to hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/fam/92484a47b8f14c338314b70c98ebc0dc 2014-08-21 22:46:48,188 INFO [PRI IPC Server handler 5 on 56883] regionserver.Store(972): Added hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/fam/92484a47b8f14c338314b70c98ebc0dc, entries=2, sequenceid=16, filesize=722 2014-08-21 22:46:48,190 INFO [PRI IPC Server handler 5 on 56883] regionserver.HRegion(1745): Finished memstore flush of ~320/320, currentsize=0/0 for region testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. in 105ms, sequenceid=16, compaction requested= false 2014-08-21 22:46:48,191 INFO [PRI IPC Server handler 2 on 54158] regionserver.HRegionServer(3307): Flushing testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. 2014-08-21 22:46:48,191 DEBUG [PRI IPC Server handler 2 on 54158] regionserver.HRegion(1605): Started memstore flush for testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., current region memstore size 320 2014-08-21 22:46:48,192 DEBUG [PRI IPC Server handler 2 on 54158] regionserver.HRegion(1655): Finished snapshotting testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., syncing WAL and waiting on mvcc, flushsize=320 2014-08-21 22:46:48,192 DEBUG [PRI IPC Server handler 2 on 54158] regionserver.HRegion(1671): Finished snapshotting, commencing flushing stores 2014-08-21 22:46:48,203 DEBUG [PRI IPC Server handler 2 on 54158] util.FSUtils(157): Creating file=hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/.tmp/e81f27e4ffbf435cb38dca815be340e8 with permission=rwxrwxrwx 2014-08-21 22:46:48,211 DEBUG [PRI IPC Server handler 2 on 54158] hfile.HFileWriterV2(149): Initialized with CacheConfig:enabled [cacheDataOnRead= true ] [cacheDataOnWrite= false ] [cacheIndexesOnWrite= false ] [cacheBloomsOnWrite= false ] [cacheEvictOnClose= false ] [cacheCompressed= false ] 2014-08-21 22:46:48,211 INFO [PRI IPC Server handler 2 on 54158] regionserver.StoreFile$Writer(1095): Delete Family Bloom filter type for hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/.tmp/e81f27e4ffbf435cb38dca815be340e8: CompoundBloomFilterWriter 2014-08-21 22:46:48,222 INFO [IPC Server handler 2 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34823 is added to blk_8136300766489353090_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:40206|RBW], ReplicaUnderConstruction[127.0.0.1:40670|RBW], ReplicaUnderConstruction[127.0.0.1:34823|RBW]]} size 0 2014-08-21 22:46:48,223 INFO [IPC Server handler 6 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40670 is added to blk_8136300766489353090_1102 size 722 2014-08-21 22:46:48,224 INFO [IPC Server handler 1 on 58811] blockmanagement.BlockManager(2192): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40206 is added to blk_8136300766489353090_1102 size 722 2014-08-21 22:46:48,227 INFO [PRI IPC Server handler 2 on 54158] regionserver.StoreFile$Writer(1315): NO General Bloom and NO DeleteFamily was added to HFile (hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/.tmp/e81f27e4ffbf435cb38dca815be340e8) 2014-08-21 22:46:48,227 INFO [PRI IPC Server handler 2 on 54158] regionserver.Store(925): Flushed , sequenceid=15, memsize=320, into tmp file hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/.tmp/e81f27e4ffbf435cb38dca815be340e8 2014-08-21 22:46:48,240 DEBUG [PRI IPC Server handler 2 on 54158] regionserver.Store(949): Renaming flushed file at hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/.tmp/e81f27e4ffbf435cb38dca815be340e8 to hdfs://localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/fam/e81f27e4ffbf435cb38dca815be340e8 2014-08-21 22:46:48,264 INFO [PRI IPC Server handler 2 on 54158] regionserver.Store(972): Added hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/fam/e81f27e4ffbf435cb38dca815be340e8, entries=2, sequenceid=15, filesize=722 2014-08-21 22:46:48,266 INFO [PRI IPC Server handler 2 on 54158] regionserver.HRegion(1745): Finished memstore flush of ~320/320, currentsize=0/0 for region testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. in 75ms, sequenceid=15, compaction requested= false 2014-08-21 22:46:48,267 DEBUG [ Thread -609] catalog.CatalogTracker(227): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@42081f25 2014-08-21 22:46:48,277 DEBUG [IPC Server handler 0 on 37883] client.ClientScanner(90): Creating scanner over .META. starting at key 'testQuarantineMissingHFile,,' 2014-08-21 22:46:48,277 DEBUG [IPC Server handler 0 on 37883] client.ClientScanner(203): Advancing internal scanner to startKey at 'testQuarantineMissingHFile,,' 2014-08-21 22:46:48,299 INFO [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DisableTableHandler(97): Attemping to disable table testQuarantineMissingHFile 2014-08-21 22:46:48,299 INFO [ Thread -609] client.HBaseAdmin(858): Started disable of testQuarantineMissingHFile 2014-08-21 22:46:48,301 DEBUG [ Thread -609] zookeeper.ZKUtil(120): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 opening connection to ZooKeeper with ensemble (localhost:63891) 2014-08-21 22:46:48,303 INFO [ Thread -609] zookeeper.RecoverableZooKeeper(104): The identifier of this process is 10184@p0420.sjc.cloudera.com 2014-08-21 22:46:48,303 DEBUG [ Thread -609] catalog.CatalogTracker(210): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@b6a6597 2014-08-21 22:46:48,330 INFO [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DisableTableHandler(121): Offlining 4 regions. 2014-08-21 22:46:48,331 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-0] master.AssignmentManager(2140): Starting unassignment of region testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. (offlining) 2014-08-21 22:46:48,331 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-1] master.AssignmentManager(2140): Starting unassignment of region testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. (offlining) 2014-08-21 22:46:48,331 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-2] master.AssignmentManager(2140): Starting unassignment of region testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. (offlining) 2014-08-21 22:46:48,331 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-0] zookeeper.ZKAssign(561): master:37883-0x147fc404e830000 Creating unassigned node for a8edbdfb2e9b02881ebc1702752b2372 in a CLOSING state 2014-08-21 22:46:48,341 DEBUG [ Thread -609-EventThread] zookeeper.ZooKeeperWatcher(294): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Received ZooKeeper Event, type=None, state=SyncConnected, path= null 2014-08-21 22:46:48,343 DEBUG [ Thread -609-EventThread] zookeeper.ZooKeeperWatcher(371): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830023 connected 2014-08-21 22:46:48,349 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/unassigned 2014-08-21 22:46:48,349 DEBUG [ Thread -609] zookeeper.ZKUtil(423): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830023 Set watcher on existing znode /hbase/root-region-server 2014-08-21 22:46:48,349 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-2] zookeeper.ZKAssign(561): master:37883-0x147fc404e830000 Creating unassigned node for 1644a212531c3b43dde748d401c7e212 in a CLOSING state 2014-08-21 22:46:48,350 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 133 byte (s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372 and set watcher; region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_CLOSING 2014-08-21 22:46:48,350 DEBUG [ Thread -609] zookeeper.ZKUtil(1599): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830023 Retrieved 42 byte (s) of data from znode /hbase/root-region-server and set watcher; p0420.sjc.cloudera.com,60875,... 2014-08-21 22:46:48,351 INFO [PRI IPC Server handler 0 on 60875] regionserver.HRegionServer(3195): Received close region: testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.. Version of ZK closing node:0 2014-08-21 22:46:48,351 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] handler.CloseRegionHandler(105): Processing close of testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. 2014-08-21 22:46:48,351 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-0] master.AssignmentManager(2239): Sent CLOSE to p0420.sjc.cloudera.com,60875,1408686379690 for region testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. 2014-08-21 22:46:48,351 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] regionserver.HRegion(1018): Closing testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.: disabling compactions & flushes 2014-08-21 22:46:48,351 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] regionserver.HRegion(1045): Updates disabled for region testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. 2014-08-21 22:46:48,357 INFO [StoreCloserThread-testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.-1] regionserver.Store(754): Closed fam 2014-08-21 22:46:48,357 INFO [RS_CLOSE_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] regionserver.HRegion(1117): Closed testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. 2014-08-21 22:46:48,357 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] zookeeper.ZKAssign(757): regionserver:60875-0x147fc404e830003 Attempting to transition node a8edbdfb2e9b02881ebc1702752b2372 from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,357 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/unassigned 2014-08-21 22:46:48,357 DEBUG [ Thread -609] zookeeper.ZKUtil(425): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830023 /hbase/unassigned/1028785192 does not exist. Watcher is set. 2014-08-21 22:46:48,358 DEBUG [ Thread -609] client.ClientScanner(90): Creating scanner over .META. starting at key 'testQuarantineMissingHFile,,' 2014-08-21 22:46:48,358 DEBUG [ Thread -609] client.ClientScanner(203): Advancing internal scanner to startKey at 'testQuarantineMissingHFile,,' 2014-08-21 22:46:48,358 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] zookeeper.ZKUtil(1599): regionserver:60875-0x147fc404e830003 Retrieved 133 byte (s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372; data=region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_CLOSING 2014-08-21 22:46:48,359 INFO [PRI IPC Server handler 6 on 56883] regionserver.HRegionServer(3195): Received close region: testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.. Version of ZK closing node:0 2014-08-21 22:46:48,359 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] handler.CloseRegionHandler(105): Processing close of testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. 2014-08-21 22:46:48,359 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-2] master.AssignmentManager(2239): Sent CLOSE to p0420.sjc.cloudera.com,56883,1408686379653 for region testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. 2014-08-21 22:46:48,360 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] regionserver.HRegion(1018): Closing testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.: disabling compactions & flushes 2014-08-21 22:46:48,359 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-1] zookeeper.ZKAssign(561): master:37883-0x147fc404e830000 Creating unassigned node for 1eeb1332ce0a2f3b96882b0ec1572dc5 in a CLOSING state 2014-08-21 22:46:48,360 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] regionserver.HRegion(1045): Updates disabled for region testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. 2014-08-21 22:46:48,359 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212 and set watcher; region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_CLOSING 2014-08-21 22:46:48,362 DEBUG [ Thread -609] catalog.CatalogTracker(227): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@b6a6597 2014-08-21 22:46:48,368 INFO [StoreCloserThread-testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.-1] regionserver.Store(754): Closed fam 2014-08-21 22:46:48,368 INFO [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] regionserver.HRegion(1117): Closed testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. 2014-08-21 22:46:48,369 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] zookeeper.ZKAssign(820): regionserver:60875-0x147fc404e830003 Successfully transitioned node a8edbdfb2e9b02881ebc1702752b2372 from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,369 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] zookeeper.ZKAssign(757): regionserver:56883-0x147fc404e830002 Attempting to transition node 1644a212531c3b43dde748d401c7e212 from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,369 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] handler.CloseRegionHandler(140): set region closed state in zk successfully for region testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. sn name: p0420.sjc.cloudera.com,60875,1408686379690 2014-08-21 22:46:48,369 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,60875,1408686379690-1] handler.CloseRegionHandler(149): Closed region testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. 2014-08-21 22:46:48,376 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] zookeeper.ZKUtil(1599): regionserver:56883-0x147fc404e830002 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212; data=region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_CLOSING 2014-08-21 22:46:48,376 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 133 byte (s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372 and set watcher; region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,60875,1408686379690, state=RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,376 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372 2014-08-21 22:46:48,376 DEBUG [ Thread -609] zookeeper.ZKUtil(1599): hconnection-0x147fc404e830007 Retrieved 9 byte (s) of data from znode /hbase/table/testQuarantineMissingHFile; data=DISABLING 2014-08-21 22:46:48,377 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-3] master.AssignmentManager(2140): Starting unassignment of region testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. (offlining) 2014-08-21 22:46:48,377 DEBUG [ Thread -609] client.HBaseAdmin(889): Sleeping= 1000ms, waiting for all regions to be disabled in testQuarantineMissingHFile 2014-08-21 22:46:48,377 INFO [PRI IPC Server handler 7 on 56883] regionserver.HRegionServer(3195): Received close region: testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.. Version of ZK closing node:0 2014-08-21 22:46:48,377 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-3] zookeeper.ZKAssign(561): master:37883-0x147fc404e830000 Creating unassigned node for c425f751446d62d8f4a9d9f5d8811214 in a CLOSING state 2014-08-21 22:46:48,377 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] handler.CloseRegionHandler(105): Processing close of testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. 2014-08-21 22:46:48,377 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-1] master.AssignmentManager(2239): Sent CLOSE to p0420.sjc.cloudera.com,56883,1408686379653 for region testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. 2014-08-21 22:46:48,378 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] regionserver.HRegion(1018): Closing testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.: disabling compactions & flushes 2014-08-21 22:46:48,378 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] regionserver.HRegion(1045): Updates disabled for region testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. 2014-08-21 22:46:48,382 INFO [StoreCloserThread-testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.-1] regionserver.Store(754): Closed fam 2014-08-21 22:46:48,382 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] zookeeper.ZKAssign(820): regionserver:56883-0x147fc404e830002 Successfully transitioned node 1644a212531c3b43dde748d401c7e212 from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,382 INFO [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] regionserver.HRegion(1117): Closed testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. 2014-08-21 22:46:48,383 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 133 byte (s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372 and set watcher; region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,60875,1408686379690, state=RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,382 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] handler.CloseRegionHandler(140): set region closed state in zk successfully for region testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. sn name: p0420.sjc.cloudera.com,56883,1408686379653 2014-08-21 22:46:48,383 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] zookeeper.ZKAssign(757): regionserver:56883-0x147fc404e830002 Attempting to transition node 1eeb1332ce0a2f3b96882b0ec1572dc5 from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,383 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-0] handler.CloseRegionHandler(149): Closed region testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. 2014-08-21 22:46:48,391 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] zookeeper.ZKUtil(1599): regionserver:56883-0x147fc404e830002 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5; data=region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_CLOSING 2014-08-21 22:46:48,391 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_CLOSED, server=p0420.sjc.cloudera.com,60875,1408686379690, region=a8edbdfb2e9b02881ebc1702752b2372 2014-08-21 22:46:48,392 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/unassigned 2014-08-21 22:46:48,392 INFO [PRI IPC Server handler 3 on 54158] regionserver.HRegionServer(3195): Received close region: testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.. Version of ZK closing node:0 2014-08-21 22:46:48,392 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.ClosedRegionHandler(92): Handling CLOSED event for a8edbdfb2e9b02881ebc1702752b2372 2014-08-21 22:46:48,392 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] handler.CloseRegionHandler(105): Processing close of testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. 2014-08-21 22:46:48,392 DEBUG [p0420.sjc.cloudera.com,37883,1408686379181-org.apache.hadoop.hbase.master.handler.DisableTableHandler$BulkDisabler-3] master.AssignmentManager(2239): Sent CLOSE to p0420.sjc.cloudera.com,54158,1408686379607 for region testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. 2014-08-21 22:46:48,392 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] regionserver.HRegion(1018): Closing testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.: disabling compactions & flushes 2014-08-21 22:46:48,392 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-0] master.AssignmentManager(1355): Table being disabled so deleting ZK node and removing from regions in transition, skipping assignment of region testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. 2014-08-21 22:46:48,393 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] regionserver.HRegion(1045): Updates disabled for region testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. 2014-08-21 22:46:48,393 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-0] zookeeper.ZKAssign(483): master:37883-0x147fc404e830000 Deleting existing unassigned node for a8edbdfb2e9b02881ebc1702752b2372 that is in expected state RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,394 INFO [StoreCloserThread-testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.-1] regionserver.Store(754): Closed fam 2014-08-21 22:46:48,394 INFO [RS_CLOSE_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] regionserver.HRegion(1117): Closed testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. 2014-08-21 22:46:48,394 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] zookeeper.ZKAssign(757): regionserver:54158-0x147fc404e830001 Attempting to transition node c425f751446d62d8f4a9d9f5d8811214 from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,399 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] zookeeper.ZKAssign(820): regionserver:56883-0x147fc404e830002 Successfully transitioned node 1eeb1332ce0a2f3b96882b0ec1572dc5 from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,399 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] handler.CloseRegionHandler(140): set region closed state in zk successfully for region testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. sn name: p0420.sjc.cloudera.com,56883,1408686379653 2014-08-21 22:46:48,399 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,56883,1408686379653-1] handler.CloseRegionHandler(149): Closed region testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. 2014-08-21 22:46:48,399 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-0] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 133 byte (s) of data from znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372; data=region=testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., origin=p0420.sjc.cloudera.com,60875,1408686379690, state=RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,400 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212 and set watcher; region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,400 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] zookeeper.ZKUtil(1599): regionserver:54158-0x147fc404e830001 Retrieved 134 byte (s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214; data=region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_CLOSING 2014-08-21 22:46:48,407 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-0] zookeeper.ZKAssign(512): master:37883-0x147fc404e830000 Successfully deleted unassigned node for region a8edbdfb2e9b02881ebc1702752b2372 in expected state RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,408 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214 and set watcher; region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,37883,1408686379181, state=M_ZK_REGION_CLOSING 2014-08-21 22:46:48,416 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] zookeeper.ZKAssign(820): regionserver:54158-0x147fc404e830001 Successfully transitioned node c425f751446d62d8f4a9d9f5d8811214 from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,416 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(713): master:37883-0x147fc404e830000 Unable to get data of znode /hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372 because node does not exist (not an error) 2014-08-21 22:46:48,416 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] handler.CloseRegionHandler(140): set region closed state in zk successfully for region testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. sn name: p0420.sjc.cloudera.com,54158,1408686379607 2014-08-21 22:46:48,416 DEBUG [RS_CLOSE_REGION-p0420.sjc.cloudera.com,54158,1408686379607-2] handler.CloseRegionHandler(149): Closed region testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. 2014-08-21 22:46:48,417 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5 and set watcher; region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,417 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/1644a212531c3b43dde748d401c7e212 2014-08-21 22:46:48,417 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212 and set watcher; region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,418 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_CLOSED, server=p0420.sjc.cloudera.com,56883,1408686379653, region=1644a212531c3b43dde748d401c7e212 2014-08-21 22:46:48,418 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5 2014-08-21 22:46:48,418 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-1] handler.ClosedRegionHandler(92): Handling CLOSED event for 1644a212531c3b43dde748d401c7e212 2014-08-21 22:46:48,418 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-1] master.AssignmentManager(1355): Table being disabled so deleting ZK node and removing from regions in transition, skipping assignment of region testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. 2014-08-21 22:46:48,418 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-1] zookeeper.ZKAssign(483): master:37883-0x147fc404e830000 Deleting existing unassigned node for 1644a212531c3b43dde748d401c7e212 that is in expected state RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,419 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5 and set watcher; region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,419 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_CLOSED, server=p0420.sjc.cloudera.com,56883,1408686379653, region=1eeb1332ce0a2f3b96882b0ec1572dc5 2014-08-21 22:46:48,419 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/unassigned/a8edbdfb2e9b02881ebc1702752b2372 2014-08-21 22:46:48,419 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-1] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1644a212531c3b43dde748d401c7e212; data=region=testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,419 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/unassigned 2014-08-21 22:46:48,419 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-2] handler.ClosedRegionHandler(92): Handling CLOSED event for 1eeb1332ce0a2f3b96882b0ec1572dc5 2014-08-21 22:46:48,419 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-2] master.AssignmentManager(1355): Table being disabled so deleting ZK node and removing from regions in transition, skipping assignment of region testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. 2014-08-21 22:46:48,420 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-2] zookeeper.ZKAssign(483): master:37883-0x147fc404e830000 Deleting existing unassigned node for 1eeb1332ce0a2f3b96882b0ec1572dc5 that is in expected state RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,424 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-1] zookeeper.ZKAssign(512): master:37883-0x147fc404e830000 Successfully deleted unassigned node for region 1644a212531c3b43dde748d401c7e212 in expected state RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,424 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-2] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5; data=region=testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., origin=p0420.sjc.cloudera.com,56883,1408686379653, state=RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,425 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214 and set watcher; region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,54158,1408686379607, state=RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,427 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DisableTableHandler$BulkDisabler(173): Disable waiting until done; 300000 ms remaining; [{NAME => 'testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.', STARTKEY => 'A', ENDKEY => 'B', ENCODED => 1eeb1332ce0a2f3b96882b0ec1572dc5,}, {NAME => 'testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.', STARTKEY => 'C', ENDKEY => '', ENCODED => c425f751446d62d8f4a9d9f5d8811214,}] 2014-08-21 22:46:48,432 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-2] zookeeper.ZKAssign(512): master:37883-0x147fc404e830000 Successfully deleted unassigned node for region 1eeb1332ce0a2f3b96882b0ec1572dc5 in expected state RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,432 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(713): master:37883-0x147fc404e830000 Unable to get data of znode /hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5 because node does not exist (not an error) 2014-08-21 22:46:48,433 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214 2014-08-21 22:46:48,434 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214 and set watcher; region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,54158,1408686379607, state=RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,434 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(743): Handling transition=RS_ZK_REGION_CLOSED, server=p0420.sjc.cloudera.com,54158,1408686379607, region=c425f751446d62d8f4a9d9f5d8811214 2014-08-21 22:46:48,434 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/unassigned/1644a212531c3b43dde748d401c7e212 2014-08-21 22:46:48,434 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-3] handler.ClosedRegionHandler(92): Handling CLOSED event for c425f751446d62d8f4a9d9f5d8811214 2014-08-21 22:46:48,434 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/unassigned/1eeb1332ce0a2f3b96882b0ec1572dc5 2014-08-21 22:46:48,434 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-3] master.AssignmentManager(1355): Table being disabled so deleting ZK node and removing from regions in transition, skipping assignment of region testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. 2014-08-21 22:46:48,434 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/unassigned 2014-08-21 22:46:48,435 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-3] zookeeper.ZKAssign(483): master:37883-0x147fc404e830000 Deleting existing unassigned node for c425f751446d62d8f4a9d9f5d8811214 that is in expected state RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,436 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-3] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214; data=region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,54158,1408686379607, state=RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,436 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(1599): master:37883-0x147fc404e830000 Retrieved 134 byte (s) of data from znode /hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214 and set watcher; region=testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., origin=p0420.sjc.cloudera.com,54158,1408686379607, state=RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,441 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/unassigned/c425f751446d62d8f4a9d9f5d8811214 2014-08-21 22:46:48,441 DEBUG [MASTER_CLOSE_REGION-p0420.sjc.cloudera.com,37883,1408686379181-3] zookeeper.ZKAssign(512): master:37883-0x147fc404e830000 Successfully deleted unassigned node for region c425f751446d62d8f4a9d9f5d8811214 in expected state RS_ZK_REGION_CLOSED 2014-08-21 22:46:48,441 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(1176): The znode of region testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. has been deleted. 2014-08-21 22:46:48,441 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(294): master:37883-0x147fc404e830000 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/unassigned 2014-08-21 22:46:48,477 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DisableTableHandler$BulkDisabler(173): Disable waiting until done; 299949 ms remaining; [] 2014-08-21 22:46:48,482 INFO [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DisableTableHandler(137): Disabled table is done= true 2014-08-21 22:46:49,378 DEBUG [ Thread -609] zookeeper.ZKUtil(120): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 opening connection to ZooKeeper with ensemble (localhost:63891) 2014-08-21 22:46:49,381 INFO [ Thread -609] zookeeper.RecoverableZooKeeper(104): The identifier of this process is 10184@p0420.sjc.cloudera.com 2014-08-21 22:46:49,381 DEBUG [ Thread -609] catalog.CatalogTracker(210): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@46480e23 2014-08-21 22:46:49,391 DEBUG [ Thread -609-EventThread] zookeeper.ZooKeeperWatcher(294): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Received ZooKeeper Event, type=None, state=SyncConnected, path= null 2014-08-21 22:46:49,391 DEBUG [ Thread -609] zookeeper.ZKUtil(423): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Set watcher on existing znode /hbase/root-region-server 2014-08-21 22:46:49,392 DEBUG [ Thread -609] zookeeper.ZKUtil(1599): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Retrieved 42 byte (s) of data from znode /hbase/root-region-server and set watcher; p0420.sjc.cloudera.com,60875,... 2014-08-21 22:46:49,392 DEBUG [ Thread -609-EventThread] zookeeper.ZooKeeperWatcher(371): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830024 connected 2014-08-21 22:46:49,393 DEBUG [ Thread -609] zookeeper.ZKUtil(425): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830024 /hbase/unassigned/1028785192 does not exist. Watcher is set. 2014-08-21 22:46:49,393 DEBUG [ Thread -609] client.ClientScanner(90): Creating scanner over .META. starting at key 'testQuarantineMissingHFile,,' 2014-08-21 22:46:49,393 DEBUG [ Thread -609] client.ClientScanner(203): Advancing internal scanner to startKey at 'testQuarantineMissingHFile,,' 2014-08-21 22:46:49,396 DEBUG [ Thread -609] catalog.CatalogTracker(227): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@46480e23 2014-08-21 22:46:49,400 DEBUG [ Thread -609] zookeeper.ZKUtil(1599): hconnection-0x147fc404e830007 Retrieved 8 byte (s) of data from znode /hbase/table/testQuarantineMissingHFile; data=DISABLED 2014-08-21 22:46:49,401 INFO [ Thread -609] client.HBaseAdmin(905): Disabled testQuarantineMissingHFile 2014-08-21 22:46:49,422 WARN [ Thread -609] conf.Configuration(981): fs. default .name is deprecated. Instead, use fs.defaultFS 2014-08-21 22:46:49,426 INFO [ Thread -609] util.HBaseFsck(3665): Checking all hfiles for corruption 2014-08-21 22:46:49,460 INFO [IPC Server handler 6 on 58811] blockmanagement.BlockManager(989): BLOCK* addToInvalidates: blk_-8202252735549624962_1100 127.0.0.1:34823 127.0.0.1:40670 127.0.0.1:40206 2014-08-21 22:46:49,462 ERROR [IPC Server handler 9 on 58811] security.UserGroupInformation(1461): PriviledgedActionException as:jenkins (auth:SIMPLE) cause:java.io.FileNotFoundException: File does not exist: /user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/fam/92484a47b8f14c338314b70c98ebc0dc 2014-08-21 22:46:49,464 WARN [pool-67-thread-1] hbck.HFileCorruptionChecker(108): HFile hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/fam/92484a47b8f14c338314b70c98ebc0dc was missing. Likely removed due to compaction/split? 2014-08-21 22:46:49,468 INFO [IPC Server handler 1 on 58811] blockmanagement.BlockManager(989): BLOCK* addToInvalidates: blk_8136300766489353090_1102 127.0.0.1:34823 127.0.0.1:40670 127.0.0.1:40206 2014-08-21 22:46:49,508 ERROR [IPC Server handler 5 on 58811] security.UserGroupInformation(1461): PriviledgedActionException as:jenkins (auth:SIMPLE) cause:java.io.FileNotFoundException: File does not exist: /user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/fam/e81f27e4ffbf435cb38dca815be340e8 2014-08-21 22:46:49,509 WARN [pool-67-thread-4] hbck.HFileCorruptionChecker(108): HFile hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/fam/e81f27e4ffbf435cb38dca815be340e8 was missing. Likely removed due to compaction/split? 2014-08-21 22:46:49,512 INFO [ Thread -609] util.HBaseFsck(358): Loading regioninfos HDFS 2014-08-21 22:46:49,513 INFO [ Thread -609] util.HBaseFsck(573): Loading HBase regioninfo from HDFS... 2014-08-21 22:46:49,515 DEBUG [ Thread -609] util.HBaseFsck(1310): Loading region dirs from hdfs: //localhost:58811/user/jenkins/hbase/-ROOT- 2014-08-21 22:46:49,515 DEBUG [ Thread -609] util.HBaseFsck(1310): Loading region dirs from hdfs: //localhost:58811/user/jenkins/hbase/.META. 2014-08-21 22:46:49,516 DEBUG [ Thread -609] util.HBaseFsck(1310): Loading region dirs from hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile 2014-08-21 22:46:49,518 DEBUG [pool-67-thread-1] util.HBaseFsck$WorkItemHdfsDir(3133): Loading region info from hdfs:hdfs: //localhost:58811/user/jenkins/hbase/-ROOT-/70236052 2014-08-21 22:46:49,518 DEBUG [pool-67-thread-5] util.HBaseFsck$WorkItemHdfsDir(3133): Loading region info from hdfs:hdfs: //localhost:58811/user/jenkins/hbase/.META./1028785192 2014-08-21 22:46:49,519 DEBUG [pool-67-thread-6] util.HBaseFsck$WorkItemHdfsDir(3133): Loading region info from hdfs:hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212 2014-08-21 22:46:49,561 DEBUG [pool-67-thread-6] util.HBaseFsck$WorkItemHdfsDir(3133): Loading region info from hdfs:hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5 2014-08-21 22:46:49,564 DEBUG [pool-67-thread-6] util.HBaseFsck$WorkItemHdfsDir(3133): Loading region info from hdfs:hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372 2014-08-21 22:46:49,569 DEBUG [pool-67-thread-6] util.HBaseFsck$WorkItemHdfsDir(3133): Loading region info from hdfs:hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214 2014-08-21 22:46:49,576 DEBUG [pool-67-thread-7] util.HBaseFsck(734): HRegionInfo read: {NAME => '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED => 1028785192,} 2014-08-21 22:46:49,577 DEBUG [pool-67-thread-9] util.HBaseFsck(734): HRegionInfo read: {NAME => 'testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.', STARTKEY => 'A', ENDKEY => 'B', ENCODED => 1eeb1332ce0a2f3b96882b0ec1572dc5,} 2014-08-21 22:46:49,616 DEBUG [pool-67-thread-6] util.HBaseFsck(734): HRegionInfo read: {NAME => '-ROOT-,,0', STARTKEY => '', ENDKEY => '', ENCODED => 70236052,} 2014-08-21 22:46:49,617 DEBUG [pool-67-thread-5] util.HBaseFsck(734): HRegionInfo read: {NAME => 'testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.', STARTKEY => 'B', ENDKEY => 'C', ENCODED => 1644a212531c3b43dde748d401c7e212,} 2014-08-21 22:46:49,617 DEBUG [pool-67-thread-10] util.HBaseFsck(734): HRegionInfo read: {NAME => 'testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.', STARTKEY => '', ENDKEY => 'A', ENCODED => a8edbdfb2e9b02881ebc1702752b2372,} 2014-08-21 22:46:49,617 DEBUG [pool-67-thread-8] util.HBaseFsck(734): HRegionInfo read: {NAME => 'testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.', STARTKEY => 'C', ENDKEY => '', ENCODED => c425f751446d62d8f4a9d9f5d8811214,} 2014-08-21 22:46:49,625 INFO [ Thread -609] util.HBaseFsck(1072): Checking HBase region split map from HDFS data... 2014-08-21 22:46:49,626 INFO [ Thread -609] util.HBaseFsck(582): No integrity errors. We are done with this phase. Glorious. 2014-08-21 22:46:49,627 INFO [IPC Server handler 3 on 37883] master.HMaster(1249): BalanceSwitch= false 2014-08-21 22:46:49,627 INFO [ Thread -609] util.HBaseFsck(394): Loading regionsinfo from the .META. table 2014-08-21 22:46:49,628 DEBUG [ Thread -609] zookeeper.ZKUtil(1599): hconnection-0x147fc404e830007 Retrieved 42 byte (s) of data from znode /hbase/root-region-server and set watcher; p0420.sjc.cloudera.com,60875,... 2014-08-21 22:46:49,629 DEBUG [ Thread -609] client.HConnectionManager$HConnectionImplementation(987): Looked up root region location, connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033; serverName=p0420.sjc.cloudera.com,60875,1408686379690 2014-08-21 22:46:49,629 DEBUG [ Thread -609] zookeeper.ZKUtil(423): hconnection-0x147fc404e830007 Set watcher on existing znode /hbase/root-region-server 2014-08-21 22:46:49,630 DEBUG [ Thread -609] zookeeper.ZKUtil(1599): hconnection-0x147fc404e830007 Retrieved 42 byte (s) of data from znode /hbase/root-region-server and set watcher; p0420.sjc.cloudera.com,60875,... 2014-08-21 22:46:49,630 DEBUG [ Thread -609] zookeeper.ZKUtil(1599): hconnection-0x147fc404e830007 Retrieved 42 byte (s) of data from znode /hbase/root-region-server and set watcher; p0420.sjc.cloudera.com,60875,... 2014-08-21 22:46:49,631 DEBUG [ Thread -609] client.MetaScanner(182): Scanning -ROOT- starting at row= for max=2147483647 rows using org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 2014-08-21 22:46:49,632 DEBUG [ Thread -609] zookeeper.ZKUtil(1599): hconnection-0x147fc404e830007 Retrieved 42 byte (s) of data from znode /hbase/root-region-server and set watcher; p0420.sjc.cloudera.com,60875,... 2014-08-21 22:46:49,632 DEBUG [ Thread -609] client.HConnectionManager$HConnectionImplementation(987): Looked up root region location, connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033; serverName=p0420.sjc.cloudera.com,60875,1408686379690 2014-08-21 22:46:49,636 DEBUG [ Thread -609] client.MetaScanner(182): Scanning .META. starting at row= for max=2147483647 rows using org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 2014-08-21 22:46:49,646 INFO [ Thread -609] util.HBaseFsck(2464): getHTableDescriptors == tableNames => [] 2014-08-21 22:46:49,667 WARN [ Thread -609] conf.Configuration(981): fs. default .name is deprecated. Instead, use fs.defaultFS 2014-08-21 22:46:49,673 DEBUG [ Thread -609] util.HBaseFsck(1310): Loading region dirs from hdfs: //localhost:58811/user/jenkins/hbase/-ROOT- 2014-08-21 22:46:49,674 DEBUG [ Thread -609] util.HBaseFsck(1310): Loading region dirs from hdfs: //localhost:58811/user/jenkins/hbase/.META. 2014-08-21 22:46:49,674 DEBUG [ Thread -609] util.HBaseFsck(1310): Loading region dirs from hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile 2014-08-21 22:46:49,676 DEBUG [pool-67-thread-1] util.HBaseFsck$WorkItemHdfsDir(3133): Loading region info from hdfs:hdfs: //localhost:58811/user/jenkins/hbase/-ROOT-/70236052 2014-08-21 22:46:49,677 DEBUG [pool-67-thread-7] util.HBaseFsck$WorkItemHdfsDir(3133): Loading region info from hdfs:hdfs: //localhost:58811/user/jenkins/hbase/.META./1028785192 2014-08-21 22:46:49,681 DEBUG [pool-67-thread-9] util.HBaseFsck$WorkItemHdfsDir(3133): Loading region info from hdfs:hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212 2014-08-21 22:46:49,724 DEBUG [pool-67-thread-9] util.HBaseFsck$WorkItemHdfsDir(3133): Loading region info from hdfs:hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5 2014-08-21 22:46:49,727 DEBUG [pool-67-thread-9] util.HBaseFsck$WorkItemHdfsDir(3133): Loading region info from hdfs:hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372 2014-08-21 22:46:49,729 DEBUG [pool-67-thread-9] util.HBaseFsck$WorkItemHdfsDir(3133): Loading region info from hdfs:hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214 2014-08-21 22:46:49,736 DEBUG [pool-67-thread-6] util.HBaseFsck(734): HRegionInfo read: {NAME => '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED => 1028785192,} 2014-08-21 22:46:49,737 DEBUG [pool-67-thread-3] util.HBaseFsck(734): HRegionInfo read: {NAME => 'testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.', STARTKEY => 'C', ENDKEY => '', ENCODED => c425f751446d62d8f4a9d9f5d8811214,} 2014-08-21 22:46:49,777 DEBUG [pool-67-thread-5] util.HBaseFsck(734): HRegionInfo read: {NAME => 'testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.', STARTKEY => 'B', ENDKEY => 'C', ENCODED => 1644a212531c3b43dde748d401c7e212,} 2014-08-21 22:46:49,777 DEBUG [pool-67-thread-4] util.HBaseFsck(734): HRegionInfo read: {NAME => 'testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.', STARTKEY => '', ENDKEY => 'A', ENCODED => a8edbdfb2e9b02881ebc1702752b2372,} 2014-08-21 22:46:49,777 DEBUG [pool-67-thread-8] util.HBaseFsck(734): HRegionInfo read: {NAME => '-ROOT-,,0', STARTKEY => '', ENDKEY => '', ENCODED => 70236052,} 2014-08-21 22:46:49,777 DEBUG [pool-67-thread-10] util.HBaseFsck(734): HRegionInfo read: {NAME => 'testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.', STARTKEY => 'A', ENDKEY => 'B', ENCODED => 1eeb1332ce0a2f3b96882b0ec1572dc5,} 2014-08-21 22:46:49,785 DEBUG [ Thread -609] zookeeper.ZKUtil(1599): hconnection-0x147fc404e830007 Retrieved 8 byte (s) of data from znode /hbase/table/testQuarantineMissingHFile; data=DISABLED 2014-08-21 22:46:49,786 INFO [ Thread -609] util.HBaseFsck(1623): Region { meta => testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212., hdfs => hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212, deployed => } is in META, and in a disabled tabled that is not deployed 2014-08-21 22:46:49,786 INFO [ Thread -609] util.HBaseFsck(1623): Region { meta => testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5., hdfs => hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5, deployed => } is in META, and in a disabled tabled that is not deployed 2014-08-21 22:46:49,786 INFO [ Thread -609] util.HBaseFsck(1623): Region { meta => testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372., hdfs => hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372, deployed => } is in META, and in a disabled tabled that is not deployed 2014-08-21 22:46:49,786 INFO [ Thread -609] util.HBaseFsck(1623): Region { meta => testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214., hdfs => hdfs: //localhost:58811/user/jenkins/hbase/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214, deployed => } is in META, and in a disabled tabled that is not deployed 2014-08-21 22:46:49,786 DEBUG [ Thread -609] util.HBaseFsck(1777): There are 6 region info entries 2014-08-21 22:46:49,788 INFO [IPC Server handler 4 on 37883] master.HMaster(1249): BalanceSwitch= true 2014-08-21 22:46:49,874 WARN [ Thread -609] conf.Configuration(981): fs. default .name is deprecated. Instead, use fs.defaultFS 2014-08-21 22:46:49,877 DEBUG [ Thread -609] zookeeper.ZKUtil(120): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 opening connection to ZooKeeper with ensemble (localhost:63891) 2014-08-21 22:46:49,886 DEBUG [ Thread -609-EventThread] zookeeper.ZooKeeperWatcher(294): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Received ZooKeeper Event, type=None, state=SyncConnected, path= null 2014-08-21 22:46:49,888 INFO [ Thread -609] zookeeper.RecoverableZooKeeper(104): The identifier of this process is 10184@p0420.sjc.cloudera.com 2014-08-21 22:46:49,888 DEBUG [ Thread -609] catalog.CatalogTracker(210): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@6b5a0316 2014-08-21 22:46:49,888 DEBUG [ Thread -609-EventThread] zookeeper.ZooKeeperWatcher(371): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830025 connected 2014-08-21 22:46:49,891 DEBUG [ Thread -609] zookeeper.ZKUtil(423): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830025 Set watcher on existing znode /hbase/root-region-server 2014-08-21 22:46:49,892 DEBUG [ Thread -609] zookeeper.ZKUtil(1599): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830025 Retrieved 42 byte (s) of data from znode /hbase/root-region-server and set watcher; p0420.sjc.cloudera.com,60875,... 2014-08-21 22:46:49,892 DEBUG [ Thread -609] zookeeper.ZKUtil(425): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830025 /hbase/unassigned/1028785192 does not exist. Watcher is set. 2014-08-21 22:46:49,894 DEBUG [ Thread -609] zookeeper.ZKUtil(1599): hconnection-0x147fc404e830007 Retrieved 42 byte (s) of data from znode /hbase/root-region-server and set watcher; p0420.sjc.cloudera.com,60875,... 2014-08-21 22:46:49,894 DEBUG [ Thread -609] client.HConnectionManager$HConnectionImplementation(987): Looked up root region location, connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033; serverName=p0420.sjc.cloudera.com,60875,1408686379690 2014-08-21 22:46:49,896 DEBUG [ Thread -609] client.HConnectionManager$HConnectionImplementation(1404): Cached location for .META.,,1.1028785192 is p0420.sjc.cloudera.com:60875 2014-08-21 22:46:49,897 DEBUG [ Thread -609] client.ClientScanner(90): Creating scanner over .META. starting at key 'testQuarantineMissingHFile,,' 2014-08-21 22:46:49,897 DEBUG [ Thread -609] client.ClientScanner(203): Advancing internal scanner to startKey at 'testQuarantineMissingHFile,,' 2014-08-21 22:46:49,900 DEBUG [ Thread -609] catalog.CatalogTracker(227): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@6b5a0316 2014-08-21 22:46:49,909 DEBUG [ Thread -609] zookeeper.ZKUtil(1599): hconnection-0x147fc404e830007 Retrieved 8 byte (s) of data from znode /hbase/table/testQuarantineMissingHFile; data=DISABLED 2014-08-21 22:46:49,910 DEBUG [ Thread -609] zookeeper.ZKUtil(120): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 opening connection to ZooKeeper with ensemble (localhost:63891) 2014-08-21 22:46:49,912 INFO [ Thread -609] zookeeper.RecoverableZooKeeper(104): The identifier of this process is 10184@p0420.sjc.cloudera.com 2014-08-21 22:46:49,912 DEBUG [ Thread -609] catalog.CatalogTracker(210): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@51cb3ec4 2014-08-21 22:46:49,924 DEBUG [ Thread -609-EventThread] zookeeper.ZooKeeperWatcher(294): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Received ZooKeeper Event, type=None, state=SyncConnected, path= null 2014-08-21 22:46:49,925 DEBUG [ Thread -609] zookeeper.ZKUtil(423): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Set watcher on existing znode /hbase/root-region-server 2014-08-21 22:46:49,925 DEBUG [ Thread -609] zookeeper.ZKUtil(1599): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033 Retrieved 42 byte (s) of data from znode /hbase/root-region-server and set watcher; p0420.sjc.cloudera.com,60875,... 2014-08-21 22:46:49,926 DEBUG [ Thread -609] zookeeper.ZKUtil(425): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830026 /hbase/unassigned/1028785192 does not exist. Watcher is set. 2014-08-21 22:46:49,927 DEBUG [ Thread -609] client.ClientScanner(90): Creating scanner over .META. starting at key 'testQuarantineMissingHFile,,' 2014-08-21 22:46:49,927 DEBUG [ Thread -609] client.ClientScanner(203): Advancing internal scanner to startKey at 'testQuarantineMissingHFile,,' 2014-08-21 22:46:49,927 DEBUG [ Thread -609-EventThread] zookeeper.ZooKeeperWatcher(371): catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a5d5033-0x147fc404e830026 connected 2014-08-21 22:46:49,930 DEBUG [ Thread -609] catalog.CatalogTracker(227): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@51cb3ec4 2014-08-21 22:46:49,942 DEBUG [ Thread -609] zookeeper.ZKUtil(1599): hconnection-0x147fc404e830007 Retrieved 8 byte (s) of data from znode /hbase/table/testQuarantineMissingHFile; data=DISABLED 2014-08-21 22:46:49,945 DEBUG [IPC Server handler 1 on 37883] client.ClientScanner(90): Creating scanner over .META. starting at key 'testQuarantineMissingHFile,,' 2014-08-21 22:46:49,945 DEBUG [IPC Server handler 1 on 37883] client.ClientScanner(203): Advancing internal scanner to startKey at 'testQuarantineMissingHFile,,' 2014-08-21 22:46:49,957 INFO [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.TableEventHandler(93): Handling table operation C_M_DELETE_TABLE on table testQuarantineMissingHFile 2014-08-21 22:46:49,958 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] client.ClientScanner(90): Creating scanner over .META. starting at key 'testQuarantineMissingHFile,,' 2014-08-21 22:46:49,958 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] client.ClientScanner(203): Advancing internal scanner to startKey at 'testQuarantineMissingHFile,,' 2014-08-21 22:46:49,963 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] client.ClientScanner(190): Finished with scanning at {NAME => '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED => 1028785192,} 2014-08-21 22:46:49,964 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DeleteTableHandler(75): Deleting regions from META 2014-08-21 22:46:49,968 INFO [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] catalog.MetaEditor(328): Deleted from META, regions: [{NAME => 'testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372.', STARTKEY => '', ENDKEY => 'A', ENCODED => a8edbdfb2e9b02881ebc1702752b2372,}, {NAME => 'testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5.', STARTKEY => 'A', ENDKEY => 'B', ENCODED => 1eeb1332ce0a2f3b96882b0ec1572dc5,}, {NAME => 'testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212.', STARTKEY => 'B', ENDKEY => 'C', ENCODED => 1644a212531c3b43dde748d401c7e212,}, {NAME => 'testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214.', STARTKEY => 'C', ENDKEY => '', ENCODED => c425f751446d62d8f4a9d9f5d8811214,}] 2014-08-21 22:46:49,968 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DeleteTableHandler(79): Moving table directory to a temp directory 2014-08-21 22:46:49,986 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DeleteTableHandler(87): Archiving region testQuarantineMissingHFile,,1408686406710.a8edbdfb2e9b02881ebc1702752b2372. from FS 2014-08-21 22:46:49,986 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(95): ARCHIVING region hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372 2014-08-21 22:46:49,986 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(113): Have an archive directory, preparing to move files 2014-08-21 22:46:49,990 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(135): Archiving:[class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/fam] 2014-08-21 22:46:49,991 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(284): Starting to archive files:[class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/fam] 2014-08-21 22:46:49,991 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(318): moving files to the archive directory: hdfs: //localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372 2014-08-21 22:46:50,044 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(326): Created archive directory:hdfs: //localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372 2014-08-21 22:46:50,044 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(334): Archiving:class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/fam 2014-08-21 22:46:50,045 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(343): class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/fam is a directory, archiving children files 2014-08-21 22:46:50,047 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(318): moving files to the archive directory: hdfs: //localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/fam 2014-08-21 22:46:50,094 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(326): Created archive directory:hdfs: //localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/fam 2014-08-21 22:46:50,094 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(334): Archiving:class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/fam/231f0c27ede84a77a6e0a64aeb8887ce 2014-08-21 22:46:50,096 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(402): No existing file in archive for :hdfs: //localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/fam/231f0c27ede84a77a6e0a64aeb8887ce, free to archive original file. 2014-08-21 22:46:50,119 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(437): Finished archiving file from: class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/fam/231f0c27ede84a77a6e0a64aeb8887ce, to: hdfs://localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372/fam/231f0c27ede84a77a6e0a64aeb8887ce 2014-08-21 22:46:50,119 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(146): Successfully resolved and archived, now can just delete region. 2014-08-21 22:46:50,135 INFO [IPC Server handler 5 on 58811] blockmanagement.BlockManager(989): BLOCK* addToInvalidates: blk_1232571622821848185_1091 127.0.0.1:40206 127.0.0.1:40670 127.0.0.1:34823 2014-08-21 22:46:50,136 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(480): Deleted all region files in: hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/a8edbdfb2e9b02881ebc1702752b2372 2014-08-21 22:46:50,136 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DeleteTableHandler(87): Archiving region testQuarantineMissingHFile,A,1408686406710.1eeb1332ce0a2f3b96882b0ec1572dc5. from FS 2014-08-21 22:46:50,136 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(95): ARCHIVING region hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5 2014-08-21 22:46:50,137 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(113): Have an archive directory, preparing to move files 2014-08-21 22:46:50,142 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(135): Archiving:[class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/fam] 2014-08-21 22:46:50,142 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(284): Starting to archive files:[class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/fam] 2014-08-21 22:46:50,142 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(318): moving files to the archive directory: hdfs: //localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5 2014-08-21 22:46:50,169 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(326): Created archive directory:hdfs: //localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5 2014-08-21 22:46:50,169 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(334): Archiving:class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/fam 2014-08-21 22:46:50,170 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(343): class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/fam is a directory, archiving children files 2014-08-21 22:46:50,173 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(318): moving files to the archive directory: hdfs: //localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/fam 2014-08-21 22:46:50,202 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(326): Created archive directory:hdfs: //localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/fam 2014-08-21 22:46:50,202 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(334): Archiving:class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/fam/7cec52ed390b4af3a2a3b04be32b91ed 2014-08-21 22:46:50,204 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(402): No existing file in archive for :hdfs: //localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/fam/7cec52ed390b4af3a2a3b04be32b91ed, free to archive original file. 2014-08-21 22:46:50,269 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(437): Finished archiving file from: class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/fam/7cec52ed390b4af3a2a3b04be32b91ed, to: hdfs://localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5/fam/7cec52ed390b4af3a2a3b04be32b91ed 2014-08-21 22:46:50,269 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(146): Successfully resolved and archived, now can just delete region. 2014-08-21 22:46:50,293 INFO [IPC Server handler 3 on 58811] blockmanagement.BlockManager(989): BLOCK* addToInvalidates: blk_214010544537184802_1093 127.0.0.1:34823 127.0.0.1:40206 127.0.0.1:40670 2014-08-21 22:46:50,294 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(480): Deleted all region files in: hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1eeb1332ce0a2f3b96882b0ec1572dc5 2014-08-21 22:46:50,295 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DeleteTableHandler(87): Archiving region testQuarantineMissingHFile,B,1408686406710.1644a212531c3b43dde748d401c7e212. from FS 2014-08-21 22:46:50,295 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(95): ARCHIVING region hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212 2014-08-21 22:46:50,295 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(113): Have an archive directory, preparing to move files 2014-08-21 22:46:50,299 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(135): Archiving:[class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/fam] 2014-08-21 22:46:50,299 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(284): Starting to archive files:[class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/fam] 2014-08-21 22:46:50,299 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(318): moving files to the archive directory: hdfs: //localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212 2014-08-21 22:46:50,385 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(326): Created archive directory:hdfs: //localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212 2014-08-21 22:46:50,386 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(334): Archiving:class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/fam 2014-08-21 22:46:50,387 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(343): class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212/fam is a directory, archiving children files 2014-08-21 22:46:50,389 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(146): Successfully resolved and archived, now can just delete region. 2014-08-21 22:46:50,410 INFO [IPC Server handler 3 on 58811] blockmanagement.BlockManager(989): BLOCK* addToInvalidates: blk_4217073309354766419_1094 127.0.0.1:40206 127.0.0.1:40670 127.0.0.1:34823 2014-08-21 22:46:50,411 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(480): Deleted all region files in: hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/1644a212531c3b43dde748d401c7e212 2014-08-21 22:46:50,411 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DeleteTableHandler(87): Archiving region testQuarantineMissingHFile,C,1408686406710.c425f751446d62d8f4a9d9f5d8811214. from FS 2014-08-21 22:46:50,411 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(95): ARCHIVING region hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214 2014-08-21 22:46:50,412 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(113): Have an archive directory, preparing to move files 2014-08-21 22:46:50,415 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(135): Archiving:[class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/fam] 2014-08-21 22:46:50,416 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(284): Starting to archive files:[class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/fam] 2014-08-21 22:46:50,416 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(318): moving files to the archive directory: hdfs: //localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214 2014-08-21 22:46:50,469 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(326): Created archive directory:hdfs: //localhost:58811/user/jenkins/hbase/.archive/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214 2014-08-21 22:46:50,469 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(334): Archiving:class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/fam 2014-08-21 22:46:50,470 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(343): class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214/fam is a directory, archiving children files 2014-08-21 22:46:50,472 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(146): Successfully resolved and archived, now can just delete region. 2014-08-21 22:46:50,502 INFO [IPC Server handler 3 on 58811] blockmanagement.BlockManager(989): BLOCK* addToInvalidates: blk_-8586672548042035946_1092 127.0.0.1:40206 127.0.0.1:40670 127.0.0.1:34823 2014-08-21 22:46:50,503 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] backup.HFileArchiver(480): Deleted all region files in: hdfs: //localhost:58811/user/jenkins/hbase/.tmp/testQuarantineMissingHFile/c425f751446d62d8f4a9d9f5d8811214 2014-08-21 22:46:50,527 INFO [IPC Server handler 1 on 58811] blockmanagement.BlockManager(989): BLOCK* addToInvalidates: blk_7267598665009752386_1086 127.0.0.1:34823 127.0.0.1:40206 127.0.0.1:40670 2014-08-21 22:46:50,528 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DeleteTableHandler(97): Table 'testQuarantineMissingHFile' archived! 2014-08-21 22:46:50,528 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DeleteTableHandler(100): Removing 'testQuarantineMissingHFile' descriptor. 2014-08-21 22:46:50,529 DEBUG [MASTER_TABLE_OPERATIONS-p0420.sjc.cloudera.com,37883,1408686379181-0] handler.DeleteTableHandler(104): Marking 'testQuarantineMissingHFile' as deleted. 2014-08-21 22:46:50,968 INFO [ Thread -609] client.HBaseAdmin(656): Deleted testQuarantineMissingHFile 2014-08-21 22:46:50,982 INFO [pool-1-thread-1] hbase.ResourceChecker(157): after util.TestHBaseFsck#testQuarantineMissingHFile: 398 threads (was 385), 603 file descriptors (was 600). 5 connections (was 5), -thread leak?- -file handle leak?- 2014-08-21 22:46:50,995 INFO [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - DataXceiver for client DFSClient_NONMAPREDUCE_-1466515135_8 at /127.0.0.1:43833 [Waiting for operation #6] 2014-08-21 22:46:50,995 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) 2014-08-21 22:46:50,996 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) 2014-08-21 22:46:50,996 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) 2014-08-21 22:46:50,996 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) 2014-08-21 22:46:50,996 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) 2014-08-21 22:46:50,996 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:336) 2014-08-21 22:46:50,996 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:158) 2014-08-21 22:46:50,997 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:156) 2014-08-21 22:46:50,997 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:129) 2014-08-21 22:46:50,997 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.io.BufferedInputStream.fill(BufferedInputStream.java:218) 2014-08-21 22:46:50,997 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.io.BufferedInputStream.read(BufferedInputStream.java:237) 2014-08-21 22:46:50,997 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.io.DataInputStream.readShort(DataInputStream.java:295) 2014-08-21 22:46:50,998 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:51) 2014-08-21 22:46:50,998 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:198) 2014-08-21 22:46:50,998 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.lang. Thread .run( Thread .java:662) 2014-08-21 22:46:50,998 INFO [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - pool-67-thread-3 2014-08-21 22:46:50,998 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.misc.Unsafe.park(Native Method) 2014-08-21 22:46:50,999 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.locks.LockSupport.park(LockSupport.java:156) 2014-08-21 22:46:50,999 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) 2014-08-21 22:46:50,999 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.DelayQueue.take(DelayQueue.java:160) 2014-08-21 22:46:50,999 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) 2014-08-21 22:46:50,999 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) 2014-08-21 22:46:50,999 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) 2014-08-21 22:46:51,000 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) 2014-08-21 22:46:51,000 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.lang. Thread .run( Thread .java:662) 2014-08-21 22:46:51,000 INFO [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - DataXceiver for client DFSClient_NONMAPREDUCE_-1466515135_8 at /127.0.0.1:34869 [Waiting for operation #5] 2014-08-21 22:46:51,000 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) 2014-08-21 22:46:51,000 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) 2014-08-21 22:46:51,001 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) 2014-08-21 22:46:51,001 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) 2014-08-21 22:46:51,001 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) 2014-08-21 22:46:51,001 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:336) 2014-08-21 22:46:51,001 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:158) 2014-08-21 22:46:51,001 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:156) 2014-08-21 22:46:51,002 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:129) 2014-08-21 22:46:51,002 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.io.BufferedInputStream.fill(BufferedInputStream.java:218) 2014-08-21 22:46:51,002 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.io.BufferedInputStream.read(BufferedInputStream.java:237) 2014-08-21 22:46:51,002 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.io.DataInputStream.readShort(DataInputStream.java:295) 2014-08-21 22:46:51,002 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:51) 2014-08-21 22:46:51,002 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:198) 2014-08-21 22:46:51,003 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.lang. Thread .run( Thread .java:662) 2014-08-21 22:46:51,003 INFO [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - pool-67-thread-9 2014-08-21 22:46:51,003 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.misc.Unsafe.park(Native Method) 2014-08-21 22:46:51,003 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.locks.LockSupport.park(LockSupport.java:156) 2014-08-21 22:46:51,003 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) 2014-08-21 22:46:51,003 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.DelayQueue.take(DelayQueue.java:160) 2014-08-21 22:46:51,004 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) 2014-08-21 22:46:51,004 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) 2014-08-21 22:46:51,004 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) 2014-08-21 22:46:51,004 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) 2014-08-21 22:46:51,004 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.lang. Thread .run( Thread .java:662) 2014-08-21 22:46:51,005 INFO [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - DataXceiver for client DFSClient_NONMAPREDUCE_-1466515135_8 at /127.0.0.1:43845 [Waiting for operation #2] 2014-08-21 22:46:51,005 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) 2014-08-21 22:46:51,005 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) 2014-08-21 22:46:51,005 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) 2014-08-21 22:46:51,005 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) 2014-08-21 22:46:51,005 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) 2014-08-21 22:46:51,006 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:336) 2014-08-21 22:46:51,006 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:158) 2014-08-21 22:46:51,006 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:156) 2014-08-21 22:46:51,006 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:129) 2014-08-21 22:46:51,006 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.io.BufferedInputStream.fill(BufferedInputStream.java:218) 2014-08-21 22:46:51,007 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.io.BufferedInputStream.read(BufferedInputStream.java:237) 2014-08-21 22:46:51,007 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.io.DataInputStream.readShort(DataInputStream.java:295) 2014-08-21 22:46:51,007 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:51) 2014-08-21 22:46:51,007 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:198) 2014-08-21 22:46:51,007 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.lang. Thread .run( Thread .java:662) 2014-08-21 22:46:51,008 INFO [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - pool-67-thread-8 2014-08-21 22:46:51,008 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.misc.Unsafe.park(Native Method) 2014-08-21 22:46:51,008 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.locks.LockSupport.park(LockSupport.java:156) 2014-08-21 22:46:51,008 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) 2014-08-21 22:46:51,008 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.DelayQueue.take(DelayQueue.java:160) 2014-08-21 22:46:51,008 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) 2014-08-21 22:46:51,009 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) 2014-08-21 22:46:51,009 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) 2014-08-21 22:46:51,009 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) 2014-08-21 22:46:51,009 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.lang. Thread .run( Thread .java:662) 2014-08-21 22:46:51,009 INFO [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - DataXceiver for client DFSClient_NONMAPREDUCE_-1466515135_8 at /127.0.0.1:34874 [Waiting for operation #4] 2014-08-21 22:46:51,010 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) 2014-08-21 22:46:51,010 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) 2014-08-21 22:46:51,010 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) 2014-08-21 22:46:51,010 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) 2014-08-21 22:46:51,010 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) 2014-08-21 22:46:51,010 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:336) 2014-08-21 22:46:51,011 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:158) 2014-08-21 22:46:51,011 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:156) 2014-08-21 22:46:51,011 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:129) 2014-08-21 22:46:51,011 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.io.BufferedInputStream.fill(BufferedInputStream.java:218) 2014-08-21 22:46:51,011 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.io.BufferedInputStream.read(BufferedInputStream.java:237) 2014-08-21 22:46:51,012 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.io.DataInputStream.readShort(DataInputStream.java:295) 2014-08-21 22:46:51,012 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:51) 2014-08-21 22:46:51,012 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:198) 2014-08-21 22:46:51,012 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.lang. Thread .run( Thread .java:662) 2014-08-21 22:46:51,012 INFO [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - DataXceiver for client DFSClient_NONMAPREDUCE_-1466515135_8 at /127.0.0.1:43470 [Waiting for operation #22] 2014-08-21 22:46:51,012 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) 2014-08-21 22:46:51,013 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) 2014-08-21 22:46:51,013 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) 2014-08-21 22:46:51,013 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) 2014-08-21 22:46:51,013 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) 2014-08-21 22:46:51,013 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:336) 2014-08-21 22:46:51,013 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:158) 2014-08-21 22:46:51,014 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:156) 2014-08-21 22:46:51,014 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:129) 2014-08-21 22:46:51,014 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.io.BufferedInputStream.fill(BufferedInputStream.java:218) 2014-08-21 22:46:51,014 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.io.BufferedInputStream.read(BufferedInputStream.java:237) 2014-08-21 22:46:51,014 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.io.DataInputStream.readShort(DataInputStream.java:295) 2014-08-21 22:46:51,015 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:51) 2014-08-21 22:46:51,015 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:198) 2014-08-21 22:46:51,015 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.lang. Thread .run( Thread .java:662) 2014-08-21 22:46:51,015 INFO [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - pool-67-thread-2 2014-08-21 22:46:51,015 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.misc.Unsafe.park(Native Method) 2014-08-21 22:46:51,016 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.locks.LockSupport.park(LockSupport.java:156) 2014-08-21 22:46:51,016 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) 2014-08-21 22:46:51,016 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.DelayQueue.take(DelayQueue.java:160) 2014-08-21 22:46:51,016 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) 2014-08-21 22:46:51,016 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) 2014-08-21 22:46:51,016 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) 2014-08-21 22:46:51,017 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) 2014-08-21 22:46:51,017 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.lang. Thread .run( Thread .java:662) 2014-08-21 22:46:51,017 INFO [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - pool-67-thread-1 2014-08-21 22:46:51,017 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.misc.Unsafe.park(Native Method) 2014-08-21 22:46:51,017 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.locks.LockSupport.park(LockSupport.java:156) 2014-08-21 22:46:51,017 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) 2014-08-21 22:46:51,018 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.DelayQueue.take(DelayQueue.java:160) 2014-08-21 22:46:51,018 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) 2014-08-21 22:46:51,018 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) 2014-08-21 22:46:51,018 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) 2014-08-21 22:46:51,018 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) 2014-08-21 22:46:51,018 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.lang. Thread .run( Thread .java:662) 2014-08-21 22:46:51,019 INFO [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - pool-67-thread-6 2014-08-21 22:46:51,019 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.misc.Unsafe.park(Native Method) 2014-08-21 22:46:51,019 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.locks.LockSupport.park(LockSupport.java:156) 2014-08-21 22:46:51,019 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) 2014-08-21 22:46:51,019 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.DelayQueue.take(DelayQueue.java:160) 2014-08-21 22:46:51,019 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) 2014-08-21 22:46:51,020 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) 2014-08-21 22:46:51,020 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) 2014-08-21 22:46:51,020 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) 2014-08-21 22:46:51,020 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.lang. Thread .run( Thread .java:662) 2014-08-21 22:46:51,020 INFO [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - hbase-tablepool-123-thread-2 2014-08-21 22:46:51,020 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.misc.Unsafe.park(Native Method) 2014-08-21 22:46:51,021 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) 2014-08-21 22:46:51,021 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:424) 2014-08-21 22:46:51,021 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323) 2014-08-21 22:46:51,021 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:874) 2014-08-21 22:46:51,021 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945) 2014-08-21 22:46:51,022 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) 2014-08-21 22:46:51,022 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.lang. Thread .run( Thread .java:662) 2014-08-21 22:46:51,022 INFO [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - pool-67-thread-7 2014-08-21 22:46:51,022 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.misc.Unsafe.park(Native Method) 2014-08-21 22:46:51,022 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.locks.LockSupport.park(LockSupport.java:156) 2014-08-21 22:46:51,022 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) 2014-08-21 22:46:51,023 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.DelayQueue.take(DelayQueue.java:160) 2014-08-21 22:46:51,023 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) 2014-08-21 22:46:51,023 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) 2014-08-21 22:46:51,023 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) 2014-08-21 22:46:51,023 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) 2014-08-21 22:46:51,023 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.lang. Thread .run( Thread .java:662) 2014-08-21 22:46:51,024 INFO [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - hbase-tablepool-123-thread-3 2014-08-21 22:46:51,024 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.misc.Unsafe.park(Native Method) 2014-08-21 22:46:51,024 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) 2014-08-21 22:46:51,024 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:424) 2014-08-21 22:46:51,024 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323) 2014-08-21 22:46:51,025 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:874) 2014-08-21 22:46:51,025 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945) 2014-08-21 22:46:51,025 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) 2014-08-21 22:46:51,025 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.lang. Thread .run( Thread .java:662) 2014-08-21 22:46:51,025 INFO [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - DataXceiver for client DFSClient_NONMAPREDUCE_-1466515135_8 at /127.0.0.1:55621 [Waiting for operation #2] 2014-08-21 22:46:51,025 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) 2014-08-21 22:46:51,026 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) 2014-08-21 22:46:51,026 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) 2014-08-21 22:46:51,026 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) 2014-08-21 22:46:51,026 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) 2014-08-21 22:46:51,026 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:336) 2014-08-21 22:46:51,026 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:158) 2014-08-21 22:46:51,027 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:156) 2014-08-21 22:46:51,027 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:129) 2014-08-21 22:46:51,027 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.io.BufferedInputStream.fill(BufferedInputStream.java:218) 2014-08-21 22:46:51,027 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.io.BufferedInputStream.read(BufferedInputStream.java:237) 2014-08-21 22:46:51,027 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.io.DataInputStream.readShort(DataInputStream.java:295) 2014-08-21 22:46:51,028 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:51) 2014-08-21 22:46:51,028 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:198) 2014-08-21 22:46:51,028 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.lang. Thread .run( Thread .java:662) 2014-08-21 22:46:51,028 INFO [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - DataXceiver for client DFSClient_NONMAPREDUCE_-1466515135_8 at /127.0.0.1:55531 [Waiting for operation #15] 2014-08-21 22:46:51,028 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) 2014-08-21 22:46:51,028 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) 2014-08-21 22:46:51,029 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) 2014-08-21 22:46:51,029 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) 2014-08-21 22:46:51,029 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) 2014-08-21 22:46:51,029 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:336) 2014-08-21 22:46:51,029 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:158) 2014-08-21 22:46:51,030 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:156) 2014-08-21 22:46:51,030 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:129) 2014-08-21 22:46:51,030 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.io.BufferedInputStream.fill(BufferedInputStream.java:218) 2014-08-21 22:46:51,030 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.io.BufferedInputStream.read(BufferedInputStream.java:237) 2014-08-21 22:46:51,030 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.io.DataInputStream.readShort(DataInputStream.java:295) 2014-08-21 22:46:51,030 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:51) 2014-08-21 22:46:51,031 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:198) 2014-08-21 22:46:51,031 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.lang. Thread .run( Thread .java:662) 2014-08-21 22:46:51,031 INFO [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - pool-67-thread-10 2014-08-21 22:46:51,031 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.misc.Unsafe.park(Native Method) 2014-08-21 22:46:51,031 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.locks.LockSupport.park(LockSupport.java:156) 2014-08-21 22:46:51,032 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) 2014-08-21 22:46:51,032 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.DelayQueue.take(DelayQueue.java:160) 2014-08-21 22:46:51,032 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) 2014-08-21 22:46:51,032 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) 2014-08-21 22:46:51,032 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) 2014-08-21 22:46:51,032 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) 2014-08-21 22:46:51,033 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.lang. Thread .run( Thread .java:662) 2014-08-21 22:46:51,033 INFO [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - hbase-tablepool-123-thread-1 2014-08-21 22:46:51,033 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.misc.Unsafe.park(Native Method) 2014-08-21 22:46:51,033 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) 2014-08-21 22:46:51,033 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:424) 2014-08-21 22:46:51,034 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323) 2014-08-21 22:46:51,034 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:874) 2014-08-21 22:46:51,034 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945) 2014-08-21 22:46:51,034 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) 2014-08-21 22:46:51,034 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.lang. Thread .run( Thread .java:662) 2014-08-21 22:46:51,034 INFO [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - DataXceiver for client DFSClient_NONMAPREDUCE_-1466515135_8 at /127.0.0.1:34859 [Waiting for operation #5] 2014-08-21 22:46:51,035 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) 2014-08-21 22:46:51,035 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) 2014-08-21 22:46:51,035 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) 2014-08-21 22:46:51,035 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) 2014-08-21 22:46:51,035 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) 2014-08-21 22:46:51,035 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:336) 2014-08-21 22:46:51,036 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:158) 2014-08-21 22:46:51,036 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:156) 2014-08-21 22:46:51,036 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:129) 2014-08-21 22:46:51,036 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.io.BufferedInputStream.fill(BufferedInputStream.java:218) 2014-08-21 22:46:51,036 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.io.BufferedInputStream.read(BufferedInputStream.java:237) 2014-08-21 22:46:51,037 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.io.DataInputStream.readShort(DataInputStream.java:295) 2014-08-21 22:46:51,037 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:51) 2014-08-21 22:46:51,037 INFO [pool-1-thread-1] hbase.ResourceChecker(185): org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:198) 2014-08-21 22:46:51,037 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.lang. Thread .run( Thread .java:662) 2014-08-21 22:46:51,037 INFO [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - pool-67-thread-5 2014-08-21 22:46:51,037 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.misc.Unsafe.park(Native Method) 2014-08-21 22:46:51,038 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.locks.LockSupport.park(LockSupport.java:156) 2014-08-21 22:46:51,038 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) 2014-08-21 22:46:51,038 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.DelayQueue.take(DelayQueue.java:160) 2014-08-21 22:46:51,038 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) 2014-08-21 22:46:51,038 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) 2014-08-21 22:46:51,038 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) 2014-08-21 22:46:51,039 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) 2014-08-21 22:46:51,039 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.lang. Thread .run( Thread .java:662) 2014-08-21 22:46:51,039 INFO [pool-1-thread-1] hbase.ResourceChecker(182): after util.TestHBaseFsck#testQuarantineMissingHFile: potentially hanging thread - pool-67-thread-4 2014-08-21 22:46:51,039 INFO [pool-1-thread-1] hbase.ResourceChecker(185): sun.misc.Unsafe.park(Native Method) 2014-08-21 22:46:51,039 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.locks.LockSupport.park(LockSupport.java:156) 2014-08-21 22:46:51,040 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) 2014-08-21 22:46:51,040 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.DelayQueue.take(DelayQueue.java:160) 2014-08-21 22:46:51,040 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) 2014-08-21 22:46:51,040 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) 2014-08-21 22:46:51,040 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) 2014-08-21 22:46:51,040 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) 2014-08-21 22:46:51,041 INFO [pool-1-thread-1] hbase.ResourceChecker(185): java.lang. Thread .run( Thread .java:662)
        Hide
        stack added a comment -

        This is not same as HBASE-9851

        Show
        stack added a comment - This is not same as HBASE-9851

          People

          • Assignee:
            Unassigned
            Reporter:
            stack
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:

              Development