[HBASE-7764] [snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.95.0
• Hadoop Flags: Reviewed
• Assignee: Ted Yu
• Reporter: Ted Yu
• Created: 04/Feb/13 23:49
• Updated: 23/Sep/13 18:30
• Resolved: 08/Feb/13 17:35

Description

Here is log snippet for TestSnapshotCloneIndependence#testOnlineSnapshotRegionOperationsIndependent (pay attention to region 1360020297284.2e43e47a882d3cff601eb222cad41f20.):

2013-02-04 15:24:58,369 INFO  [MASTER_SERVER_OPERATIONS-10.11.2.194,61955,1360020289835-0] handler.SplitRegionHandler(115): Handled SPLIT event; parent=test1360020295791,,1360020295793.794d37c0445b61619b5056623228827d. daughter a=test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.daughter b=test1360020295791,dgb,1360020297284.b87834cee60702d883aa287df6aaeaef.
...
2013-02-04 15:25:02,005 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(78): Starting region operation on test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:02,005 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(81): Flush Snapshotting region test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. started...
2013-02-04 15:25:02,005 DEBUG [member: '10.11.2.194,61958,1360020290064' subprocedure-pool3-thread-1] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(318): Completed 2/3 local region snapshots.
2013-02-04 15:25:02,005 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1] regionserver.HRegion(2485): Storing region-info for snapshot.
2013-02-04 15:25:02,006 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1] util.FSUtils(166): Creating file=hdfs://localhost:61942/user/tyu/hbase/.snapshot/.tmp/snapshot_test1360020295791/2e43e47a882d3cff601eb222cad41f20/.tmp/.regioninfo with permission=rwxrwxrwx
2013-02-04 15:25:02,014 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1] regionserver.HRegion(2489): Creating references for hfiles
2013-02-04 15:25:02,014 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1] regionserver.HRegion(2502): Adding snapshot references for [hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02] hfiles
2013-02-04 15:25:02,015 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1] regionserver.HRegion(2516): Creating reference for file (1/1) : hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02
2013-02-04 15:25:02,017 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(84): ... Flush Snapshotting region test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. completed.
2013-02-04 15:25:02,017 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(86): Closing region operation on test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
...
2013-02-04 15:25:03,836 INFO  [PRI IPC Server handler 7 on 61958] regionserver.HRegionServer(3600): Splitting test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958] regionserver.HStore(1686): cannot split because midkey is the same as first or last row
2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958] regionserver.CompactSplitThread(172): Region test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. not splittable because midkey=null
2013-02-04 15:25:03,837 DEBUG [main] catalog.CatalogTracker(231): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@5c602d9d
2013-02-04 15:25:03,838 INFO  [main] client.TestSnapshotCloneIndependence(307): split requested for test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:03,892 DEBUG [main] client.MetaScanner(199): Scanning .META. starting at row=test1360020295791,,00000000000000 for max=2147483647 rows using hconnection 0x53d9f80
2013-02-04 15:25:03,895 DEBUG [main] client.MetaScanner(252): Current INFO from scan results = {NAME => 'test1360020295791,,1360020295793.794d37c0445b61619b5056623228827d.', STARTKEY => '', ENDKEY => '', ENCODED => 794d37c0445b61619b5056623228827d, OFFLINE => true, SPLIT => true,}
2013-02-04 15:25:03,896 DEBUG [main] client.MetaScanner(252): Current INFO from scan results = {NAME => 'test1360020295791,,1360020295793.794d37c0445b61619b5056623228827d.', STARTKEY => '', ENDKEY => '', ENCODED => 794d37c0445b61619b5056623228827d, OFFLINE => true, SPLIT => true,}
2013-02-04 15:25:03,896 DEBUG [main] client.MetaScanner$BlockingMetaScannerVisitor(441): blocking until region is in META: test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
2013-02-04 15:25:03,897 DEBUG [main] client.MetaScanner(252): Current INFO from scan results = {NAME => 'test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.', STARTKEY => '', ENDKEY => 'dgb', ENCODED => 2e43e47a882d3cff601eb222cad41f20,}
2013-02-04 15:25:03,898 DEBUG [main] client.MetaScanner(252): Current INFO from scan results = {NAME => 'test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.', STARTKEY => '', ENDKEY => 'dgb', ENCODED => 2e43e47a882d3cff601eb222cad41f20,}
2013-02-04 15:25:03,898 DEBUG [main] client.MetaScanner(252): Current INFO from scan results = {NAME => 'test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.', STARTKEY => '', ENDKEY => 'dgb', ENCODED => 2e43e47a882d3cff601eb222cad41f20,}
2013-02-04 15:25:03,898 DEBUG [main] client.MetaScanner(252): Current INFO from scan results = {NAME => 'test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.', STARTKEY => '', ENDKEY => 'dgb', ENCODED => 2e43e47a882d3cff601eb222cad41f20,}

In the code we choose the first region from the original table to split which happens to be not splittable.