Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-7290 Online snapshots
  3. HBASE-7764

[snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.95.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Here is log snippet for TestSnapshotCloneIndependence#testOnlineSnapshotRegionOperationsIndependent (pay attention to region 1360020297284.2e43e47a882d3cff601eb222cad41f20.):

      2013-02-04 15:24:58,369 INFO  [MASTER_SERVER_OPERATIONS-10.11.2.194,61955,1360020289835-0] handler.SplitRegionHandler(115): Handled SPLIT event; parent=test1360020295791,,1360020295793.794d37c0445b61619b5056623228827d. daughter a=test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.daughter b=test1360020295791,dgb,1360020297284.b87834cee60702d883aa287df6aaeaef.
      ...
      2013-02-04 15:25:02,005 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(78): Starting region operation on test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
      2013-02-04 15:25:02,005 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(81): Flush Snapshotting region test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. started...
      2013-02-04 15:25:02,005 DEBUG [member: '10.11.2.194,61958,1360020290064' subprocedure-pool3-thread-1] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(318): Completed 2/3 local region snapshots.
      2013-02-04 15:25:02,005 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1] regionserver.HRegion(2485): Storing region-info for snapshot.
      2013-02-04 15:25:02,006 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1] util.FSUtils(166): Creating file=hdfs://localhost:61942/user/tyu/hbase/.snapshot/.tmp/snapshot_test1360020295791/2e43e47a882d3cff601eb222cad41f20/.tmp/.regioninfo with permission=rwxrwxrwx
      2013-02-04 15:25:02,014 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1] regionserver.HRegion(2489): Creating references for hfiles
      2013-02-04 15:25:02,014 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1] regionserver.HRegion(2502): Adding snapshot references for [hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02] hfiles
      2013-02-04 15:25:02,015 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1] regionserver.HRegion(2516): Creating reference for file (1/1) : hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02
      2013-02-04 15:25:02,017 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(84): ... Flush Snapshotting region test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. completed.
      2013-02-04 15:25:02,017 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(86): Closing region operation on test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
      ...
      2013-02-04 15:25:03,836 INFO  [PRI IPC Server handler 7 on 61958] regionserver.HRegionServer(3600): Splitting test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
      2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958] regionserver.HStore(1686): cannot split because midkey is the same as first or last row
      2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958] regionserver.CompactSplitThread(172): Region test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. not splittable because midkey=null
      2013-02-04 15:25:03,837 DEBUG [main] catalog.CatalogTracker(231): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@5c602d9d
      2013-02-04 15:25:03,838 INFO  [main] client.TestSnapshotCloneIndependence(307): split requested for test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
      2013-02-04 15:25:03,892 DEBUG [main] client.MetaScanner(199): Scanning .META. starting at row=test1360020295791,,00000000000000 for max=2147483647 rows using hconnection 0x53d9f80
      2013-02-04 15:25:03,895 DEBUG [main] client.MetaScanner(252): Current INFO from scan results = {NAME => 'test1360020295791,,1360020295793.794d37c0445b61619b5056623228827d.', STARTKEY => '', ENDKEY => '', ENCODED => 794d37c0445b61619b5056623228827d, OFFLINE => true, SPLIT => true,}
      2013-02-04 15:25:03,896 DEBUG [main] client.MetaScanner(252): Current INFO from scan results = {NAME => 'test1360020295791,,1360020295793.794d37c0445b61619b5056623228827d.', STARTKEY => '', ENDKEY => '', ENCODED => 794d37c0445b61619b5056623228827d, OFFLINE => true, SPLIT => true,}
      2013-02-04 15:25:03,896 DEBUG [main] client.MetaScanner$BlockingMetaScannerVisitor(441): blocking until region is in META: test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
      2013-02-04 15:25:03,897 DEBUG [main] client.MetaScanner(252): Current INFO from scan results = {NAME => 'test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.', STARTKEY => '', ENDKEY => 'dgb', ENCODED => 2e43e47a882d3cff601eb222cad41f20,}
      2013-02-04 15:25:03,898 DEBUG [main] client.MetaScanner(252): Current INFO from scan results = {NAME => 'test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.', STARTKEY => '', ENDKEY => 'dgb', ENCODED => 2e43e47a882d3cff601eb222cad41f20,}
      2013-02-04 15:25:03,898 DEBUG [main] client.MetaScanner(252): Current INFO from scan results = {NAME => 'test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.', STARTKEY => '', ENDKEY => 'dgb', ENCODED => 2e43e47a882d3cff601eb222cad41f20,}
      2013-02-04 15:25:03,898 DEBUG [main] client.MetaScanner(252): Current INFO from scan results = {NAME => 'test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.', STARTKEY => '', ENDKEY => 'dgb', ENCODED => 2e43e47a882d3cff601eb222cad41f20,}
      

      In the code we choose the first region from the original table to split which happens to be not splittable.

        Attachments

        1. 7764.txt
          0.9 kB
          Ted Yu
        2. 7764-v2.txt
          2 kB
          Ted Yu
        3. 7764-v3.txt
          1 kB
          Ted Yu

          Activity

            People

            • Assignee:
              yuzhihong@gmail.com Ted Yu
              Reporter:
              yuzhihong@gmail.com Ted Yu
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: