Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-3515

[replication] ReplicationSource can miss a log after RS comes out of GC

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 0.90.0
    • Fix Version/s: 0.92.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      This is from Hudson build 1738, if a log is about to be rolled and the ZK connection is already closed then the replication code will fail at adding the new log in ZK but the log will still be rolled and it's possible that some edits will make it in.

      From the log:

      2011-02-08 10:21:20,618 FATAL [RegionServer:0;vesta.apache.org,46117,1297160399378.logRoller] regionserver.HRegionServer(1383):
      ABORTING region server serverName=vesta.apache.org,46117,1297160399378, load=(requests=1525, regions=12,
      usedHeap=273, maxHeap=1244): Failed add log to list
      org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for
      /1/replication/rs/vesta.apache.org,46117,1297160399378/2/vesta.apache.org%3A46117.1297160480509
      ...

      2011-02-08 10:21:22,444 DEBUG [MASTER_META_SERVER_OPERATIONS-vesta.apache.org:56008-0] wal.HLogSplitter(258):
      Splitting hlog 8 of 8: hdfs://localhost:55474/user/hudson/.logs/vesta.apache.org,46117,1297160399378/vesta.apache.org%3A46117.1297160480509, length=0

      2011-02-08 10:21:22,862 DEBUG [MASTER_META_SERVER_OPERATIONS-vesta.apache.org:56008-0] wal.HLogSplitter(436):
      Pushed=31 entries from hdfs://localhost:55474/user/hudson/.logs/vesta.apache.org,46117,1297160399378/vesta.apache.org%3A46117.1297160480509

      The easiest thing to do would be let the exception out and cancel the log roll.

        Attachments

        1. HBASE-3515.patch
          0.6 kB
          Jean-Daniel Cryans
        2. HBASE-3515-v2.patch
          3 kB
          Jean-Daniel Cryans
        3. HBASE-3515-v2-0.92.patch
          4 kB
          Jean-Daniel Cryans

          Issue Links

            Activity

              People

              • Assignee:
                jdcryans Jean-Daniel Cryans
                Reporter:
                jdcryans Jean-Daniel Cryans
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: