Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-2645

HLog writer can do 1-2 sync operations after lease has been recovered for split process.



    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.90.4
    • 0.95.0
    • Filters
    • None
    • 0.96notable


      TestHLogSplit.testLogCannotBeWrittenOnceParsed is failing.

      This test starts a thread that writes one edit to the log, syncs and counts. During this, a HLog.splitLog operation is started. splitLog recovers the log lease before reading the log, so that the original regionserver could not wake up and write after the split process started.
      The test compares the number of edits reported by the split process and by the writer thread. Writer thread (called zombie in the test) should report <= than the splitLog (sync() might raise after the last edit gets written and the edit won't get counted by zombie thread). However it appears that the zombie counts 1-2 more edits. So it looks like it can sync without a lease.

      This might be a hdfs-0.20 related issue.


        1. 2645.txt
          7 kB
          Michael Stack
        2. 2645v2.txt
          14 kB
          Michael Stack
        3. 2645v3.txt
          11 kB
          Michael Stack
        4. org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit-output.txt
          47 kB
          Ted Yu
        5. hdfs_trunk_editswriter_recoverlease.txt
          6 kB
          Michael Stack
        6. hdfs_1.0_editswriter_recoverlease.txt
          8 kB
          Michael Stack
        7. org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit-output.txt
          740 kB
          Michael Stack
        8. 2645_hacking.txt
          51 kB
          Michael Stack
        9. 2645v4.txt
          47 kB
          Michael Stack
        10. 2645-addendum.txt
          0.8 kB
          Michael Stack

        Issue Links



              tlipcon Todd Lipcon
              clehene Cosmin Lehene
              0 Vote for this issue
              9 Start watching this issue