Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-2645

HLog writer can do 1-2 sync operations after lease has been recovered for split process.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.90.4
    • 0.95.0
    • Filters
    • None
    • 0.96notable

    Description

      TestHLogSplit.testLogCannotBeWrittenOnceParsed is failing.

      This test starts a thread that writes one edit to the log, syncs and counts. During this, a HLog.splitLog operation is started. splitLog recovers the log lease before reading the log, so that the original regionserver could not wake up and write after the split process started.
      The test compares the number of edits reported by the split process and by the writer thread. Writer thread (called zombie in the test) should report <= than the splitLog (sync() might raise after the last edit gets written and the edit won't get counted by zombie thread). However it appears that the zombie counts 1-2 more edits. So it looks like it can sync without a lease.

      This might be a hdfs-0.20 related issue.

      Attachments

        1. 2645.txt
          7 kB
          Michael Stack
        2. 2645v2.txt
          14 kB
          Michael Stack
        3. 2645v3.txt
          11 kB
          Michael Stack
        4. org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit-output.txt
          47 kB
          Ted Yu
        5. hdfs_trunk_editswriter_recoverlease.txt
          6 kB
          Michael Stack
        6. hdfs_1.0_editswriter_recoverlease.txt
          8 kB
          Michael Stack
        7. org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit-output.txt
          740 kB
          Michael Stack
        8. 2645_hacking.txt
          51 kB
          Michael Stack
        9. 2645v4.txt
          47 kB
          Michael Stack
        10. 2645-addendum.txt
          0.8 kB
          Michael Stack

        Issue Links

          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. HDFS-1186 0.20: DNs should interrupt writers at start of recovery

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed
          is related to

          Sub-task - The sub-task of the issue HBASE-7636 TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0

          • Major - Major loss of function.
          • Closed

          Activity

            People

              tlipcon Todd Lipcon
              clehene Cosmin Lehene
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: