HBase
  1. HBase
  2. HBASE-6679

RegionServer aborts due to race between compaction and split

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.94.2
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      In our nightlies, we have seen RS aborts due to compaction and split racing. Original parent file gets deleted after the compaction, and hence, the daughters don't find the parent data file. The RS kills itself when this happens. Will attach a snippet of the relevant RS logs.

      1. rs-crash-parallel-compact-split.log
        376 kB
        Devaraj Das
      2. 6679-1.patch
        0.7 kB
        Devaraj Das
      3. 6679-1.094.patch
        0.6 kB
        stack

        Activity

        stack made changes -
        Fix Version/s 0.94.2 [ 12321884 ]
        Fix Version/s 0.95.0 [ 12324094 ]
        stack made changes -
        Fix Version/s 0.98.0 [ 12323143 ]
        stack made changes -
        Fix Version/s 0.98.0 [ 12323143 ]
        Fix Version/s 0.94.2 [ 12321884 ]
        Lars Hofhansl made changes -
        Fix Version/s 0.94.2 [ 12321884 ]
        Fix Version/s 0.94.3 [ 12323144 ]
        Lars Hofhansl made changes -
        Fix Version/s 0.94.3 [ 12323144 ]
        stack made changes -
        Fix Version/s 0.95.0 [ 12324094 ]
        Fix Version/s 0.96.0 [ 12320040 ]
        Fix Version/s 0.92.3 [ 12321692 ]
        Fix Version/s 0.94.2 [ 12321884 ]
        Lars Hofhansl made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Lars Hofhansl made changes -
        Fix Version/s 0.94.2 [ 12321884 ]
        Fix Version/s 0.94.3 [ 12323144 ]
        stack made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Fix Version/s 0.94.3 [ 12323144 ]
        Fix Version/s 0.96.0 [ 12320040 ]
        Resolution Fixed [ 1 ]
        stack made changes -
        Attachment 6679-1.094.patch [ 12546785 ]
        Devaraj Das made changes -
        Attachment 6679-1.patch [ 12546776 ]
        Ted Yu made changes -
        Fix Version/s 0.92.3 [ 12321692 ]
        Fix Version/s 0.92.2 [ 12319888 ]
        Devaraj Das made changes -
        Description In our nightlies, we have seen RS aborts due to compaction and split racing. Will attach a snippet of the relevant RS logs. In our nightlies, we have seen RS aborts due to compaction and split racing. Original parent file gets deleted after the compaction, and hence, the daughters don't find the parent data file. The RS kills itself when this happens. Will attach a snippet of the relevant RS logs.
        Devaraj Das made changes -
        Field Original Value New Value
        Attachment rs-crash-parallel-compact-split.log [ 12542829 ]
        Devaraj Das created issue -

          People

          • Assignee:
            Devaraj Das
            Reporter:
            Devaraj Das
          • Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development