Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-9736

Alow more than one log splitter per RS

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: MTTR
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      IIRC, this is an idea that came from the lads at Xiaomi.

      I have a small cluster of 6 RSs and one went down. It had a few WALs. I see this in logs:

      2013-10-09 05:47:27,890 DEBUG org.apache.hadoop.hbase.master.SplitLogManager: total tasks = 25 unassigned = 21

      WAL splitting is held up for want of slots out on the cluster to split WALs.

      We need to be careful we don't overwhelm the foreground regionservers but more splitters should help get all back online faster.

        Attachments

        1. hbase-9736.patch
          36 kB
          Jeffrey Zhong

          Activity

            People

            • Assignee:
              jeffreyz Jeffrey Zhong
              Reporter:
              stack Michael Stack
            • Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: