Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-10935

support snapshot policy where flush memstore can be skipped to prevent production cluster freeze

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 0.94.7, 0.94.18
    • Fix Version/s: 0.99.0, 0.94.21, 0.98.4
    • Component/s: shell, snapshots
    • Labels:
      None

      Description

      We are using snapshot feature to do HBase disaster recovery. We will do snapshot in our production cluster periodically. The current flush snapshot policy require all regions of the table to coordinate to prevent write and do flush at the same time. Since we use WALPlayer to complete the data that is not in the snapshot HFile, we don't need the snapshot to do coordinated flush. The snapshot just recored all the HFile that are already there.

      I added the parameter in the HBase shell. So people can choose to use the NoFlush snapshot when they need, like below. Otherwise, the default flush snpahot support is not impacted.

      >snaphot 'TestTable', 'TestSnapshot', 'skipFlush'

        Attachments

        1. hbase-10935-94.patch
          12 kB
          Tianying Chang
        2. hbase-10935-trunk.patch
          13 kB
          Tianying Chang
        3. HBASE-10935-0.94-v1.patch
          13 kB
          Matteo Bertozzi
        4. HBASE-10935-0.98-v1.patch
          17 kB
          Matteo Bertozzi
        5. HBASE-10935-trunk-v1.patch
          16 kB
          Matteo Bertozzi

          Activity

            People

            • Assignee:
              tychang Tianying Chang
              Reporter:
              tychang Tianying Chang
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Due:
                Created:
                Updated:
                Resolved: