Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Invalid
    • Affects Version/s: 0.95.2
    • Fix Version/s: 0.95.0
    • Component/s: None
    • Labels:
    • Tags:
      0.96notable

      Description

      Havening an option to take a snapshot of a table would be vary useful in production.

      What I would like to see this option do is do a merge of all the data into one or more files stored in the same folder on the dfs. This way we could save data in case of a software bug in hadoop or user code.

      The other advantage would be to be able to export a table to multi locations. Say I had a read_only table that must be online. I could take a snapshot of it when needed and export it to a separate data center and have it loaded there and then i would have it online at multi data centers for load balancing and failover.

      I understand that hadoop takes the need out of havening backup to protect from failed servers, but this does not protect use from software bugs that might delete or alter data in ways we did not plan. We should have a way we can roll back a dataset.

      1. Snapshot Class Diagram.png
        91 kB
        Li Chongxin
      2. HBase Snapshot Implementation Plan.pdf
        176 kB
        Li Chongxin
      3. HBase Snapshot Design Report V3.pdf
        98 kB
        Li Chongxin
      4. HBase Snapshot Design Report V2.pdf
        54 kB
        Li Chongxin

        Issue Links

          Activity

          Billy Pearson created issue -
          Bryan Duxbury made changes -
          Field Original Value New Value
          Priority Major [ 3 ] Minor [ 4 ]
          Fix Version/s 0.16.0 [ 12312740 ]
          Fix Version/s 0.17.0 [ 12312913 ]
          Jim Kellerman made changes -
          Issue Type Bug [ 1 ] New Feature [ 2 ]
          Owen O'Malley made changes -
          Project Hadoop Core [ 12310240 ] Hadoop HBase [ 12310753 ]
          Component/s contrib/hbase [ 12311752 ]
          Fix Version/s 0.17.0 [ 12312913 ]
          Key HADOOP-2496 HBASE-50
          Alex Newman made changes -
          Assignee Alex Newman [ posix4e ]
          Alex Newman made changes -
          Status Open [ 1 ] In Progress [ 3 ]
          Alex Newman made changes -
          Status In Progress [ 3 ] Open [ 1 ]
          Alex Newman made changes -
          Assignee Alex Newman [ posix4e ]
          stack made changes -
          Labels gsoc
          Li Chongxin made changes -
          Assignee Li Chongxin [ lichongxin ]
          Li Chongxin made changes -
          Attachment snapshot-src.zip [ 12444050 ]
          Attachment snapshot-flowchart.png [ 12444051 ]
          Li Chongxin made changes -
          Attachment snapshot-flowchart.png [ 12444051 ]
          Li Chongxin made changes -
          Attachment HBase Snapshot Design Report V2.pdf [ 12446018 ]
          Li Chongxin made changes -
          Attachment HBase Snapshot Design Report V3.pdf [ 12446965 ]
          Li Chongxin made changes -
          Status Open [ 1 ] In Progress [ 3 ]
          Li Chongxin made changes -
          Attachment Snapshot Class Diagram.png [ 12448045 ]
          Li Chongxin made changes -
          Attachment HBase Snapshot Implementation Plan.pdf [ 12448046 ]
          Li Chongxin made changes -
          Attachment snapshot-src.zip [ 12444050 ]
          Jesse Yates made changes -
          Fix Version/s 0.96.0 [ 12320040 ]
          Affects Version/s 0.96.0 [ 12320040 ]
          Jeff Hammerbacher made changes -
          Link This issue is related to HDFS-2802 [ HDFS-2802 ]
          Jeff Hammerbacher made changes -
          Link This issue is related to HDFS-233 [ HDFS-233 ]
          Jesse Yates made changes -
          Link This issue relates to HBASE-5547 [ HBASE-5547 ]
          stack made changes -
          Status In Progress [ 3 ] Resolved [ 5 ]
          Resolution Invalid [ 6 ]
          Jonathan Hsieh made changes -
          Link This issue is superceded by HBASE-6055 [ HBASE-6055 ]
          Jonathan Hsieh made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          stack made changes -
          Fix Version/s 0.95.0 [ 12324094 ]
          Fix Version/s 0.96.0 [ 12320040 ]
          stack made changes -
          Tags 0.96notable

            People

            • Assignee:
              Li Chongxin
              Reporter:
              Billy Pearson
            • Votes:
              2 Vote for this issue
              Watchers:
              31 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development