Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-15321

Ability to open a HRegion from hdfs snapshot.

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha-1, 1.5.0, 2.0.0
    • Fix Version/s: 1.4.1, 2.0.0-beta-2, 2.0.0
    • Component/s: None
    • Labels:
      None
    • Release Note:
      HRegion.openReadOnlyFileSystemHRegion() provides the ability to open HRegion from a read-only hdfs snapshot. Because hdfs snapshots are read-only, no cleanup happens when using this API.

      Description

      Now that hdfs snapshots are here, we started to run our mapreduce jobs over hdfs snapshots. The thing is, hdfs snapshots are read-only point-in-time copies of the file system. Thus we had to modify the section of code that initialized the region internals in HRegion. We have to skip cleanup of certain directories if the HRegion is backed by a hdfs snapshot. I have a patch for trunk with some basic tests if folks are interested.

        Attachments

        1. HBASE-15321.patch
          12 kB
          churro morales
        2. HBASE-15321.v01.patch
          8 kB
          churro morales
        3. HBASE-15321.v02.patch
          10 kB
          churro morales
        4. HBASE-15321.v1.branch-1.patch
          9 kB
          churro morales

          Activity

            People

            • Assignee:
              churromorales churro morales
              Reporter:
              churromorales churro morales
            • Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: