Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-15321

Ability to open a HRegion from hdfs snapshot.

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha-1, 1.5.0, 2.0.0
    • 1.4.1, 2.0.0-beta-2, 2.0.0
    • None
    • None
    • HRegion.openReadOnlyFileSystemHRegion() provides the ability to open HRegion from a read-only hdfs snapshot. Because hdfs snapshots are read-only, no cleanup happens when using this API.

    Description

      Now that hdfs snapshots are here, we started to run our mapreduce jobs over hdfs snapshots. The thing is, hdfs snapshots are read-only point-in-time copies of the file system. Thus we had to modify the section of code that initialized the region internals in HRegion. We have to skip cleanup of certain directories if the HRegion is backed by a hdfs snapshot. I have a patch for trunk with some basic tests if folks are interested.

      Attachments

        1. HBASE-15321.patch
          12 kB
          churro morales
        2. HBASE-15321.v01.patch
          8 kB
          churro morales
        3. HBASE-15321.v02.patch
          10 kB
          churro morales
        4. HBASE-15321.v1.branch-1.patch
          9 kB
          churro morales

        Activity

          People

            churromorales churro morales
            churromorales churro morales
            Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: