Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-13356

HBase should provide an InputFormat supporting multiple scans in mapreduce jobs over snapshots

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 0.98.14, 1.2.0, 2.0.0
    • mapreduce
    • None
    • Reviewed

    Description

      Currently, HBase supports the pushing of multiple scans to mapreduce jobs over live tables (via MultiTableInputFormat) but only supports a single scan for mapreduce jobs over table snapshots. It would be handy to support multiple scans over snapshots as well, probably through another input format (MultiTableSnapshotInputFormat?). To mimic the functionality present in MultiTableInputFormat, the new input format would likely have to take in the names of all snapshots used in addition to the scans.

      Attachments

        1. HBASE-13356.2.patch
          84 kB
          Andrew Mains
        2. HBASE-13356.3.patch
          85 kB
          Andrew Mains
        3. HBASE-13356.4.patch
          84 kB
          Andrew Mains
        4. HBASE-13356.patch
          67 kB
          Andrew Mains
        5. HBASE-13356-0.98.patch
          89 kB
          Andrew Mains
        6. HBASE-13356-0.98-addendum-hadoop-1.patch
          1 kB
          Andrew Kyle Purtell
        7. HBASE-13356-branch-1.patch
          76 kB
          Andrew Mains

        Issue Links

          is depended upon by

          Sub-task - The sub-task of the issue KYLIN-750 Merge cube segments from HBase table

          • Major - Major loss of function.
          • Closed

          Activity

            People

              amains12 Andrew Mains
              amains12 Andrew Mains
              Votes:
              1 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: