Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-2095

TableInputFormat should support more confs for the scanner

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.20.2
    • Fix Version/s: 0.20.3, 0.90.0
    • Component/s: mapreduce
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      TableInputFormat currently only supports hbase.mapreduce.scan and hbase.mapreduce.inputtable confs. The scan conf is a Base64 encoded scanner object, which makes it difficult to use TIF from hadoop pipes. I propose that the following confs be supported iff hbase.mapreduce.scan is not set:

      • hbase.mapreduce.scan.columns
      • hbase.mapreduce.scan.timestamp
      • hbase.mapreduce.scan.timerange.start
      • hbase.mapreduce.scan.timerange.end
      • hbase.mapreduce.scan.maxversions
      • hbase.mapreduce.scan.cacheblocks
      • hbase.mapreduce.scan.cachedrows

      Ideally we would also support filters but I think that would be harder to implement.

        Attachments

        1. HBASE-2095.patch
          4 kB
          Bassam Tabbara

          Activity

            People

            • Assignee:
              bassam Bassam Tabbara
              Reporter:
              bassam Bassam Tabbara
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: