Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-7024

TableMapReduceUtil.initTableMapperJob unnecessarily limits the types of outputKeyClass and outputValueClass

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 0.95.0
    • mapreduce
    • None
    • Incompatible change, Reviewed

    Description

      The various initTableMapperJob methods in TableMapReduceUtil take outputKeyClass and outputValueClass parameters which need to extend WritableComparable and Writable respectively.

      Because of this, it is not convenient to use an alternative serialization like Avro. (I wanted to set these parameters to AvroKey and AvroValue).

      The methods in the MapReduce API to set map output key and value types do not impose this restriction, so is there a reason to do it here?

      Attachments

        1. HBASE-7024-multiscan.patch
          2 kB
          Will Temperley
        2. HBASE-7024.patch
          5 kB
          Dave Beech

        Activity

          People

            Unassigned Unassigned
            dbeech Dave Beech
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: