Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-13028

Cleanup mapreduce API changes

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 1.0.0
    • 1.0.0
    • mapreduce
    • Hide
      The bindings for reading data from HBase using both the Hadoop MapReduce mapred and mapreduce libraries now are initialized the same way. Subclasses wishing to build on TableInputFormatBase that use the new initialize method will have access to job configuration information.
      Show
      The bindings for reading data from HBase using both the Hadoop MapReduce mapred and mapreduce libraries now are initialized the same way. Subclasses wishing to build on TableInputFormatBase that use the new initialize method will have access to job configuration information.

    Description

      The API changes made in HBASE-12798 need to be cleaned up so their common use makes more sense.

      • initialize should take some kind of configuration object that can be used in setting up a Connection (e.g. JobConf)
      • initialize should be called at the start of getSplits and getRecordReader rather than across the class when a member is needed
      • the same changes should be present in the mapred package since it is not longer deprecated
      • examples should rely on idiomatic MapReduce (specifically they should not be relying on JobConfigurable to get a JobConf instance)

      Attachments

        1. HBASE-13028.5.patch.txt
          34 kB
          Sean Busbey
        2. HBASE-13028.4.patch.txt
          34 kB
          Sean Busbey
        3. HBASE-13028.3.patch.txt
          32 kB
          Sean Busbey
        4. HBASE-13028.2.patch.txt
          31 kB
          Sean Busbey
        5. HBASE-13028.1.patch.txt
          31 kB
          Sean Busbey

        Issue Links

          Activity

            People

              busbey Sean Busbey
              busbey Sean Busbey
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: