Uploaded image for project: 'MRUnit'
  1. MRUnit
  2. MRUNIT-99

dont force K2 in MapReduceDriver's to be Comparable since Hadoop dont enforce this on the map output key and value classes

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.8.1
    • 0.9.0
    • None

    Description

      We should not force K2 in MapReduceDriver's to be Comparable because Hadoop does not enforce this on the map output key and value classes. This makes MRUnit difficult to use when using non Writable classes that dont need to be Comparable but define their own key comparators in the JobConf

      I realized this after seeing [1] on stackoverflow. I am still trying to investigate if we have other conflicts with Avro

      [1]: http://stackoverflow.com/questions/10119616/use-mrunit-and-avro-together

      Attachments

        Activity

          People

            jdonofrio Jim Donofrio
            jdonofrio Jim Donofrio
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: