Uploaded image for project: 'MRUnit'
  1. MRUnit
  2. MRUNIT-77

cannot use serializations that do not clone into object, or serializations without no arg constructors with reduce driver

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.8.1
    • 0.9.0
    • None

    Description

      @Test
      public void testJavaSerialization()

      { ReduceDriver<Integer, Integer, Integer, Integer> driver = ReduceDriver.newReduceDriver(new IdentityReducer<Integer, Integer>()); Configuration conf = new Configuration(); conf.set("io.serializations", "org.apache.hadoop.io.serializer.JavaSerialization"); driver.setConfiguration(conf); driver.withInputKey(1) .withInputValue(2) .withInputValue(3) .withInputValue(4) .withOutput(1, 2) .withOutput(1, 3) .withOutput(1, 4) .runTest(); }

      The above test fails because the result of copy(next, value, conf) needs to be reassigned to value for serializations such as java serialization that dont change the copy argument. This also fails because of the lack of a no arg constructor which breaks the call to ReflectionUtils.newInstance(klass, conf)

      Attachments

        Activity

          People

            jdonofrio Jim Donofrio
            jdonofrio Jim Donofrio
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: