MRUnit
  1. MRUnit
  2. MRUNIT-77

cannot use serializations that do not clone into object, or serializations without no arg constructors with reduce driver

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.8.1
    • Fix Version/s: 0.9.0
    • Labels:
      None

      Description

      @Test
      public void testJavaSerialization()

      { ReduceDriver<Integer, Integer, Integer, Integer> driver = ReduceDriver.newReduceDriver(new IdentityReducer<Integer, Integer>()); Configuration conf = new Configuration(); conf.set("io.serializations", "org.apache.hadoop.io.serializer.JavaSerialization"); driver.setConfiguration(conf); driver.withInputKey(1) .withInputValue(2) .withInputValue(3) .withInputValue(4) .withOutput(1, 2) .withOutput(1, 3) .withOutput(1, 4) .runTest(); }

      The above test fails because the result of copy(next, value, conf) needs to be reassigned to value for serializations such as java serialization that dont change the copy argument. This also fails because of the lack of a no arg constructor which breaks the call to ReflectionUtils.newInstance(klass, conf)

        Activity

          People

          • Assignee:
            Jim Donofrio
            Reporter:
            Jim Donofrio
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development