Uploaded image for project: 'MRUnit'
  1. MRUnit
  2. MRUNIT-77

cannot use serializations that do not clone into object, or serializations without no arg constructors with reduce driver

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.8.1
    • Fix Version/s: 0.9.0
    • Labels:
      None

      Description

      @Test
      public void testJavaSerialization()

      { ReduceDriver<Integer, Integer, Integer, Integer> driver = ReduceDriver.newReduceDriver(new IdentityReducer<Integer, Integer>()); Configuration conf = new Configuration(); conf.set("io.serializations", "org.apache.hadoop.io.serializer.JavaSerialization"); driver.setConfiguration(conf); driver.withInputKey(1) .withInputValue(2) .withInputValue(3) .withInputValue(4) .withOutput(1, 2) .withOutput(1, 3) .withOutput(1, 4) .runTest(); }

      The above test fails because the result of copy(next, value, conf) needs to be reassigned to value for serializations such as java serialization that dont change the copy argument. This also fails because of the lack of a no arg constructor which breaks the call to ReflectionUtils.newInstance(klass, conf)

        Attachments

          Activity

            People

            • Assignee:
              jdonofrio Jim Donofrio
              Reporter:
              jdonofrio Jim Donofrio
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: