MRUnit
  1. MRUnit
  2. MRUNIT-77

cannot use serializations that do not clone into object, or serializations without no arg constructors with reduce driver

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.8.1
    • Fix Version/s: 0.9.0
    • Labels:
      None

      Description

      @Test
      public void testJavaSerialization()

      { ReduceDriver<Integer, Integer, Integer, Integer> driver = ReduceDriver.newReduceDriver(new IdentityReducer<Integer, Integer>()); Configuration conf = new Configuration(); conf.set("io.serializations", "org.apache.hadoop.io.serializer.JavaSerialization"); driver.setConfiguration(conf); driver.withInputKey(1) .withInputValue(2) .withInputValue(3) .withInputValue(4) .withOutput(1, 2) .withOutput(1, 3) .withOutput(1, 4) .runTest(); }

      The above test fails because the result of copy(next, value, conf) needs to be reassigned to value for serializations such as java serialization that dont change the copy argument. This also fails because of the lack of a no arg constructor which breaks the call to ReflectionUtils.newInstance(klass, conf)

        Activity

        Hide
        Jim Donofrio added a comment -

        added above test
        set value to copy(next, value, conf) for serializations that do not change the copy argument
        remove initialization of value by ReflectionUtil for classes without no arg constructors

        committed in 1299156

        Show
        Jim Donofrio added a comment - added above test set value to copy(next, value, conf) for serializations that do not change the copy argument remove initialization of value by ReflectionUtil for classes without no arg constructors committed in 1299156
        Hide
        Brock Noland added a comment -

        This is great work! Thank you for fixing my bugs!

        Show
        Brock Noland added a comment - This is great work! Thank you for fixing my bugs!

          People

          • Assignee:
            Jim Donofrio
            Reporter:
            Jim Donofrio
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development