MRUnit
  1. MRUnit
  2. MRUNIT-19

MRunit ReduceDriver does not fully replicate the reducers behaviour with reusing pointers over the iterator

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 0.5.0
    • Fix Version/s: 0.8.0
    • Labels:
      None

      Description

      The MRunit ReduceDriver does not replicate the behaviour of re-using the pointer to the returned values as they are iterated over. This is a problem for testing as it does not fail when you are incorrectly storing this pointer for a value if you want to use it later on in the iteration over the values.

      The behaviour should be modified so the iterator will return the same pointer every time.

      1. MRUNIT-19-1.patch
        16 kB
        Brock Noland

        Activity

        Dan Harvey created issue -
        Hide
        Dan Harvey added a comment -

        This was discussed in the mailing lists last year

        http://mail-archives.apache.org/mod_mbox/hadoop-mapreduce-user/201012.mbox/%3CAANLkTinMDb9NLkNXYQg=8=aFBbQt7GNuZoVpk8+avcqj@mail.gmail.com%3E

        We've got code for this we will clean up and submit as a patch as soon as we can.

        Show
        Dan Harvey added a comment - This was discussed in the mailing lists last year http://mail-archives.apache.org/mod_mbox/hadoop-mapreduce-user/201012.mbox/%3CAANLkTinMDb9NLkNXYQg=8=aFBbQt7GNuZoVpk8+avcqj@mail.gmail.com%3E We've got code for this we will clean up and submit as a patch as soon as we can.
        E. Sammer made changes -
        Field Original Value New Value
        Project Hadoop Map/Reduce [ 12310941 ] MRUnit [ 12311292 ]
        Key MAPREDUCE-2546 MRUNIT-19
        Workflow no-reopen-closed, patch-avail [ 12615040 ] jira [ 12615041 ]
        Affects Version/s 0.5.0 [ 12316328 ]
        Affects Version/s 0.21.0 [ 12314045 ]
        Affects Version/s 0.20.1 [ 12314047 ]
        Affects Version/s 0.20.2 [ 12314205 ]
        Component/s contrib/mrunit [ 12313274 ]
        Hide
        E. Sammer added a comment -

        Dan:

        Since MRUnit has been broken out from contrib, I've moved the bug over under the new mrunit project.

        Show
        E. Sammer added a comment - Dan: Since MRUnit has been broken out from contrib, I've moved the bug over under the new mrunit project.
        E. Sammer made changes -
        Fix Version/s 0.8.0 [ 12316359 ]
        Brock Noland made changes -
        Assignee Brock Noland [ brocknoland ]
        Hide
        Brock Noland added a comment -

        Attached the patch I plan on committing for this.

        Show
        Brock Noland added a comment - Attached the patch I plan on committing for this.
        Brock Noland made changes -
        Attachment MRUNIT-19-1.patch [ 12505379 ]
        Hide
        Brock Noland added a comment -

        Committed in 1207626.

        Show
        Brock Noland added a comment - Committed in 1207626.
        Brock Noland made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]

          People

          • Assignee:
            Brock Noland
            Reporter:
            Dan Harvey
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development