Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-2

Reused Keys and Values fail with a Combiner

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.1.0
    • None
    • None

    Description

      If the map function reuses the key or value by destructively modifying it after the output.collect(key,value) call and your application uses a combiner, the data is corrupted by having lots of instances with the last key or value.

      Attachments

        1. clone-map-output.patch
          3 kB
          Owen O'Malley

        Issue Links

        is depended upon by

        Bug - A problem which impairs or prevents the functions of the product. HADOOP-110 new key and value instances are allocated before each map

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            omalley Owen O'Malley
            omalley Owen O'Malley
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment