Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-3424

the value returned from getPartition should be checked to make sure it is in the range 0..#reduces-1

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.17.0
    • 0.18.0
    • None
    • None

    Description

      Since HADOOP-2919, map tasks haven't complained if getPartition returns numbers outside of the valid range. This leads to applications where some of the transient output is ignored (all of the rows marked for reduce -1, for example, are discarded, because reduce -1 doesn't exist.)

      Attachments

        1. 3424-0.patch
          3 kB
          Christopher Douglas

        Activity

          People

            cdouglas Christopher Douglas
            omalley Owen O'Malley
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: