Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-2284

BasicTypeSorterBase.compare calls progress on each compare

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.16.0
    • None
    • None

    Description

      The inner loop of the sort is calling progress on each compare. I think it would make more sense to call progress in the sort rather than the compare or at most every 10000 compares. In the performance numbers, the call to progress as part of the sort are consuming 12% of the total cpu time when running word count under the local runner.

      Attachments

        1. HADOOP-2284.patch
          3 kB
          Amar Kamat

        Activity

          People

            amar_kamat Amar Kamat
            omalley Owen O'Malley
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: