Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-441

Order by desc does not work with more than one reducer

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.2.0
    • 0.2.0
    • impl
    • None

    Description

      Order by with desc works if you use a single reducer. But with more than one reducer the partitions are not correctly constructed. The SortParitioner uses the object comparators, not the raw the comparators. The object comparators have no concept of order by descending. So they build the partitions for ascending order. The end result is data sorted descending within the partition but not across partitions.

      Attachments

        1. PIG-441.patch
          32 kB
          Alan Gates

        Activity

          People

            gates Alan Gates
            gates Alan Gates
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: