Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-1195

POSort should take care of sort order

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.6.0
    • Fix Version/s: 0.6.0
    • Component/s: impl
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Patch committed to both trunk and 0.6 branch.

      Description

      POSort always use ascending order. We shall obey the sort order as specified in the script.

      For example, the following script does not do the right thing if we turn off secondary sort (which means, we will rely on POSort to sort):

      A = load 'input' as (a0:int);
      B = group A ALL;
      C = foreach B {
          D = order A by a0 desc;
          generate D;
      };
      dump C;
      

      If we run it using the command line "java -Xmx512m -Dpig.exec.nosecondarykey=true -jar pig.jar 1.pig".

      The sort order for D is ascending.

        Attachments

        1. PIG-1195-1.patch
          6 kB
          Daniel Dai
        2. PIG-1195-2.patch
          6 kB
          Daniel Dai
        3. PIG-1195-3.patch
          2 kB
          Daniel Dai
        4. PIG-1195-4.patch
          2 kB
          Daniel Dai

          Activity

            People

            • Assignee:
              daijy Daniel Dai
              Reporter:
              daijy Daniel Dai
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: