Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-2782

Specifying sorting field(s) at nightly.conf

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.11
    • Component/s: None
    • Labels:
      None
    • Environment:

      Mac OS X Lion 10.7.3
      Hadoop 1.0.1-SNAPSHOT
      Apache Pig version 0.11.0-SNAPSHOT (r1355798)

    • Hadoop Flags:
      Reviewed

      Description

      After running the Checkin tests, it fails because one of the parameters passed to the sort is incorrect (instead of +1 -2, on POSIX is -k2,2).

      According to this http://ss64.com/bash/sort.html, it was on an old notation.

      1. PIG-2782.patch
        12 kB
        Cheolsoo Park

        Issue Links

          Activity

          Hide
          jay23jack Jie Li added a comment -

          +1. I also had the same issue.

          Show
          jay23jack Jie Li added a comment - +1. I also had the same issue.
          Hide
          cheolsoo Cheolsoo Park added a comment -

          Attached is the patch that replaces obsolete sort options with posix options in e2e tests.

          Modified tests are as follows:

          Checkin, Foreach, Order, Types, Limit, Split, MissingColumns, Jython_Checkin, and BigData

          I verified that all tests pass in local mode.

          Show
          cheolsoo Cheolsoo Park added a comment - Attached is the patch that replaces obsolete sort options with posix options in e2e tests. Modified tests are as follows: Checkin, Foreach, Order, Types, Limit, Split, MissingColumns, Jython_Checkin, and BigData I verified that all tests pass in local mode.
          Hide
          daijy Daniel Dai added a comment -

          Patch committed to trunk. Thanks Cheolsoo!

          Show
          daijy Daniel Dai added a comment - Patch committed to trunk. Thanks Cheolsoo!
          Hide
          esoren Egil Sorensen added a comment -

          There were still problems with the patch here. E.g. the pig script sorts on column one and two, but the verification only checks that output is sorted on column one.
          For details please see the cloned PIG-3045.

          Show
          esoren Egil Sorensen added a comment - There were still problems with the patch here. E.g. the pig script sorts on column one and two, but the verification only checks that output is sorted on column one. For details please see the cloned PIG-3045 .

            People

            • Assignee:
              cheolsoo Cheolsoo Park
              Reporter:
              xalan Allan Avendaño
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development