Pig
  1. Pig
  2. PIG-2782

Specifying sorting field(s) at nightly.conf

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.11
    • Component/s: None
    • Labels:
      None
    • Environment:

      Mac OS X Lion 10.7.3
      Hadoop 1.0.1-SNAPSHOT
      Apache Pig version 0.11.0-SNAPSHOT (r1355798)

    • Hadoop Flags:
      Reviewed

      Description

      After running the Checkin tests, it fails because one of the parameters passed to the sort is incorrect (instead of +1 -2, on POSIX is -k2,2).

      According to this http://ss64.com/bash/sort.html, it was on an old notation.

      1. PIG-2782.patch
        12 kB
        Cheolsoo Park

        Issue Links

          Activity

          Hide
          Jie Li added a comment -

          +1. I also had the same issue.

          Show
          Jie Li added a comment - +1. I also had the same issue.
          Hide
          Cheolsoo Park added a comment -

          Attached is the patch that replaces obsolete sort options with posix options in e2e tests.

          Modified tests are as follows:

          Checkin, Foreach, Order, Types, Limit, Split, MissingColumns, Jython_Checkin, and BigData

          I verified that all tests pass in local mode.

          Show
          Cheolsoo Park added a comment - Attached is the patch that replaces obsolete sort options with posix options in e2e tests. Modified tests are as follows: Checkin, Foreach, Order, Types, Limit, Split, MissingColumns, Jython_Checkin, and BigData I verified that all tests pass in local mode.
          Hide
          Daniel Dai added a comment -

          Patch committed to trunk. Thanks Cheolsoo!

          Show
          Daniel Dai added a comment - Patch committed to trunk. Thanks Cheolsoo!
          Hide
          Egil Sorensen added a comment -

          There were still problems with the patch here. E.g. the pig script sorts on column one and two, but the verification only checks that output is sorted on column one.
          For details please see the cloned PIG-3045.

          Show
          Egil Sorensen added a comment - There were still problems with the patch here. E.g. the pig script sorts on column one and two, but the verification only checks that output is sorted on column one. For details please see the cloned PIG-3045 .

            People

            • Assignee:
              Cheolsoo Park
              Reporter:
              Allan Avendaño
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development