Pig
  1. Pig
  2. PIG-216

Pig Streaming doesn't handle commands which use Unix pipes

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.1.0
    • Component/s: impl
    • Labels:
      None

      Description

      Currently ExecutableManager quotes each component of the the streaming command before exec'ing it via 'bash -c exec ...', this breaks commands which use Unix pipes:
      OP = stream IP through `cut -f 1 | sort | uniq -c`

      The straight-forward fix is to remove quoting of the command's components...

        Activity

        Hide
        Arun C Murthy added a comment -

        Straight-forward patch, with additional test-cases...

        Show
        Arun C Murthy added a comment - Straight-forward patch, with additional test-cases...
        Hide
        Arun C Murthy added a comment -

        Patch passes all e2e tests, submittng for review...

        Show
        Arun C Murthy added a comment - Patch passes all e2e tests, submittng for review...
        Hide
        Alan Gates added a comment -

        Patch checked in at revision 650606. Thanks Arun.

        Show
        Alan Gates added a comment - Patch checked in at revision 650606. Thanks Arun.

          People

          • Assignee:
            Arun C Murthy
            Reporter:
            Arun C Murthy
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development