Pig
  1. Pig
  2. PIG-229

Pig Streaming isn't resilient to errors in the streaming process's stdout/stderr or in LoadFuncs used to deserialize them.

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.1.0
    • Component/s: impl
    • Labels:
      None

      Description

      Jobs do not fail correctly when there are errors in the streaming process's stdout/stderr or bugs in the LoadFuncs being used to deserialize them.

        Activity

        Hide
        Olga Natkovich added a comment -

        patched tested and committed. Thanks, Arun!

        Show
        Olga Natkovich added a comment - patched tested and committed. Thanks, Arun!
        Hide
        Arun C Murthy added a comment -

        Submitting patch, passes all unit tests locally.

        Show
        Arun C Murthy added a comment - Submitting patch, passes all unit tests locally.
        Hide
        Arun C Murthy added a comment -

        Candidate patch which fixes the problem by communicating the exception to the 'Main' thread; also contains necessary fixes to DefaultOutputHandler.close and BufferedPostionedInputStream.close to ensure the correctly close the underlying streams.

        Show
        Arun C Murthy added a comment - Candidate patch which fixes the problem by communicating the exception to the 'Main' thread; also contains necessary fixes to DefaultOutputHandler.close and BufferedPostionedInputStream.close to ensure the correctly close the underlying streams.

          People

          • Assignee:
            Arun C Murthy
            Reporter:
            Arun C Murthy
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development