Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-2620

Customizable Error Handling in Pig

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      The current behavior of Pig when handling exceptions thrown by UDFs is to fail and stop processing. We want to extend this behavior to let user have finer grain control on error handling.

      Depending on the use-case there are several options users would like to have:

      Stop the execution and report an error
      Ignore tuples that cause exceptions and log warnings
      Ignore tuples that cause exceptions and redirect them to an error relation (to enable statistics, debugging, ...)
      Write their own error handler

        Attachments

        1. rewrite_example.txt
          50 kB
          Lorand Bendig
        2. error_flow.png
          84 kB
          Lorand Bendig

          Activity

            People

            • Assignee:
              lbendig Lorand Bendig
              Reporter:
              dvryaboy Dmitriy V. Ryaboy
            • Votes:
              11 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

              • Created:
                Updated: