Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-2620

Customizable Error Handling in Pig

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      The current behavior of Pig when handling exceptions thrown by UDFs is to fail and stop processing. We want to extend this behavior to let user have finer grain control on error handling.

      Depending on the use-case there are several options users would like to have:

      Stop the execution and report an error
      Ignore tuples that cause exceptions and log warnings
      Ignore tuples that cause exceptions and redirect them to an error relation (to enable statistics, debugging, ...)
      Write their own error handler

      Attachments

        1. error_flow.png
          84 kB
          Lorand Bendig
        2. rewrite_example.txt
          50 kB
          Lorand Bendig

        Activity

          People

            lbendig Lorand Bendig
            dvryaboy Dmitriy V. Ryaboy
            Votes:
            9 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

              Created:
              Updated: