Pig
  1. Pig
  2. PIG-2620

Customizable Error Handling in Pig

    Details

    • Type: New Feature New Feature
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      The current behavior of Pig when handling exceptions thrown by UDFs is to fail and stop processing. We want to extend this behavior to let user have finer grain control on error handling.

      Depending on the use-case there are several options users would like to have:

      Stop the execution and report an error
      Ignore tuples that cause exceptions and log warnings
      Ignore tuples that cause exceptions and redirect them to an error relation (to enable statistics, debugging, ...)
      Write their own error handler

      1. rewrite_example.txt
        50 kB
        Lorand Bendig
      2. error_flow.png
        84 kB
        Lorand Bendig

        Activity

        Dmitriy V. Ryaboy created issue -
        Dmitriy V. Ryaboy made changes -
        Field Original Value New Value
        Labels gsoc2012
        Dmitriy V. Ryaboy made changes -
        Labels gsoc2012
        Lorand Bendig made changes -
        Assignee Lorand Bendig [ lbendig ]
        Lorand Bendig made changes -
        Attachment error_flow.png [ 12639209 ]
        Attachment rewrite_example.txt [ 12639210 ]

          People

          • Assignee:
            Lorand Bendig
            Reporter:
            Dmitriy V. Ryaboy
          • Votes:
            11 Vote for this issue
            Watchers:
            13 Start watching this issue

            Dates

            • Created:
              Updated:

              Development