Pig
  1. Pig
  2. PIG-2620

Customizable Error Handling in Pig

    Details

    • Type: New Feature New Feature
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      The current behavior of Pig when handling exceptions thrown by UDFs is to fail and stop processing. We want to extend this behavior to let user have finer grain control on error handling.

      Depending on the use-case there are several options users would like to have:

      Stop the execution and report an error
      Ignore tuples that cause exceptions and log warnings
      Ignore tuples that cause exceptions and redirect them to an error relation (to enable statistics, debugging, ...)
      Write their own error handler

      1. rewrite_example.txt
        50 kB
        Lorand Bendig
      2. error_flow.png
        84 kB
        Lorand Bendig

        Activity

          People

          • Assignee:
            Lorand Bendig
            Reporter:
            Dmitriy V. Ryaboy
          • Votes:
            10 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

            • Created:
              Updated:

              Development