Pig
  1. Pig
  2. PIG-2614

AvroStorage crashes on LOADING a single bad error

    Details

      Description

      AvroStorage dies when a single bad record exists, such as one with missing fields. This is very bad on 'big data,' where bad records are inevitable. See discussion at http://www.quora.com/Big-Data/In-Big-Data-ETL-how-many-records-are-an-acceptable-loss for more theory.

      1. test_avro_files.tar.gz
        0.6 kB
        Cheolsoo Park
      2. PIG-2614_2.patch
        19 kB
        Cheolsoo Park
      3. PIG-2614_1.patch
        29 kB
        Jonathan Coveney
      4. PIG-2614_0.patch
        29 kB
        Jonathan Coveney

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Jonathan Coveney
              Reporter:
              Russell Jurney
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development