Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3717

AvroStorage is not filtering hidden files on directory recursion

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.12.0
    • 0.13.0
    • None
    • None

    Description

      We've noticed that when we generate couple of sub-directories with Oozie and then use AvroStorage (the older version from PiggyBank) to load those directories, hidden files such as _SUCCESS won't get ignored as they should be and in turn will cause failures in the Pig job. This seems to be regression caused by PIG-3223.

      Attachments

        1. PIG-3717.patch
          3 kB
          Jarek Jarcec Cecho
        2. PIG-3717.patch
          3 kB
          Jarek Jarcec Cecho

        Issue Links

          is part of

          Bug - A problem which impairs or prevents the functions of the product. PIG-3661 Piggybank AvroStorage fails if used in more than one load or store statement

          • Major - Major loss of function.
          • Closed
          links to

          Web Link Review board

          Activity

            People

              jarcec Jarek Jarcec Cecho
              jarcec Jarek Jarcec Cecho
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: