[PIG-3223] AvroStorage does not handle comma separated input paths

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.10.0, 0.11
• Fix Version/s: 0.12.0, 0.11.2
• Component/s: piggybank
• Assignee: Johnny Zhang
• Reporter: Michael Kramer
• Created: 28/Feb/13 00:55
• Updated: 14/Oct/13 16:46
• Resolved: 06/May/13 02:56

Description

In pig 0.11, a patch was issued to AvroStorage to support globs and comma separated input paths (PIG-2492). While this function works fine for glob-formatted input paths, it fails when issued a standard comma separated list of paths. fs.globStatus does not seem to be able to parse out such a list, and a java.net.URISyntaxException is thrown when toURI is called on the path.

I have a working fix for this, but it's extremely ugly (basically checking if the string of input paths is globbed, otherwise splitting on ","). I'm sure there's a more elegant solution. I'd be happy to post the relevant methods and "fixes" if necessary.

Issue Links

• links to: review board