[PIG-2507] Semicolon in parameters for UDF results in parsing error

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.0, 0.9.1, 0.10.0, 0.11, 0.11.1
• Fix Version/s: 0.12.0, 0.11.2
• Patch Info: Patch Available
• Hadoop Flags: Reviewed
• Assignee: Timothy Chen
• Reporter: Vivek Padmanabhan
• Created: 06/Feb/12 10:40
• Updated: 02/Oct/17 07:27
• Resolved: 18/Mar/13 04:08

Description

If I have a semicolon in the parameter passed to a udf, the script execution will fail with a parsing error.

a = load 'i1' as (f1:chararray);
c = foreach a generate REGEX_EXTRACT(f1, '.;' ,1);
dump c;

The above script fails with the below error
[main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1200: <file test.pig, line 3, column 0> mismatched character '<EOF>' expecting '''

Even replacing the semicolon with Unicode \u003B results in the same error.
c = foreach a generate REGEX_EXTRACT(f1, '.\u003B',1);

Issue Links

• is duplicated by: PIG-3418 ; in constant breaks parsing
• is duplicated by: PIG-731 Passing semicolon as a parameter in UDF causes parser error
• relates to: PIG-4818 Single quote inside comment in GENERATE is not being ignored
• relates to: PIG-4889 Replacing backslash fails as lexical error
• links to: GitHub Pull Request #32