[PIG-4887] Parameter substitution skipped with glob on register

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.16.0
• Hadoop Flags: Reviewed
• Assignee: Koji Noguchi
• Reporter: Koji Noguchi
• Created: 05/May/16 18:07
• Updated: 08/Jun/16 20:48
• Resolved: 13/May/16 01:46

Description

For a script with globbing on register followed by multi-line comments, parameter substitution doesn't work.

test.pig

register /Users/knoguchi/mydir/*.jar; 

A = load '$input' as (a1:int);
/* comment here */
store A into '$output';

Trying to run this would result in

org.apache.pig.backend.executionengine.ExecException: ERROR 2118: Input path does not exist: file:/Users/knoguchi/git/pig/$input

Running with -dryrun, we can see that parameter between the globbing and the multi-line style comment is ignored.

% pig -dryrun  -param input=input.txt -param output=output.txt  test.pig
...
2016-05-05 14:04:34,613 [main] INFO  org.apache.pig.Main - Dry run completed. Substituted pig script is at test.pig.substituted
...
% cat test.pig.substituted
register /Users/knoguchi/mydir/*.jar;

A = load '$input' as (a1:int);
/* comment here */
store A into 'output.txt';

%