[PIG-1869] Job conf parameters not passed to Streaming

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 0.8.0
• Assignee: Unassigned
• Reporter: Ankur Bansal
• Created: 25/Feb/11 03:56
• Updated: 28/Sep/12 03:33
• Resolved: 28/Sep/12 03:33

Description

Pig Streaming does not set the job conf parameters as environment variables for the streaming binary. This is unlike Hadoop streaming where all the job conf parameters are available as environment variables.

Here is a small test script along with the streaming binary

=== stream.pig ===

A = LOAD 'dat' as (f1:chararray);
DEFINE MY_BIN `./stream.sh` SHIP('./stream.sh');
B = STREAM A THROUGH MY_BIN;
dump B;

=== stream.sh ===

#!/bin/bash
export