[PIG-4225] Allow users to specify Python executable for Pig streaming

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 0.12.0, 0.12.1
• Component/s: internal-udfs
• Assignee: Unassigned
• Reporter: Mike Sukmanowsky
• Created: 09/Oct/14 20:28
• Updated: 10/Oct/14 05:42
• Resolved: 10/Oct/14 05:41

Description

The current PythonScriptEngine uses whatever python is currently on the path in order to execute scripts.

Python users are accustomed to creating virtual environments (virtualenvs) where associated requirements are installed without needing to worry about "global" installs via, for example, sudo pip install <some package>.

Is it possible to have the Python executable specified either via the DEFINE command syntax or, in a hadoop job configuration variable? Perhaps pig.pythonstreaming.pythonpath?

Issue Links

• duplicates: PIG-4124 Command for Python streaming udf should be configurable