[PIG-5217] Pig Streaming over python multiprocessing

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.15.0
• Component/s: internal-udfs

Environment

python 2.7,pig 0.15.0,multi-core processor

• Assignee: Unassigned
• Reporter: bharatpattani
• Created: 10/Apr/17 10:55
• Updated: 28/Apr/17 06:54

Description

python multiprocessing is not working with pig streaming.
Following are the steps for that:
1. Create python script with "multiprocessing" which can utilise at least two cores of the processor.
2. Create an pig script which will call python script which mentioned in above step.

Please have a look at it and do need full for the same.