[PIG-5332] Implement auto parallelism for pig on spark

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: liyunzhang
• Created: 15/Mar/18 01:19
• Updated: 15/Mar/18 01:20

Description

Currently, pig on spark use pig.exec.reducers.max as reduce number. It is better to have auto parallelism and not let end-users to calculate the reduce number. Pig on tez implementation is in PIG-4434