[PIG-4890] Run pigmix on spark on yarn with multiple nodes

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Component/s: spark
• Assignee: Unassigned
• Reporter: liyunzhang
• Created: 10/May/16 08:54
• Updated: 21/Oct/16 17:29
• Resolved: 21/Oct/16 17:29

Description

Test pigmix in three nodes with 40 core and 60g memory.

The result of spark in multiple nodes and single node are

Script	multiple nodes	single node
L_1	75	53
L_2	63	45
L_3	65	49
L_4	68	48
L_5	64	47
L_6	70	50
L_7	65	46
L_8	65	46
L_9	157	50
L_10	160	51
L_11	104	64
L_12	74	54
L_13	66	46
L_14	66	47
L_15	67	47
L_16	67	50
L_17	88	54