[PIG-3896] PigServer - Batch

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.12.0
• Component/s: impl

Environment

linux

• Assignee: Unassigned
• Reporter: srinivas
• Created: 14/Apr/14 22:42
• Updated: 16/Apr/14 21:04

Description

When using PigServer to execute pig scripts, multiple store statements in a single pig script result in multiple pig jobs getting created.

In earlier versions only on pig job would be created for a pig script even there were multiple store statements in the script.

It looks like batch mode changes affected this

0.10.0
pigServer.setBatchOn();
pigServer.registerScript(pigScript, params);
List<ExecJob> pigJobs = pigServer.executeBatch();

this would create only one pig job

in version 0.12.0

pigServer.setBatchOn();
pigServer.registerScript(pigScript, params);
List<ExecJob> pigJobs = pigServer.executeBatch(true);

create multiple pig jobs instead of one and taking longer.