[TEZ-1370] Provide a configuration so when a session is started a set of containers are started with it

• Type: Wish
• Status: Resolved
• Priority: Major
• Resolution: Implemented
• Affects Version/s: 0.5.0

Environment

branch -> master
hadoop -> HDP 2.1/CDH 5.0

• Assignee: Unassigned
• Reporter: Thaddeus Diamond
• Created: 03/Aug/14 20:11
• Updated: 05/Aug/14 13:02
• Resolved: 03/Aug/14 23:25

Description

This could use the existing TezConfiguration.TEZ_AM_SESSION_MIN_HELD_CONTAINERS configuration or a new one.

The API would be as follows:

TezConfiguration tezConfiguration = new TezConfiguration(hadoopConfiguration);
tezConfiguration.setBoolean(TEZ_AM_SESSION_MODE, true)
tezConfiguration.setInt(TEZ_AM_SESSION_STARTUP_CONTAINERS, 3)
TezClient tezClient = new TezClient("foobar", tezConfiguration);

// The following should start 3 containers
tezClient.start();

Issue Links

• is related to: TEZ-1372 Fix preWarm to work after recent API changes