[HIVE-17292] Change TestMiniSparkOnYarnCliDriver test configuration to use the configured cores

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: Spark, Test
• Assignee: Peter Vary
• Reporter: Peter Vary
• Created: 10/Aug/17 16:49
• Updated: 22/May/18 23:57
• Resolved: 21/Aug/17 02:14

Description

Currently the hive-site.xml for the TestMiniSparkOnYarnCliDriver test defines 2 cores, and 2 executors, but only 1 is used, because the MiniCluster does not allows the creation of the 3rd container.

The FairScheduler uses 1GB increments for memory, but the containers would like to use only 512MB. We should change the fairscheduler configuration to use only the requested 512MB

Issue Links

• links to: Review board