[SPARK-11442] Reduce numSlices for local metrics test of SparkListenerSuite

• Type: Test
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 1.6.0
• Component/s: Tests
• Assignee: Ted Yu
• Reporter: Ted Yu
• Created: 01/Nov/15 21:24
• Updated: 04/Nov/15 10:51
• Resolved: 04/Nov/15 10:51

Description

In the thread, http://search-hadoop.com/m/q3RTtcQiFSlTxeP/test+failed+due+to+OOME&subj=test+failed+due+to+OOME, it was discussed that memory consumption for SparkListenerSuite should be brought down.

This is an attempt in that direction by reducing numSlices for local metrics test.

Before change:

Run completed in 57 seconds, 357 milliseconds.

Reducing numSlices to 16 results in:

Run completed in 44 seconds, 115 milliseconds.

Issue Links

• links to: [Github] Pull Request #9384 (tedyu)