[SPARK-3825] Log more information when unrolling a block fails

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1.0
• Fix Version/s: 1.1.1, 1.2.0
• Component/s: Block Manager, Spark Core
• Target Version/s: 1.1.1, 1.2.0
• Assignee: Andrew Or
• Reporter: Andrew Or
• Created: 06/Oct/14 23:46
• Updated: 07/Oct/14 19:53
• Resolved: 07/Oct/14 19:53

Description

We currently log only the following:

14/10/06 16:45:42 WARN CacheManager: Not enough space to cache partition rdd_0_2 in memory! Free memory is 481861527 bytes.

This is confusing, however, because "free memory" here means the amount of memory not occupied by blocks. It does not include the amount of memory reserved for unrolling.

Issue Links

• links to: [Github] Pull Request #2688 (andrewor14)