[DATALAB-308] [Local spark]: Spark.executor.memory should be allocated depending on notebook instance shape

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Done
• Component/s: DataLab Old
• Labels: 2.3_old AWS AZURE Debian DevOps GCP Known_issues(release2.2) Known_issues(release2.3) Known_issues(release2.4) RedHat
• Epic Link: Common issues for all templates
• Assignee: Unassigned
• Reporter: Vira Vitanska
• Created: 25/Jan/19 01:05
• Updated: 01/Apr/21 08:55
• Resolved: 01/Apr/21 08:55

Description

 This allocation is obsolete because of task https://issues.apache.org/jira/browse/DATALAB-1985

Preconditions:
Notebook is created

Steps to reproduce:
1. run playbok on local kernel

Actual result:
1. the value of spark.executor.memory is less than 75% from total (if instance shape is up to 8 GB)
2. the value of spark.executor.memory is less than formula value: total value minus 3500MB (if instance shape is over than 8 GB)

Expected result:
1. the value of spark.executor.memory is equal 75% from total (if instance shape is up to 8 GB)
2. the value of spark.executor.memory is equal formula value: total value minus 3500MB (if instance shape is over than 8 GB)