[DATALAB-2225] [GCP][Spark Standalone cluster]: Python 2.7.17 is used instead of Python 3.6

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Done
• Affects Version/s: v.2.5
• Fix Version/s: v.2.5
• Component/s: DataLab Main
• Security Level: Public (Regular Issues)
• Labels: Debian DevOps GCP
• Epic Link: DataLab Compute Engine
• Sprint: Apache DataLab release 2.5
• Assignee: Mykola Bodnar
• Reporter: Vira Vitanska
• Created: 12/Jan/21 11:28
• Updated: 05/Jul/21 12:23
• Resolved: 05/Jul/21 12:23

Description

Preconditions:

1. Spark Standalone cluster is created on Jupyter

Steps to reproduce:

1. Go to Jupyter UI
2. See kernel list
3. Run a command 

import platform
platform.python_version()

Actual result:

1. Python 3.6.x is in kernel list for Spark Standalone cluster
2. Python 2.7.17 is used for Spark Standalone cluster

Expected result:

1. Python 3.6.x is in kernel list for Spark Standalone cluster
2. Python 3.6.x is used for Spark Standalone cluster

 

Issue Links

• relates to: DATALAB-2222 [GCP][Dataproc]Python 2.7.16 is used instead of Python 3.7