[DATALAB-2419] [AWS][GCP][Azure][Investigation][Spark Standalone cluster][Dataproc]: AIRBNB preparation fails with error unknown magic command 'matplotlib'

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: DataLab Main
• Security Level: Public (Regular Issues)
• Labels: Debian DevOps GCP Known_issues(release2.6)
• Epic Link: Playbook adjusting
• Story Points: 2
• Assignee: Leonid Frolov
• Reporter: Vira Vitanska
• Created: 04/Jun/21 11:12
• Updated: 04/Nov/22 07:37

Description

It was found on GCP. Perhaps it is related to other clouds.

Preconditions:

1. Spark Standalone cluster/Dataproc is running
2. AIRBNB preparation playbook is loaded to Jupyter

Steps to reproduce:

1. Run AIRBNB preparation playbook for Spark Standalone cluster/Dataproc

Actual result:

1. Playbook running fails

An error was encountered:
unknown magic command 'matplotlib'
UnknownMagic: unknown magic command 'matplotlib'

Expected result:

1. Playbook running is successfully