[DATALAB-467] DataLab Compute Engine - ASF JIRA

Add vote

Watch issue

Resolved

Reopened

Closed

Verified

Blocked

on hold

XML

Word

Printable

JSON

Details

Type: Epic
Status: Open
Priority: Major
Resolution: Unresolved
Affects Version/s: None
Fix Version/s: None
Component/s: None
Labels:
None

Epic Name:
DataLab Compute Engine

Description

Epic includes: Dataproc, EMR & Azure HDInsight

Attachments

Issues in epic

DATALAB-2830	Azure HDInsight: Create/Provision compute engine	In Progress	Vira Vitanska	Actions
DATALAB-2908	Azure HDInsight: Terminate compute engine	Open	Vira Vitanska	Actions
DATALAB-3054	[Azure]Notebook termination should terminate its HDInsight cluster as well	Closed	Leonid Frolov	Actions
DATALAB-1408	[DevOps] Create/ Provision HDInsight on Azure	Closed	Leonid Frolov	Actions
DATALAB-2915	[DevOps] Terminate Azure HDInsight	Closed	Leonid Frolov	Actions
DATALAB-2829	New Compute Engine - Azure HD Insight	Closed	Vira Vitanska	Actions
DATALAB-3066	[Front-end] Add info about how to connect to cluster for RStudio	Blocked	Hennadii Shpak	Actions
DATALAB-3072	[DevOps] Connect cluster to RStudio	Closed	Leonid Frolov	Actions
DATALAB-3052	[DevOps] Add possibility to install libs on Azure HDInsight cluster	Reopened	Leonid Frolov	Actions
DATALAB-2899	[Back-end] Add scheduler to HDInsight on Azure	Closed	Denys Yankiv	Actions
DATALAB-2902	[Front-end] Add scheduler to HDInsight on Azure	Closed	Hennadii Shpak	Actions
DATALAB-2631	[AWS] Data Engine (EMR) creation fails on Zeppelin on stage of downloading yarn configuration	Closed	Oleksandr Polishchuk	Actions
DATALAB-2997	[DevOps] Azure HDInsight: Integrate with RStudio	Closed	Oleksandr Repnikov	Actions
DATALAB-3077	[AWS][Azure]Spark cluster creation fails	Closed	Oleksandr Repnikov	Actions
DATALAB-3047	[AWS] EMR cluster creation fails when 'Spot instance bid %' checkbox is checked	Reopened	Leonid Frolov	Actions
DATALAB-2645	[Back-end] Create HDInsight on Azure	Open	Denys Yankiv	Actions
DATALAB-2898	[Back-end] Terminate HDInsight on Azure	Closed	Denys Yankiv	Actions
DATALAB-2646	[Front-end] Create HDInsight on Azure	Open	Hennadii Shpak	Actions
DATALAB-2901	[Front-end] Terminate HDInsight on Azure	Closed	Hennadii Shpak	Actions
DATALAB-2914	[DevOps] Azure HDInsight: Integrate with Jupyter	Closed	Leonid Frolov	Actions
DATALAB-2998	[DevOps] Azure HDInsight: Integrate with Zeppelin	Closed	Leonid Frolov	Actions
DATALAB-2909	[DevOps] Azure HDInsight: Add scheduler	Closed	Leonid Frolov	Actions
DATALAB-2912	[DevOps] Azure HDInsight: Investigate which lib groups are needed	Closed	Leonid Frolov	Actions
DATALAB-315	Links for Application Master/history (tracking url) are not opened successfully on EMR 5.12.0/5.19.0	Open	Unassigned	Actions
DATALAB-327	Docker's errors occur while creating EMR spot instance in any notebook	Closed	Unassigned	Actions
DATALAB-2459	[RStudio] Dataproc connection is not esteblished by Livy	Open	Leonid Frolov	Actions
DATALAB-2759	[Back-end][GCP] Dataproc status stuck on stage 'Configuring'	Closed	Denys Yankiv	Actions
DATALAB-2913	Azure HDInsight: Integrate with current notebook	Open	Unassigned	Actions
DATALAB-1692	[GCP]: Running code for Data Engine Service does not use GPU	In Progress	Mykola Bodnar	Actions
DATALAB-537	[GCP]: Disable 'Create' button in case of invalid output data on Data Engine Service creation popup	Closed	Andriana Kovalyshyn	Actions
DATALAB-578	Label should be one for check box preemptible node	Closed	Andriana Kovalyshyn	Actions
DATALAB-394	[GCP][Apache Zeppelin][Dataproc]: Playbook running fails due to spark.submit.deployMode is not specified	Closed	Oleksandr Isniuk	Actions
DATALAB-332	[GCP]: Dataproc creation fails on process of downloading jars on Jupyter and RStudio	Closed	Oleksandr Isniuk	Actions
DATALAB-452	[GCP][Data Engine Service]: Kernels R/Pyspark (Py2) of dataproc 1.2 are not run successfully on Zeppelin 0.8.0	In Progress	Vira Vitanska	Actions
DATALAB-628	[GCP][Data Engine Service]: R kernel Dataproc 1.3 runs successfully but with exception	Closed	Unassigned	Actions
DATALAB-21	[GCP]: Data Engine Service creation fails after environment has been recreated	Closed	Unassigned	Actions
DATALAB-155	[GCP]: Prevent adjusting total budget/user limit and cluster configurations for Dataproc	Closed	Andriana Kovalyshyn	Actions
DATALAB-166	[Add computational resources]: UI improvements	Closed	Andriana Kovalyshyn	Actions
DATALAB-175	[AWS]: EMR creation fails	Closed	Oleksandr Isniuk	Actions
DATALAB-226	EMR configuration fails due to of limited quantity nginx restart per 10 seconds	Closed	Oleh Moskovych	Actions
DATALAB-598	[AWS][GCP]:Convey cluster version on Data Engine Service popup	Closed	Andriana Kovalyshyn	Actions
DATALAB-963	[AWS]: Sometimes EMR creation fails	Closed	Oleh Martushevskyi	Actions
DATALAB-1033	[AWS]: EMR creation fails in case of the othe EMR creation/termination simultaneously	Closed	Adams Disturber	Actions
DATALAB-1090	Include EMR disk name cluster_name, instead of instance_name on GCP	Closed	Adams Disturber	Actions
DATALAB-1211	[GCP]: Dataproc creation fails due to Edge node is unavailable	Closed	Adams Disturber	Actions
DATALAB-1221	[AWS]: EMR termination fails due to absence of 'endpoint_name' parameter	Closed	Oleg Fuks	Actions
DATALAB-1226	[AWS]: Notebook stopping fails if it has active computational resources	Closed	Oleg Fuks	Actions
DATALAB-1387	[GCP]: Dataproc creation fails	Closed	Mykola Bodnar	Actions
DATALAB-1403	Simultaneously Data Engine Service creation fails in the same project even if users are different	Closed	Mykola Bodnar	Actions
DATALAB-1404	Simultaneously DES creation fails per one note and for the same user	Closed	Mykola Bodnar	Actions
DATALAB-1486	[GCP]: It is impossible to create Dataproc	Closed	Dmytro Gnatyshyn	Actions
DATALAB-1412	[AWS][?Obsolete?]: Spark-submit --version runs with error for EMR v.5.19.0	Closed	Mykola Bodnar	Actions
DATALAB-1626	[GCP]: Notebook termination fails if notebook contains Dataproc	Closed	Leonid Frolov	Actions
DATALAB-1916	Show version of Data Engine service to FE	Closed	Pavel Papou	Actions
DATALAB-1925	[AWS][EMR]: It is not shown correct total instance number for EMR	Closed	Dmytro Gnatyshyn	Actions
DATALAB-1929	Allow only one active Data Engine Service per notebook	Closed	Dmytro Gnatyshyn	Actions
DATALAB-2099	[GCP]: Compute configuration fails	Closed	Leonid Frolov	Actions
DATALAB-2113	[GCP]:Dataproc creation fails on RStudio/Apache Zeppelin	Closed	Leonid Frolov	Actions
DATALAB-2114	[GCP]: Value of master instance number is '0' for Dataproc	Closed	Dmytro Gnatyshyn	Actions
DATALAB-2154	EMR creation fails	Closed	Leonid Frolov	Actions
DATALAB-2179	[AWS]: EMR status is not synced up with cloud 'terminated' status	In Progress	Yurii Kinash	Actions
DATALAB-2222	[GCP][Dataproc]Python 2.7.16 is used instead of Python 3.7	Closed	Mykola Bodnar	Actions
DATALAB-2225	[GCP][Spark Standalone cluster]: Python 2.7.17 is used instead of Python 3.6	Closed	Mykola Bodnar	Actions
DATALAB-2226	Library from R package is not installed on Dataproc	Closed	Leonid Frolov	Actions
DATALAB-2232	[Back-end][GCP]: Add new parameters for Dataproc	Closed	Yurii Kinash	Actions
DATALAB-2233	[Front-end][GCP]: Add new parameters for Dataproc	Closed	Dmytro Gnatyshyn	Actions
DATALAB-2258	[Front-end]: Show GPU Dataproc parameters after Data Engine Service creation	Closed	Dmytro Gnatyshyn	Actions
DATALAB-2259	[Back-end]: Show GPU Dataproc parameters after Data Engine Service creation	Closed	Yurii Kinash	Actions
DATALAB-2422	[Dataproc]: GPU template is not available	Closed	Yurii Kinash	Actions
DATALAB-2425	[Back-end]: Dataproc creation is forbidden	Closed	Yurii Kinash	Actions
DATALAB-2426	[Front-end]: Dataproc creation is forbidden	Closed	Yurii Tykhun	Actions
DATALAB-2437	[Dataproc]: Mismatch in GPU parameters	Closed	Yurii Kinash	Actions
DATALAB-2445	[GCP]:Dataproc creation fails on RStudio/Apache Zeppelin	Closed	Leonid Frolov	Actions
DATALAB-2487	Get rid of EMR version 6.0.0	Closed	Leonid Frolov	Actions
DATALAB-2529	Dataproc creation fails	Closed	Leonid Frolov	Actions
DATALAB-2607	[GCP] Data Engine Service (Dataproc) creation fails on RStudio/Zeppelin	Closed	Leonid Frolov	Actions
DATALAB-2691	[AWS][GCP] Data Engine Service (EMR v.5.30.0)/Dataproc creation fails on stage of configuration	Closed	Leonid Frolov	Actions
DATALAB-2806	[GCP] Dataproc cluster creation fails due connection problems	Closed	Oleksandr Polishchuk	Actions
DATALAB-2982	Convey required information to BE for cretion/termination HDInsight	Closed	Leonid Frolov	Actions
DATALAB-3053	[DevOps] Implement Python virtual environment usage	Open	Leonid Frolov	Actions
DATALAB-3079	[Azure][DevOps][Part1] Scope of tasks for HDInsight	In Progress	Leonid Frolov	Actions
DATALAB-3080	[Azure][HDInsight] Convey correct version and change "_" for "-" in the name of HDInsight	Closed	Oleksandr Repnikov	Actions
DATALAB-3081	[HDInsight]Hide possibility to install library from DataLab WEB UI	Closed	Hennadii Shpak	Actions
DATALAB-3082	[Azure] Billing tasks for HDInsight	In Progress	Denys Yankiv	Actions
DATALAB-3083	[Azure] HDInsight has not access to the bucket	Closed	Leonid Frolov	Actions
DATALAB-3084	[Azure][Zeppelin] Adjust view of remote interpreter with respect to the necessary interpreters	Closed	Leonid Frolov	Actions
DATALAB-3085	[Azure][Jupyter] HDInsight is still available in the kernel list after its termination	Closed	Leonid Frolov	Actions
DATALAB-3087	[Azure][RStudio] Password is still available after HDInsight termination	Closed	Leonid Frolov	Actions
DATALAB-3088	[Azure]Project termination fails if HDInsight is in Running status	Closed	Leonid Frolov	Actions
DATALAB-3089	[Azure]During notebook termination HDInsight is stuck in Terminating status on DataLab WEB UI	In Progress	Denys Yankiv	Actions
DATALAB-3090	[Azure][RStudio]Investigate how to run playbook on HDInsight	In Progress	Leonid Frolov	Actions
DATALAB-3091	[Azure][Jupyter] HDInsight is still available in the kernel list after its termination	Closed	Leonid Frolov	Actions
DATALAB-3092	[Azure][RStudio] Password is still available after HDInsight termination	Closed	Leonid Frolov	Actions
DATALAB-3094	[Azure] Spark cluster reconfiguration fails	Open	Leonid Frolov	Actions
DATALAB-3098	[Azure]Azure HDInsight cloud status 'error' does not change status in DataLab UI	Closed	Leonid Frolov	Actions

Activity

People

Assignee:: Unassigned

Reporter:: Vira Vitanska

Votes:: 0 Vote for this issue

Watchers:: 1 Start watching this issue

Dates

Created:: 27/Feb/19 15:54

Updated:: 04/Nov/22 10:02

Agile

View on Board

DataLab Compute Engine

Details

Description

Attachments

Issues in epic

Activity

People

Dates

Agile

Slack

Issue deployment