[DATALAB-1788] Performance for uploading should be better

• Type: Task
• Status: Closed
• Priority: Major
• Resolution: Done
• Fix Version/s: v.2.4
• Component/s: DataLab Main
• Labels: AWS AZURE Back-end Debian GCP RedHat
• Epic Link: Bucket browser
• Sprint: Apache DLab release 2.4
• Assignee: Oleg Fuks
• Reporter: Vira Vitanska
• Created: 08/May/20 06:13
• Updated: 16/Sep/20 08:44
• Resolved: 13/May/20 16:15

Description

1. Uploading performance (I've checked only on AWS and GCP) ofuks look at performance on GCP/AWS:

 

 Uploading performance

AWS (30/04/2020)

Size	AWS	Bucket browser
51MB	1:35	3:15
51MB	1:41	0:28
51MB	0:33	0:25
51MB	0:40	0:22
Size	AWS	Bucket browser
97.2MB	0:49	0:44
97.2MB	1:08	0:39
97.2MB	1:14	0:50
97.2MB	0:53	0:32
Size	AWS	Bucket browser
8.6MB	0:16	0:16
8.6MB	0:17	0:05
8.6MB	0:17	0:05
8.6MB	0:17	0:04

Via VPN

Size	AWS	Bucket browser
8.6MB	0:16	0:25
8.6MB	4:13	0:29
8.6MB	0:34	0:30
8.6MB	0:32	0:38

AWS (04/05/2020)

Size	AWS	Bucket browser
51MB	1:02	1:38
51MB	0:32	0:28
51MB	0:42	0:23
51MB	0:28	0:21
Size	AWS	Bucket browser
97.2MB	1:20	0:34
97.2MB	2:44	0:36
97.2MB	1:21	3:25
97.2MB	0:56	0:43

---

Ticket verifying:
AWS (13/05/2020)

Size	AWS	Bucket browser
51MB	0:29	0:16
51MB	0:18	0:13
51MB	0:44	0:12
51MB	0:34	0:12
Size	AWS	Bucket browser
97.2MB	1:22	0:26
97.2MB	2:35	0:26
97.2MB	0:27	1:58
97.2MB	0:46	0:31

 

---

GCP (30/04/2020)

Size	GCP	Bucket browser
51MB	0:18	1:21
51MB	0:12	1:50
51MB	0:14	2:20
51MB	0:35	2:52
Size	GCP	Bucket browser
97.2MB	0:47	3:13
97.2MB	0:58	more than 8:00
97.2MB
97.2MB
Size	GCP	Bucket browser
8.6MB	0:03	0:04
8.6MB	0:03	0:03
8.6MB	0:03	0:04
8.6MB	0:03	0:08

Via VPN

Size	GCP	Bucket browser
8.6MB	0:05	0:08
8.6MB	0:04	0:08
8.6MB	0:06	0:17
8.6MB	0:04	0:05

GCP (04/05/2020)

Size	GCP	Bucket browser
51MB	0:21	0:19
51MB	0:16	0:22
51MB	0:15	0:16
51MB	0:17	0:19
Size	GCP	Bucket browser
97.2MB	0:25	1:21
97.2MB	0:29	1:19
97.2MB	0:37	1:21
97.2MB	0:30	0:42

---

Ticket verifying

GCP (13/05/2020)

Size	GCP	Bucket browser
51MB	0:12	0:17
51MB	0:14	0:16
51MB	0:14	0:16
51MB	0:14	0:15
Size	GCP	Bucket browser
97.2MB	0:22	0:23
97.2MB	0:18	0:23
97.2MB	0:20	0:25
97.2MB	0:22	0:26
Size	GCP	Bucket browser
543MB	2:03	1:26
543MB	2:02	1:32