[AIRAVATA-3315] Implement Storage Quotas for multiple types of storages

• Type: Epic
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Labels: gsoc2020
• Epic Name: Airavata User Storage Quotas
• Assignee: Vivek Shresta Bandaru
• Reporter: Suresh Marru
• Created: 30/Mar/20 22:47
• Updated: 03/Aug/20 15:37

Description

Airavata based science gateways store data in gateway storage, typically mounted with the portal's hosting server. Each user's data is organized within user directories on these storage devices. As storage gets full, it often creates an issue in rationing the disks.

This Epic is to track a new capability to implement user-specific quotas within Airavata and track usage. This will involve:

• Adding a configurable user-specific storage per gateway. This should be adding an entry to Gateway Resource Profile - https://github.com/apache/airavata/blob/master/thrift-interface-descriptions/data-models/resource-catalog-models/gateway_resource_profile_model.thrift#L84-L89
• Record user-specific usage within Airavata's experiment catalog 
• Add user interfaces to display user-specific quota and current usage. 
• Use Airavata MFT service to fetch current information on users storage to cross validate. 

 

Mentors: Sudhakar, Suresh, Dimuthu

Sub-Tasks

• Add configurable user-specific storage quota entry: Open
• Develop a quota tracking mechanism: Open
• Alter Experiment table to include EXPERIMENT_DATA_DIR_SIZE column: Open
• Changes to Thrift files to accommodate the entry EXPERIMENT_DATA_DIR_SIZE: Open