[AIRAVATA-2555] Standardizing Workflow execution by using CWL

• Type: New Feature
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Component/s: Workflow Engine, Workflow Tracking
• Assignee: Saurabh Agrawal
• Reporter: Saurabh Agrawal
• Created: 10/Oct/17 01:47
• Updated: 16/Dec/17 07:29

Description

Pull request
Wikis

• Assignment 4
• Assignment 5
• Assignment 6
• Assignment 7

The current workflow execution and monitoring are not very user-friendly.
We would like to make these simpler and use standard technologies.

The goals of this project are as follows:
1) A specification for passing task DAG information from the client to the Airavata API
2) Interpreting the DAG inside workflow engine
3) Executing and monitoring the tasks

1) A specification for passing task DAG information from the client to the Airavata API:
We are considering Common Workflow Language

2) Interpreting the DAG inside workflow engine: We considered Airflow, but it is probably not the best fit for our requirements. We are currently looking at CWL tool

3) Executing and monitoring the tasks: Need to confirm whether to keep this task in this project or not