[GOBBLIN-1944] Create Gobblin-Temporal load-generator to de-risk Temporal's scaling

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Component/s: gobblin-core
• Assignee: Abhishek Tiwari
• Reporter: Kip Kohn
• Created: 31/Oct/23 01:16
• Updated: 01/Nov/23 05:08
• Resolved: 01/Nov/23 05:07

Description

To de-risk Temporal as an effective platform for executing Gobblin jobs, we must validate that temporal workflows can scale-up to a Big Data number of activities. To perform such load testing, build a load-generator for creating nesting workflows that ultimately subsume whatever configurable number of activities.