[GOBBLIN-64] Added skipping feature to MultiWorkUnits

• Type: Task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Labels: Core:TaskManagement enhancement
• External issue URL: https://github.com/linkedin/gobblin/pull/1521
• Assignee: Unassigned
• Reporter: Abhishek Tiwari
• Created: 19/Jul/17 07:39
• Updated: 07/Aug/17 08:57

Description

This change will allow MultiWorkUnits to be skipped. If some WorkUnits are marked are skipped in MultiWorkUnit they can be skipped too. Modified the test for skipping of MultiWorkUnits.

Github Url : https://github.com/linkedin/gobblin/pull/1521
Github Reporter : aditya1105
Github Assignee : aditya1105
Github Created At : 2017-01-09T08:26:47Z
Github Updated At : 2017-05-18T15:26:35Z

Comments

---

abti wrote on 2017-01-12T03:35:58Z : Why would we create workunits if we intend to skip them?

Github Url : https://github.com/linkedin/gobblin/pull/1521#issuecomment-272067568

---

aditya1105 wrote on 2017-01-12T08:25:31Z : As described in issue https://github.com/linkedin/gobblin/issues/1314, we need to create WorkUnit to persist its state in the state store.

Github Url : https://github.com/linkedin/gobblin/pull/1521#issuecomment-272102794