[HUDI-1616] Abstract out one off operations within dag

• Type: Test
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 0.9.0
• Component/s: Testing, tests-ci
• Epic Link: CI tests improvements
• Assignee: Unassigned
• Reporter: sivabalan narayanan
• Created: 12/Feb/21 21:47
• Updated: 10/Mar/23 01:03

Description

In existing test suite, we have a config called "execute_itr_count". When this is set to N for a particular node, out of 50 odd iterations, this node will be executed only on Nth iteration only. 

Use-case: 

we wish to execute clustering node on 10th iteration. but the entire dag needs to be executed for 25 iterations.