[NEMO-193] Revised version of IR-based dynamic optimization

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.2
• Labels: compiler runtime
• Assignee: Unassigned
• Reporter: Jeongyoon Eo
• Created: 19/Aug/18 01:07
• Updated: 07/Mar/20 06:50
• Resolved: 18/Feb/19 12:19

Description

Current dynamic optimization is done via StageEdge in removing IR DAG from PhysicalPlan(NEMO-192). We need a revised version of IR-based dynamic optimization, considering issues related with RDD caching(NEMO-6) and reshaping IR DAG in run-time(NEMO-182).