[NEMO-404] Provide user argument to use lambda executor representer

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.2
• Labels: pull-request-available
• Assignee: Gao Zhiyuan
• Reporter: Gao Zhiyuan
• Created: 07/Aug/19 13:14
• Updated: 07/Mar/20 06:35
• Resolved: 25/Aug/19 12:51

Description

1. Description

On supporting LambdaExecutor, this issue relates to allowing user to specify which type of executor they need, and refactor the dependency classes to runtime/common to avoid cyclic dependencies.

1. # # Major changes:

• Provide user argument to use the new representer
• Refactor task state manager and metric manager from runtime executor to runtime common

1. Other comments:

Try it out by
```
./bin/run_beam.sh \
-job_id wordCount_testexecutor \
-executor_json `pwd`/examples/resources/executors/beam_test_executor_resources.json \
-optimization_policy org.apache.nemo.compiler.optimizer.policy.DefaultPolicy \
-user_main org.apache.nemo.examples.beam.WordCount \
-executor_type lambda \
-user_args "`pwd`/examples/resources/inputs/test_input_wordcount `pwd`/outputs/wordcount --numEventGenerators=1"
```

Issue Links

• is a child of: NEMO-398 ExecutorRepresenter interface and LambdaExecutorRepresenter
• links to: GitHub Pull Request #229
• links to: GitHub Pull Request #230