[FLINK-13646] Add ARM CI job definition scripts

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 2.0.0
• Component/s: Build System
• Labels: pull-request-available
• Assignee: wangxiyuan
• Reporter: wangxiyuan
• Created: 08/Aug/19 07:11
• Updated: 16/Dec/19 08:56
• Resolved: 16/Dec/19 08:56

Description

OpenLab CI github-app now is added to Flink repo. It's a good time to add the related ARM job definition scripts now.
OpenLab uses zuul[1] as the CI infrastructure which uses ansible[2] for job execution and definition.

The ansible scripts for job definition is always contained in a file named .zuul.yaml. Here is an example[3].

So for Flink ARM support work, I suggest to devide it into some steps(we will add flink-core and flink-test related modules as the beginner. Other modules can be added later if people want them):

1. Add the basic build script to ensure the CI system and build job works as expect. The job should be marked as non-voting first, it means the CI test failure won't block Flink PR to be merged.
2. Add the test script to run unit/intergration test. At this step the --fn parameter will be added to mvn test. It will run the full test cases in Flink, so that we can find what test is failed on ARM.
3. Fix the test failure one by one.
4. Once all the tests are passed, remove the --fn parameter and keep watch the CI's status for some days. If some bugs raise then, fix them as what we usually do for travis-ci.
5. Once the CI is stable enought, remove the non-voting tag, so that the ARM CI will be the same as travis-ci, to be one of the gate for Flink PR.
6. Finally, Flink community can announce and release Flink ARM version.

OpenLab will keep helping and maintaining the ARM work. If you have any question or requirement, welcome to job IRC channel: #askopenlab

Any thought?

Thanks.

[1]: https://zuul-ci.org/docs/zuul/
[2]: https://www.ansible.com/
[3]: https://github.com/theopenlab/flink/pull/1/files

Issue Links

• links to: GitHub Pull Request #9416