[BIGTOP-1329] Leverage bigtop to build a patch deployment tester for hadoop.

• Type: Wish
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: backlog
• Component/s: vm
• Assignee: Unassigned
• Reporter: jay vyas
• Created: 06/Jun/14 16:55
• Updated: 08/Jun/14 01:54

Description

YARN-1964 demonstrates that testing patches in hadoop is not just about unit testing anymore : End to end testing is increasingly valuable.

Lets create a vagrant recipe in bigtop which

1) Pulls a jira patch down
2) Builds hadoop from scratch and
3) Packages it in a local repo, in a VM.
4) Runs a smoke test on the patch.

This essentially would validate that (1) bigtop hadoop packaging is up-to-date with the code on hadoop head (2) Give the hadoop community a solid utility for end-to-end testing of YARN apps.

This jira will be a significant undertaking, and we will work some on the idea during the BigTop Meetup today.

Lets start by diagraming the process for end-to-end testing of a hadoop patch using bigtop-rpms, and ensuring that its actually feasible.