[BIGTOP-2615] Provide a tool to build pseudo cluster docker images

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1.0
• Fix Version/s: 1.2.0
• Component/s: docker
• Assignee: Evans Ye
• Reporter: Evans Ye
• Created: 02/Dec/16 14:49
• Updated: 29/Mar/17 18:46
• Resolved: 16/Jan/17 17:32

Description

This JIRA implements a tool named Hadoocker, which is to build docker images that have specified hadoop components provisioned inside. During image build time, we execute puppet apply to install packages and configuration. After images are built, components can be brought up quickly by executing puppet apply again. Usually it takes about 80~180 seconds, depends on the complexity of components.
This work adopt exactly the same idea introduced by cos in BIGTOP-2296, but goes further to implement a tool that supports different OS, components, or even a customized site.yaml config file.

Use cases for Bigtop users:

• Quick POC environment
• Being leveraged in CI/CD pipeline

Use cases for Bigtop:

• Image generation CI jobs can be treated as our integration tests.

Issue Links

• is related to: BIGTOP-2036 [Docker provisioner] Adopt a more flexible port mapping mechanism
• links to: GitHub Pull Request #165