This JIRA implements a tool named Hadoocker, which is to build docker images that have specified hadoop components provisioned inside. During image build time, we execute puppet apply to install packages and configuration. After images are built, components can be brought up quickly by executing puppet apply again. Usually it takes about 80~180 seconds, depends on the complexity of components.
This work adopt exactly the same idea introduced by Konstantin Boudnik in
BIGTOP-2296, but goes further to implement a tool that supports different OS, components, or even a customized site.yaml config file.
Use cases for Bigtop users:
- Quick POC environment
- Being leveraged in CI/CD pipeline
Use cases for Bigtop:
- Image generation CI jobs can be treated as our integration tests.