[BIGTOP-3356] Add CentOS 8 support to the Docker provisioner

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: docker, provisioner
• Assignee: Kengo Seki
• Reporter: Kengo Seki
• Created: 19/May/20 16:16
• Updated: 23/Jun/20 16:01
• Resolved: 31/May/20 23:05

Description

1. The puppet package provided by puppetlabs installs the puppet command into /opt/puppetlabs/bin, so we have to append it to the container's PATH environment variable. Without that, provisioner fails with a "command not found" error.

2. puppet module install installs a module to /etc/puppetlabs/code/environments/production/modules by default in the case of puppetlabs' one (https://puppet.com/docs/puppet/5.5/modules_installing.html#concept-5452). So we have to add it to the --modulepath option in docker-hadoop.sh. Without that, provisioner fails with the following error.

Error: Evaluation Error: Unknown function: 'any2array'. (file: /bigtop-home/bigtop-deploy/puppet/manifests/bigtop_repo.pp, line: 20, column: 25) on node 31aac35f86a7.bigtop.apache.org

3. Provisioner copies hiera.yaml to /etc/puppet in the container via docker-compose, but it's not included in Hiera's lookup path (https://puppet.com/docs/puppet/5.5/hiera_automatic.html#puppet_lookup). We have to specify the --hiera_config option explicitly when running puppet apply. Without that, it fails with the following error.

Error: Function lookup() did not find a value for the name 'bigtop::hadoop_head_node'

Issue Links

• links to: https://github.com/apache/bigtop/pull/640