[BIGTOP-3408] docker-hadoop.sh generates broken site.yaml from config.yaml containing multiple components

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: provisioner
• Assignee: Masatake Iwasaki
• Reporter: Masatake Iwasaki
• Created: 18/Sep/20 11:21
• Updated: 23/Sep/20 04:35
• Resolved: 20/Sep/20 18:16

Description

input:

$ grep components provisioner/docker/config.yaml
components: [hdfs, yarn, mapreduce, kms]
smoke_test_components: [hdfs, yarn, mapreduce, kms]

output:

[root@848451c899db puppet]# cat /etc/puppet/hieradata/site.yaml
bigtop::hadoop_head_node: 848451c899db.bigtop.apache.org
hadoop::hadoop_storage_dirs: [/data/1, /data/2]
bigtop::bigtop_repo_uri:
bigtop::bigtop_repo_gpg_check: false
hadoop_cluster_node::cluster_components: [hdfs
yarn
mapreduce
kms]
hadoop_cluster_node::cluster_nodes: [172.17.0.2]

Issue Links

• is broken by: BIGTOP-3401 Failed to build Centos-8 docker images for Arm64
• links to: GitHub Pull Request #674