[BIGTOP-3119] Failed to deploy docker provisioner on Mac occasionally

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.3.0
• Component/s: docker, provisioner
• Assignee: Evans Ye
• Reporter: Evans Ye
• Created: 26/Dec/18 08:25
• Updated: 22/Mar/19 10:23

Description

The error log:

./docker-hadoop.sh -d -c 1
WARNING: The DOCKER_IMAGE variable is not set. Defaulting to a blank string.
WARNING: The MEM_LIMIT variable is not set. Defaulting to a blank string.
WARNING: The DOCKER_IMAGE variable is not set. Defaulting to a blank string.
WARNING: The MEM_LIMIT variable is not set. Defaulting to a blank string.
Stopping 20171216224653r31038_bigtop_1 ... done
WARNING: The DOCKER_IMAGE variable is not set. Defaulting to a blank string.
WARNING: The MEM_LIMIT variable is not set. Defaulting to a blank string.
Going to remove 20171216224653r31038_bigtop_1
Removing 20171216224653r31038_bigtop_1 ... done
./config/hiera.yaml
./config/hieradata/bigtop/cluster.yaml
./config/hieradata/bigtop/ha.yaml
./config/hieradata/bigtop/noha.yaml
./config/hieradata/bigtop
./config/hieradata/site.yaml
./config/hieradata
./config/hosts
./config
.provision_id
Environment check...
Check docker:
Docker version 17.09.1-ce, build 19e2cf6
Check docker-compose:
docker-compose version 1.17.1, build 6d101fb
Check ruby:
ruby 2.0.0p648 (2015-12-16 revision 53162) [universal.x86_64-darwin16]
WARNING: The scale command is deprecated. Use the up command with the --scale flag instead.
Creating 20171217103727r15552_bigtop_1 ...
Creating 20171217103727r15552_bigtop_1 ... done

[LOG] Bigtop Puppet configurations are shared between instances, and can be modified under config/hieradata

../../bigtop-deploy/puppet/hieradata -> ./config/hieradata
../../bigtop-deploy/puppet/hieradata/bigtop -> ./config/hieradata/bigtop
../../bigtop-deploy/puppet/hieradata/bigtop/cluster.yaml -> ./config/hieradata/bigtop/cluster.yaml
../../bigtop-deploy/puppet/hieradata/bigtop/ha.yaml -> ./config/hieradata/bigtop/ha.yaml
../../bigtop-deploy/puppet/hieradata/bigtop/noha.yaml -> ./config/hieradata/bigtop/noha.yaml
../../bigtop-deploy/puppet/hieradata/site.yaml -> ./config/hieradata/site.yaml
Loaded plugins: fastestmirror, ovl
Determining fastest mirrors
 * base: ftp.stu.edu.tw
 * epel: mirror.ehost.vn
 * extras: ftp.stu.edu.tw
 * updates: ftp.stu.edu.tw
Resolving Dependencies
--> Running transaction check
---> Package rng-tools.x86_64 0:5-11.el7 will be installed
--> Processing Dependency: libsysfs.so.2()(64bit) for package: rng-tools-5-11.el7.x86_64
--> Running transaction check
---> Package libsysfs.x86_64 0:2.1.0-16.el7 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================
 Package            Arch            Version                 Repository     Size
================================================================================
Installing:
 rng-tools          x86_64          5-11.el7                base           35 k
Installing for dependencies:
 libsysfs           x86_64          2.1.0-16.el7            base           46 k

Transaction Summary
================================================================================
Install  1 Package (+1 Dependent package)

Total download size: 82 k
Installed size: 214 k
Downloading packages:
--------------------------------------------------------------------------------
Total                                              206 kB/s |  82 kB  00:00
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : libsysfs-2.1.0-16.el7.x86_64                                 1/2
  Installing : rng-tools-5-11.el7.x86_64                                    2/2
  Verifying  : rng-tools-5-11.el7.x86_64                                    1/2
  Verifying  : libsysfs-2.1.0-16.el7.x86_64                                 2/2

Installed:
  rng-tools.x86_64 0:5-11.el7

Dependency Installed:
  libsysfs.x86_64 0:2.1.0-16.el7

Complete!
local yum = false ; NOT Enabling local yum.  Packages will be pulled from remote...
Warning: Config file /etc/puppet/hiera.yaml not found, using Hiera defaults
Error: Could not find data item bigtop::hadoop_head_node in any Hiera data file and no default supplied on node 2e4226e33ac3.bigtop.apache.org
Error: Could not find data item bigtop::hadoop_head_node in any Hiera data file and no default supplied on node 2e4226e33ac3.bigtop.apache.org

Dig further into this we can find the shared folder hieradata is not accessible inside container.

Issue Links

• is related to: BIGTOP-3116 [Provisioner] Docker Provisioner failed to deploy on mac due to missing site.yaml file