Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-3119

Failed to deploy docker provisioner on Mac occasionally

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.3.0
    • Fix Version/s: None
    • Component/s: docker, provisioner
    • Labels:
      None

      Description

      The error log:

      ./docker-hadoop.sh -d -c 1
      WARNING: The DOCKER_IMAGE variable is not set. Defaulting to a blank string.
      WARNING: The MEM_LIMIT variable is not set. Defaulting to a blank string.
      WARNING: The DOCKER_IMAGE variable is not set. Defaulting to a blank string.
      WARNING: The MEM_LIMIT variable is not set. Defaulting to a blank string.
      Stopping 20171216224653r31038_bigtop_1 ... done
      WARNING: The DOCKER_IMAGE variable is not set. Defaulting to a blank string.
      WARNING: The MEM_LIMIT variable is not set. Defaulting to a blank string.
      Going to remove 20171216224653r31038_bigtop_1
      Removing 20171216224653r31038_bigtop_1 ... done
      ./config/hiera.yaml
      ./config/hieradata/bigtop/cluster.yaml
      ./config/hieradata/bigtop/ha.yaml
      ./config/hieradata/bigtop/noha.yaml
      ./config/hieradata/bigtop
      ./config/hieradata/site.yaml
      ./config/hieradata
      ./config/hosts
      ./config
      .provision_id
      Environment check...
      Check docker:
      Docker version 17.09.1-ce, build 19e2cf6
      Check docker-compose:
      docker-compose version 1.17.1, build 6d101fb
      Check ruby:
      ruby 2.0.0p648 (2015-12-16 revision 53162) [universal.x86_64-darwin16]
      WARNING: The scale command is deprecated. Use the up command with the --scale flag instead.
      Creating 20171217103727r15552_bigtop_1 ...
      Creating 20171217103727r15552_bigtop_1 ... done
      
      [LOG] Bigtop Puppet configurations are shared between instances, and can be modified under config/hieradata
      
      ../../bigtop-deploy/puppet/hieradata -> ./config/hieradata
      ../../bigtop-deploy/puppet/hieradata/bigtop -> ./config/hieradata/bigtop
      ../../bigtop-deploy/puppet/hieradata/bigtop/cluster.yaml -> ./config/hieradata/bigtop/cluster.yaml
      ../../bigtop-deploy/puppet/hieradata/bigtop/ha.yaml -> ./config/hieradata/bigtop/ha.yaml
      ../../bigtop-deploy/puppet/hieradata/bigtop/noha.yaml -> ./config/hieradata/bigtop/noha.yaml
      ../../bigtop-deploy/puppet/hieradata/site.yaml -> ./config/hieradata/site.yaml
      Loaded plugins: fastestmirror, ovl
      Determining fastest mirrors
       * base: ftp.stu.edu.tw
       * epel: mirror.ehost.vn
       * extras: ftp.stu.edu.tw
       * updates: ftp.stu.edu.tw
      Resolving Dependencies
      --> Running transaction check
      ---> Package rng-tools.x86_64 0:5-11.el7 will be installed
      --> Processing Dependency: libsysfs.so.2()(64bit) for package: rng-tools-5-11.el7.x86_64
      --> Running transaction check
      ---> Package libsysfs.x86_64 0:2.1.0-16.el7 will be installed
      --> Finished Dependency Resolution
      
      Dependencies Resolved
      
      ================================================================================
       Package            Arch            Version                 Repository     Size
      ================================================================================
      Installing:
       rng-tools          x86_64          5-11.el7                base           35 k
      Installing for dependencies:
       libsysfs           x86_64          2.1.0-16.el7            base           46 k
      
      Transaction Summary
      ================================================================================
      Install  1 Package (+1 Dependent package)
      
      Total download size: 82 k
      Installed size: 214 k
      Downloading packages:
      --------------------------------------------------------------------------------
      Total                                              206 kB/s |  82 kB  00:00
      Running transaction check
      Running transaction test
      Transaction test succeeded
      Running transaction
        Installing : libsysfs-2.1.0-16.el7.x86_64                                 1/2
        Installing : rng-tools-5-11.el7.x86_64                                    2/2
        Verifying  : rng-tools-5-11.el7.x86_64                                    1/2
        Verifying  : libsysfs-2.1.0-16.el7.x86_64                                 2/2
      
      Installed:
        rng-tools.x86_64 0:5-11.el7
      
      Dependency Installed:
        libsysfs.x86_64 0:2.1.0-16.el7
      
      Complete!
      local yum = false ; NOT Enabling local yum.  Packages will be pulled from remote...
      Warning: Config file /etc/puppet/hiera.yaml not found, using Hiera defaults
      Error: Could not find data item bigtop::hadoop_head_node in any Hiera data file and no default supplied on node 2e4226e33ac3.bigtop.apache.org
      Error: Could not find data item bigtop::hadoop_head_node in any Hiera data file and no default supplied on node 2e4226e33ac3.bigtop.apache.org
      

      Dig further into this we can find the shared folder hieradata is not accessible inside container.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                evans_ye Evans Ye
                Reporter:
                evans_ye Evans Ye
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: