Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-3665

Fix Docker provisioner to work with Fedora 35

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.1.0
    • docker, provisioner
    • None

    Description

      1. Running provisioner/docker/docker-hadoop.sh with the default docker-compose.yml on Fedora 35 causes the following error.

      $ ./docker-hadoop.sh -d -k zookeeper -r file:///bigtop-home/output -C config_fedora-35.yaml -G -c 1
      
      ...
      
      Error response from daemon: Container 57d94cd870c9fb13e351b35f99c8d1870203baba0c571e6d4e1f66ee17fd5692 is not running
      
      [LOG] Failed to provision container 57d94cd870c9fb13e351b35f99c8d1870203baba0c571e6d4e1f66ee17fd5692 with exit code 1
      

      Just like Debian 11, Fedora 35 also should be mentioned in the "Experimental" section in provisioner/docker/README.md.

      2. Even using the right version of docker-compose.yml, it fails with the following error.

      $ ./docker-hadoop.sh -d -k zookeeper -r file:///bigtop-home/output -C config_fedora-35.yaml -F docker-compose-cgroupv2.yml -G -c 1
      
      ...
      
      Error: Evaluation Error: Unknown function: 'any2array'. (file: /bigtop-home/bigtop-deploy/puppet/manifests/bigtop_repo.pp, line: 24, column: 25) on node 4ddfc8e441f7.bigtop.apache.org
      
      [LOG] Failed to provision container 4ddfc8e441f7f2f98133833b08cfcb215a1350306e9a97bf04208bb776babcdb with exit code 1
      

      This is because the puppetlabs-stdlib module is installed in /etc/puppet/code/modules on Fedora 35 by default. This path should be added to the puppet apply command in the bigtop-puppet function in docker-hadoop.sh.
      (I updated build.gradle and docker/bigtop-slaves/build.sh in BIGTOP-3658, but forgot to update it)

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            yoda-mon Leona Yoda
            sekikn Kengo Seki
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 20m
                20m

                Slack

                  Issue deployment