Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3611 Support Docker Containers In LinuxContainerExecutor
  3. YARN-8228

Docker does not support hostnames greater than 64 characters

    XMLWordPrintableJSON

Details

    Description

      If containers name is greater than 64 characters, docker containers stays in Created state only And app fails with below error

       

      /usr/bin/docker-current: Error response from daemon: oci runtime error: container_linux.go:247: starting container process caused "process_linux.go:364: container init caused \"invalid argument\"".
      
      Could not invoke docker /usr/bin/docker run --name='container_1524681858728_0001_01_000004' --user='99:99' -d --workdir='/grid/0/hadoop/yarn/local/usercache/hrt_qa/appcache/application_1524681858728_0001/container_1524681858728_0001_01_000004' --net='hadoop' -v '/grid/0/hadoop/yarn/local/filecache:/grid/0/hadoop/yarn/local/filecache:ro' -v '/grid/0/hadoop/yarn/local/usercache/hrt_qa/filecache:/grid/0/hadoop/yarn/local/usercache/hrt_qa/filecache:ro' -v '/grid/0/hadoop/yarn/local/usercache/hrt_qa/appcache/application_1524681858728_0001/filecache/195/httpd-proxy.conf:/etc/httpd/conf.d/httpd-proxy.conf:ro' -v '/grid/0/hadoop/yarn/log/application_1524681858728_0001/container_1524681858728_0001_01_000004:/grid/0/hadoop/yarn/log/application_1524681858728_0001/container_1524681858728_0001_01_000004' -v '/grid/0/hadoop/yarn/local/usercache/hrt_qa/appcache/application_1524681858728_0001:/grid/0/hadoop/yarn/local/usercache/hrt_qa/appcache/application_1524681858728_0001' --cgroup-parent='/hadoop-yarn-tmp-xxx/container_1524681858728_0001_01_000004' --cap-drop='ALL' --cap-add='SYS_CHROOT' --cap-add='MKNOD' --cap-add='SETFCAP' --cap-add='SETPCAP' --cap-add='DAC_READ_SEARCH' --cap-add='FSETID' --cap-add='SYS_PTRACE' --cap-add='CHOWN' --cap-add='SYS_ADMIN' --cap-add='AUDIT_WRITE' --cap-add='SETGID' --cap-add='NET_RAW' --cap-add='FOWNER' --cap-add='SETUID' --cap-add='DAC_OVERRIDE' --cap-add='KILL' --cap-add='NET_BIND_SERVICE' --hostname='httpd-proxy-0.fault-test-component-kill-httpd-docker.hrt-qa.test.com' --group-add '99' 'centos/httpd-24-centos7:latest' 'bash' '/grid/0/hadoop/yarn/local/usercache/hrt_qa/appcache/application_1524681858728_0001/container_1524681858728_0001_01_000004/launch_container.sh' .
      
      
      
      Shell output: main : command provided 4
      
      main : run as user is nobody
      
      main : requested yarn user is hrt_qa
      
      Creating script paths...
      
      Creating local dirs...
      
      Getting exit code file...
      
      Changing effective user to root...
      
      Launching docker container...
      
      Docker run command: /usr/bin/docker run --name='container_1524681858728_0001_01_000004' --user='99:99' -d --workdir='/grid/0/hadoop/yarn/local/usercache/hrt_qa/appcache/application_1524681858728_0001/container_1524681858728_0001_01_000004' --net='hadoop' -v '/grid/0/hadoop/yarn/local/filecache:/grid/0/hadoop/yarn/local/filecache:ro' -v '/grid/0/hadoop/yarn/local/usercache/hrt_qa/filecache:/grid/0/hadoop/yarn/local/usercache/hrt_qa/filecache:ro' -v '/grid/0/hadoop/yarn/local/usercache/hrt_qa/appcache/application_1524681858728_0001/filecache/195/httpd-proxy.conf:/etc/httpd/conf.d/httpd-proxy.conf:ro' -v '/grid/0/hadoop/yarn/log/application_1524681858728_0001/container_1524681858728_0001_01_000004:/grid/0/hadoop/yarn/log/application_1524681858728_0001/container_1524681858728_0001_01_000004' -v '/grid/0/hadoop/yarn/local/usercache/hrt_qa/appcache/application_1524681858728_0001:/grid/0/hadoop/yarn/local/usercache/hrt_qa/appcache/application_1524681858728_0001' --cgroup-parent='/hadoop-yarn-tmp-xxx/container_1524681858728_0001_01_000004' --cap-drop='ALL' --cap-add='SYS_CHROOT' --cap-add='MKNOD' --cap-add='SETFCAP' --cap-add='SETPCAP' --cap-add='DAC_READ_SEARCH' --cap-add='FSETID' --cap-add='SYS_PTRACE' --cap-add='CHOWN' --cap-add='SYS_ADMIN' --cap-add='AUDIT_WRITE' --cap-add='SETGID' --cap-add='NET_RAW' --cap-add='FOWNER' --cap-add='SETUID' --cap-add='DAC_OVERRIDE' --cap-add='KILL' --cap-add='NET_BIND_SERVICE' --hostname='httpd-proxy-0.fault-test-component-kill-httpd-docker.hrt-qa.test.com' --group-add '99' 'centos/httpd-24-centos7:latest' 'bash' '/grid/0/hadoop/yarn/local/usercache/hrt_qa/appcache/application_1524681858728_0001/container_1524681858728_0001_01_000004/launch_container.sh'
      
      Wrote the exit code 7 to /grid/0/hadoop/yarn/local/nmPrivate/application_1524681858728_0001/container_1524681858728_0001_01_000004/container_1524681858728_0001_01_000004.pid.exitcode
      
      
      
      
      
      [2018-04-27 01:09:15.564]Diagnostic message from attempt :
      
      [2018-04-27 01:09:15.565]Container exited with a non-zero exit code 7

      Attachments

        1. YARN-8228.001.patch
          3 kB
          Shane Kumpf

        Activity

          People

            shanekumpf@gmail.com Shane Kumpf
            yeshavora Yesha Vora
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: