Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3611 Support Docker Containers In LinuxContainerExecutor
  3. YARN-8228

Docker does not support hostnames greater than 64 characters

    XMLWordPrintableJSON

    Details

      Description

      If containers name is greater than 64 characters, docker containers stays in Created state only And app fails with below error

       

      /usr/bin/docker-current: Error response from daemon: oci runtime error: container_linux.go:247: starting container process caused "process_linux.go:364: container init caused \"invalid argument\"".
      
      Could not invoke docker /usr/bin/docker run --name='container_1524681858728_0001_01_000004' --user='99:99' -d --workdir='/grid/0/hadoop/yarn/local/usercache/hrt_qa/appcache/application_1524681858728_0001/container_1524681858728_0001_01_000004' --net='hadoop' -v '/grid/0/hadoop/yarn/local/filecache:/grid/0/hadoop/yarn/local/filecache:ro' -v '/grid/0/hadoop/yarn/local/usercache/hrt_qa/filecache:/grid/0/hadoop/yarn/local/usercache/hrt_qa/filecache:ro' -v '/grid/0/hadoop/yarn/local/usercache/hrt_qa/appcache/application_1524681858728_0001/filecache/195/httpd-proxy.conf:/etc/httpd/conf.d/httpd-proxy.conf:ro' -v '/grid/0/hadoop/yarn/log/application_1524681858728_0001/container_1524681858728_0001_01_000004:/grid/0/hadoop/yarn/log/application_1524681858728_0001/container_1524681858728_0001_01_000004' -v '/grid/0/hadoop/yarn/local/usercache/hrt_qa/appcache/application_1524681858728_0001:/grid/0/hadoop/yarn/local/usercache/hrt_qa/appcache/application_1524681858728_0001' --cgroup-parent='/hadoop-yarn-tmp-xxx/container_1524681858728_0001_01_000004' --cap-drop='ALL' --cap-add='SYS_CHROOT' --cap-add='MKNOD' --cap-add='SETFCAP' --cap-add='SETPCAP' --cap-add='DAC_READ_SEARCH' --cap-add='FSETID' --cap-add='SYS_PTRACE' --cap-add='CHOWN' --cap-add='SYS_ADMIN' --cap-add='AUDIT_WRITE' --cap-add='SETGID' --cap-add='NET_RAW' --cap-add='FOWNER' --cap-add='SETUID' --cap-add='DAC_OVERRIDE' --cap-add='KILL' --cap-add='NET_BIND_SERVICE' --hostname='httpd-proxy-0.fault-test-component-kill-httpd-docker.hrt-qa.test.com' --group-add '99' 'centos/httpd-24-centos7:latest' 'bash' '/grid/0/hadoop/yarn/local/usercache/hrt_qa/appcache/application_1524681858728_0001/container_1524681858728_0001_01_000004/launch_container.sh' .
      
      
      
      Shell output: main : command provided 4
      
      main : run as user is nobody
      
      main : requested yarn user is hrt_qa
      
      Creating script paths...
      
      Creating local dirs...
      
      Getting exit code file...
      
      Changing effective user to root...
      
      Launching docker container...
      
      Docker run command: /usr/bin/docker run --name='container_1524681858728_0001_01_000004' --user='99:99' -d --workdir='/grid/0/hadoop/yarn/local/usercache/hrt_qa/appcache/application_1524681858728_0001/container_1524681858728_0001_01_000004' --net='hadoop' -v '/grid/0/hadoop/yarn/local/filecache:/grid/0/hadoop/yarn/local/filecache:ro' -v '/grid/0/hadoop/yarn/local/usercache/hrt_qa/filecache:/grid/0/hadoop/yarn/local/usercache/hrt_qa/filecache:ro' -v '/grid/0/hadoop/yarn/local/usercache/hrt_qa/appcache/application_1524681858728_0001/filecache/195/httpd-proxy.conf:/etc/httpd/conf.d/httpd-proxy.conf:ro' -v '/grid/0/hadoop/yarn/log/application_1524681858728_0001/container_1524681858728_0001_01_000004:/grid/0/hadoop/yarn/log/application_1524681858728_0001/container_1524681858728_0001_01_000004' -v '/grid/0/hadoop/yarn/local/usercache/hrt_qa/appcache/application_1524681858728_0001:/grid/0/hadoop/yarn/local/usercache/hrt_qa/appcache/application_1524681858728_0001' --cgroup-parent='/hadoop-yarn-tmp-xxx/container_1524681858728_0001_01_000004' --cap-drop='ALL' --cap-add='SYS_CHROOT' --cap-add='MKNOD' --cap-add='SETFCAP' --cap-add='SETPCAP' --cap-add='DAC_READ_SEARCH' --cap-add='FSETID' --cap-add='SYS_PTRACE' --cap-add='CHOWN' --cap-add='SYS_ADMIN' --cap-add='AUDIT_WRITE' --cap-add='SETGID' --cap-add='NET_RAW' --cap-add='FOWNER' --cap-add='SETUID' --cap-add='DAC_OVERRIDE' --cap-add='KILL' --cap-add='NET_BIND_SERVICE' --hostname='httpd-proxy-0.fault-test-component-kill-httpd-docker.hrt-qa.test.com' --group-add '99' 'centos/httpd-24-centos7:latest' 'bash' '/grid/0/hadoop/yarn/local/usercache/hrt_qa/appcache/application_1524681858728_0001/container_1524681858728_0001_01_000004/launch_container.sh'
      
      Wrote the exit code 7 to /grid/0/hadoop/yarn/local/nmPrivate/application_1524681858728_0001/container_1524681858728_0001_01_000004/container_1524681858728_0001_01_000004.pid.exitcode
      
      
      
      
      
      [2018-04-27 01:09:15.564]Diagnostic message from attempt :
      
      [2018-04-27 01:09:15.565]Container exited with a non-zero exit code 7

        Attachments

        1. YARN-8228.001.patch
          3 kB
          Shane Kumpf

          Activity

            People

            • Assignee:
              shanekumpf@gmail.com Shane Kumpf
              Reporter:
              yeshavora Yesha Vora
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: