Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Duplicate
-
1.2.0
-
None
-
None
-
ubuntu 16.04 with/without SSL
Fedora 23
Description
Showed up on our internal CI
07:00:17 [ RUN ] ROOT_DOCKER_DockerAndMesosContainerizers/DefaultExecutorTest.KillTask/0 07:00:17 I0207 07:00:17.775459 2952 cluster.cpp:160] Creating default 'local' authorizer 07:00:17 I0207 07:00:17.776511 2970 master.cpp:383] Master fa1554c4-572a-4b89-8994-a89460f588d3 (ip-10-153-254-29.ec2.internal) started on 10.153.254.29:38570 07:00:17 I0207 07:00:17.776538 2970 master.cpp:385] Flags at startup: --acls="" --agent_ping_timeout="15secs" --agent_reregister_timeout="10mins" --allocation_interval="1secs" --allocator="HierarchicalDRF" --authenticate_agents="true" --authenticate_frameworks="true" --authenticate_http_frameworks="true" --authenticate_http_readonly="true" --authenticate_http_readwrite="true" --authenticators="crammd5" --authorizers="local" --credentials="/tmp/ZROfJk/credentials" --framework_sorter="drf" --help="false" --hostname_lookup="true" --http_authenticators="basic" --http_framework_authenticators="basic" --initialize_driver_logging="true" --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" --max_agent_ping_timeouts="5" --max_completed_frameworks="50" --max_completed_tasks_per_framework="1000" --max_unreachable_tasks_per_framework="1000" --quiet="false" --recovery_agent_removal_limit="100%" --registry="in_memory" --registry_fetch_timeout="1mins" --registry_gc_interval="15mins" --registry_max_agent_age="2weeks" --registry_max_agent_count="102400" --registry_store_timeout="100secs" --registry_strict="false" --root_submissions="true" --user_sorter="drf" --version="false" --webui_dir="/usr/local/share/mesos/webui" --work_dir="/tmp/ZROfJk/master" --zk_session_timeout="10secs" 07:00:17 I0207 07:00:17.776674 2970 master.cpp:435] Master only allowing authenticated frameworks to register 07:00:17 I0207 07:00:17.776687 2970 master.cpp:449] Master only allowing authenticated agents to register 07:00:17 I0207 07:00:17.776695 2970 master.cpp:462] Master only allowing authenticated HTTP frameworks to register 07:00:17 I0207 07:00:17.776703 2970 credentials.hpp:37] Loading credentials for authentication from '/tmp/ZROfJk/credentials' 07:00:17 I0207 07:00:17.776779 2970 master.cpp:507] Using default 'crammd5' authenticator 07:00:17 I0207 07:00:17.776841 2970 http.cpp:919] Using default 'basic' HTTP authenticator for realm 'mesos-master-readonly' 07:00:17 I0207 07:00:17.776919 2970 http.cpp:919] Using default 'basic' HTTP authenticator for realm 'mesos-master-readwrite' 07:00:17 I0207 07:00:17.776970 2970 http.cpp:919] Using default 'basic' HTTP authenticator for realm 'mesos-master-scheduler' 07:00:17 I0207 07:00:17.777009 2970 master.cpp:587] Authorization enabled 07:00:17 I0207 07:00:17.777122 2975 hierarchical.cpp:161] Initialized hierarchical allocator process 07:00:17 I0207 07:00:17.777138 2974 whitelist_watcher.cpp:77] No whitelist given 07:00:17 I0207 07:00:17.777704 2976 master.cpp:2123] Elected as the leading master! 07:00:17 I0207 07:00:17.777726 2976 master.cpp:1645] Recovering from registrar 07:00:17 I0207 07:00:17.777784 2975 registrar.cpp:329] Recovering registrar 07:00:17 I0207 07:00:17.777989 2973 registrar.cpp:362] Successfully fetched the registry (0B) in 176384ns 07:00:17 I0207 07:00:17.778023 2973 registrar.cpp:461] Applied 1 operations in 7573ns; attempting to update the registry 07:00:17 I0207 07:00:17.778249 2976 registrar.cpp:506] Successfully updated the registry in 210944ns 07:00:17 I0207 07:00:17.778290 2976 registrar.cpp:392] Successfully recovered registrar 07:00:17 I0207 07:00:17.778373 2976 master.cpp:1761] Recovered 0 agents from the registry (172B); allowing 10mins for agents to re-register 07:00:17 I0207 07:00:17.778394 2974 hierarchical.cpp:188] Skipping recovery of hierarchical allocator: nothing to recover 07:00:17 I0207 07:00:17.869381 2952 containerizer.cpp:220] Using isolation: posix/cpu,posix/mem,filesystem/posix,network/cni 07:00:17 I0207 07:00:17.872557 2952 linux_launcher.cpp:150] Using /sys/fs/cgroup/freezer as the freezer hierarchy for the Linux launcher 07:00:17 I0207 07:00:17.872915 2952 provisioner.cpp:249] Using default backend 'overlay' 07:00:17 I0207 07:00:17.873425 2952 cluster.cpp:446] Creating default 'local' authorizer 07:00:17 I0207 07:00:17.873791 2974 slave.cpp:211] Mesos agent started on (716)@10.153.254.29:38570 07:00:17 I0207 07:00:17.874034 2952 scheduler.cpp:184] Version: 1.2.0 07:00:17 I0207 07:00:17.873829 2974 slave.cpp:212] Flags at startup: --acls="" --appc_simple_discovery_uri_prefix="http://" --appc_store_dir="/tmp/mesos/store/appc" --authenticate_http_readonly="true" --authenticate_http_readwrite="false" --authenticatee="crammd5" --authentication_backoff_factor="1secs" --authorizer="local" --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false" --cgroups_root="mesos" --container_disk_watch_interval="15secs" --containerizers="docker,mesos" --credential="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/credential" --default_role="*" --disk_watch_interval="1mins" --docker="docker" --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io" --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns" --docker_store_dir="/tmp/mesos/store/docker" --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume" --enforce_container_disk_quota="false" --executor_registration_timeout="1mins" --executor_shutdown_grace_period="5secs" --fetcher_cache_dir="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/fetch" --fetcher_cache_size="2GB" --frameworks_home="" --gc_delay="1weeks" --gc_disk_headroom="0.1" --hadoop_home="" --help="false" --hostname_lookup="true" --http_authenticators="basic" --http_command_executor="false" --http_credentials="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/http_credentials" --http_heartbeat_interval="30secs" --initialize_driver_logging="true" --isolation="posix/cpu,posix/mem" --launcher="linux" --launcher_dir="/home/ubuntu/workspace/mesos/Mesos_CI-build/FLAG/Clang/label/mesos-ec2-ubuntu-16.04/mesos/build/src" --logbufsecs="0" --logging_level="INFO" --max_completed_executors_per_framework="150" --oversubscribed_resources_interval="15secs" --perf_duration="10secs" --perf_interval="1mins" --qos_correction_interval_min="0ns" --quiet="false" --recover="reconnect" --recovery_timeout="15mins" --registration_backoff_factor="10ms" --resources="cpus:2;gpus:0;mem:1024;disk:1024;ports:[31000-32000]" --revocable_cpu_low_priority="true" --runtime_dir="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO" --sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true" --systemd_enable_support="true" --systemd_runtime_directory="/run/systemd/system" --version="false" --work_dir="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4" 07:00:17 I0207 07:00:17.874168 2974 credentials.hpp:86] Loading credential for authentication from '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/credential' 07:00:17 I0207 07:00:17.874236 2974 slave.cpp:354] Agent using credential for: test-principal 07:00:17 I0207 07:00:17.874258 2974 credentials.hpp:37] Loading credentials for authentication from '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/http_credentials' 07:00:17 I0207 07:00:17.874331 2974 http.cpp:919] Using default 'basic' HTTP authenticator for realm 'mesos-agent-readonly' 07:00:17 I0207 07:00:17.874583 2976 scheduler.cpp:470] New master detected at master@10.153.254.29:38570 07:00:17 I0207 07:00:17.874610 2976 scheduler.cpp:479] Waiting for 0ns before initiating a re-(connection) attempt with the master 07:00:17 I0207 07:00:17.874836 2974 slave.cpp:541] Agent resources: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] 07:00:17 I0207 07:00:17.874873 2974 slave.cpp:549] Agent attributes: [ ] 07:00:17 I0207 07:00:17.874881 2974 slave.cpp:554] Agent hostname: ip-10-153-254-29.ec2.internal 07:00:17 I0207 07:00:17.874991 2970 status_update_manager.cpp:177] Pausing sending status updates 07:00:17 I0207 07:00:17.875248 2972 state.cpp:62] Recovering state from '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/meta' 07:00:17 I0207 07:00:17.875445 2971 status_update_manager.cpp:203] Recovering status update manager 07:00:17 I0207 07:00:17.875591 2972 containerizer.cpp:599] Recovering containerizer 07:00:17 I0207 07:00:17.875604 2977 docker.cpp:868] Recovering Docker containers 07:00:17 I0207 07:00:17.875658 2977 docker.cpp:1139] Running docker -H unix:///var/run/docker.sock ps -a 07:00:17 I0207 07:00:17.879174 2973 scheduler.cpp:361] Connected with the master at http://10.153.254.29:38570/master/api/v1/scheduler 07:00:17 I0207 07:00:17.879809 2976 provisioner.cpp:410] Provisioner recovery complete 07:00:17 I0207 07:00:17.879889 2971 scheduler.cpp:243] Sending SUBSCRIBE call to http://10.153.254.29:38570/master/api/v1/scheduler 07:00:17 I0207 07:00:17.880321 2976 process.cpp:3704] Handling HTTP event for process 'master' with path: '/master/api/v1/scheduler' 07:00:17 I0207 07:00:17.880755 2972 http.cpp:420] HTTP POST for /master/api/v1/scheduler from 10.153.254.29:44396 07:00:17 I0207 07:00:17.880834 2972 master.cpp:2422] Received subscription request for HTTP framework 'default' 07:00:17 I0207 07:00:17.880857 2972 master.cpp:2159] Authorizing framework principal 'test-principal' to receive offers for role '*' 07:00:17 I0207 07:00:17.881100 2977 master.cpp:2536] Subscribing framework 'default' with checkpointing disabled and capabilities [ ] 07:00:17 I0207 07:00:17.881320 2976 master.hpp:2114] Sending heartbeat to fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:17 I0207 07:00:17.881291 2973 hierarchical.cpp:286] Added framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:17 I0207 07:00:17.881448 2973 hierarchical.cpp:1817] No allocations performed 07:00:17 I0207 07:00:17.881471 2973 hierarchical.cpp:1907] No inverse offers to send out! 07:00:17 I0207 07:00:17.881480 2973 hierarchical.cpp:1401] Performed allocation for 0 agents in 47645ns 07:00:17 I0207 07:00:17.881830 2972 scheduler.cpp:676] Enqueuing event SUBSCRIBED received from http://10.153.254.29:38570/master/api/v1/scheduler 07:00:17 I0207 07:00:17.882037 2972 scheduler.cpp:676] Enqueuing event HEARTBEAT received from http://10.153.254.29:38570/master/api/v1/scheduler 07:00:18 I0207 07:00:17.970202 2975 slave.cpp:5499] Finished recovery 07:00:18 I0207 07:00:17.970434 2975 slave.cpp:5673] Querying resource estimator for oversubscribable resources 07:00:18 I0207 07:00:17.970556 2975 slave.cpp:931] New master detected at master@10.153.254.29:38570 07:00:18 I0207 07:00:17.970564 2973 status_update_manager.cpp:177] Pausing sending status updates 07:00:18 I0207 07:00:17.970598 2975 slave.cpp:966] Detecting new master 07:00:18 I0207 07:00:17.970636 2975 slave.cpp:5687] Received oversubscribable resources {} from the resource estimator 07:00:18 I0207 07:00:17.976898 2970 slave.cpp:993] Authenticating with master master@10.153.254.29:38570 07:00:18 I0207 07:00:17.976929 2970 slave.cpp:1004] Using default CRAM-MD5 authenticatee 07:00:18 I0207 07:00:17.977015 2974 authenticatee.cpp:121] Creating new client SASL connection 07:00:18 I0207 07:00:17.977448 2974 master.cpp:7103] Authenticating slave(716)@10.153.254.29:38570 07:00:18 I0207 07:00:17.977509 2975 authenticator.cpp:414] Starting authentication session for crammd5-authenticatee(1366)@10.153.254.29:38570 07:00:18 I0207 07:00:17.977602 2976 authenticator.cpp:98] Creating new server SASL connection 07:00:18 I0207 07:00:17.977922 2976 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5 07:00:18 I0207 07:00:17.977954 2976 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5' 07:00:18 I0207 07:00:17.977998 2976 authenticator.cpp:204] Received SASL authentication start 07:00:18 I0207 07:00:17.978061 2976 authenticator.cpp:326] Authentication requires more steps 07:00:18 I0207 07:00:17.978106 2976 authenticatee.cpp:259] Received SASL authentication step 07:00:18 I0207 07:00:17.978184 2974 authenticator.cpp:232] Received SASL authentication step 07:00:18 I0207 07:00:17.978210 2974 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'ip-10-153-254-29.ec2.internal' server FQDN: 'ip-10-153-254-29.ec2.internal' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false 07:00:18 I0207 07:00:17.978219 2974 auxprop.cpp:181] Looking up auxiliary property '*userPassword' 07:00:18 I0207 07:00:17.978227 2974 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' 07:00:18 I0207 07:00:17.978235 2974 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'ip-10-153-254-29.ec2.internal' server FQDN: 'ip-10-153-254-29.ec2.internal' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true 07:00:18 I0207 07:00:17.978238 2974 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true 07:00:18 I0207 07:00:17.978243 2974 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true 07:00:18 I0207 07:00:17.978252 2974 authenticator.cpp:318] Authentication success 07:00:18 I0207 07:00:17.978297 2973 authenticatee.cpp:299] Authentication success 07:00:18 I0207 07:00:17.978324 2974 master.cpp:7133] Successfully authenticated principal 'test-principal' at slave(716)@10.153.254.29:38570 07:00:18 I0207 07:00:17.978356 2972 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(1366)@10.153.254.29:38570 07:00:18 I0207 07:00:17.978426 2975 slave.cpp:1088] Successfully authenticated with master master@10.153.254.29:38570 07:00:18 I0207 07:00:17.978520 2975 slave.cpp:1515] Will retry registration in 19.358366ms if necessary 07:00:18 I0207 07:00:17.978575 2973 master.cpp:5318] Registering agent at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) with id fa1554c4-572a-4b89-8994-a89460f588d3-S0 07:00:18 I0207 07:00:17.978699 2976 registrar.cpp:461] Applied 1 operations in 24121ns; attempting to update the registry 07:00:18 I0207 07:00:17.979012 2974 registrar.cpp:506] Successfully updated the registry in 280832ns 07:00:18 I0207 07:00:17.979252 2973 slave.cpp:4301] Received ping from slave-observer(652)@10.153.254.29:38570 07:00:18 I0207 07:00:17.979238 2976 master.cpp:5392] Registered agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) with cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] 07:00:18 I0207 07:00:17.979311 2973 slave.cpp:1134] Registered with master master@10.153.254.29:38570; given agent ID fa1554c4-572a-4b89-8994-a89460f588d3-S0 07:00:18 I0207 07:00:17.979312 2974 hierarchical.cpp:515] Added agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 (ip-10-153-254-29.ec2.internal) with cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] (allocated: {}) 07:00:18 I0207 07:00:17.979336 2973 fetcher.cpp:90] Clearing fetcher cache 07:00:18 I0207 07:00:17.979425 2977 status_update_manager.cpp:184] Resuming sending status updates 07:00:18 I0207 07:00:17.979490 2973 slave.cpp:1162] Checkpointing SlaveInfo to '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/meta/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/slave.info' 07:00:18 I0207 07:00:17.979542 2974 hierarchical.cpp:1907] No inverse offers to send out! 07:00:18 I0207 07:00:17.979562 2974 hierarchical.cpp:1401] Performed allocation for 1 agents in 198598ns 07:00:18 I0207 07:00:17.979625 2973 slave.cpp:1200] Forwarding total oversubscribed resources {} 07:00:18 I0207 07:00:17.979665 2970 master.cpp:6932] Sending 1 offers to framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) 07:00:18 I0207 07:00:17.979815 2970 master.cpp:5949] Received update of agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) with total oversubscribed resources {} 07:00:18 I0207 07:00:17.979897 2970 hierarchical.cpp:588] Agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 (ip-10-153-254-29.ec2.internal) updated with oversubscribed resources {} (total: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000], allocated: cpus(*)(allocated: *):2; mem(*)(allocated: *):1024; disk(*)(allocated: *):1024; ports(*)(allocated: *):[31000-32000]) 07:00:18 I0207 07:00:17.979951 2970 hierarchical.cpp:1817] No allocations performed 07:00:18 I0207 07:00:17.980002 2970 hierarchical.cpp:1907] No inverse offers to send out! 07:00:18 I0207 07:00:17.980016 2970 hierarchical.cpp:1401] Performed allocation for 1 agents in 83177ns 07:00:18 I0207 07:00:17.980195 2974 scheduler.cpp:676] Enqueuing event OFFERS received from http://10.153.254.29:38570/master/api/v1/scheduler 07:00:18 I0207 07:00:17.980867 2970 scheduler.cpp:243] Sending ACCEPT call to http://10.153.254.29:38570/master/api/v1/scheduler 07:00:18 I0207 07:00:17.981184 2973 process.cpp:3704] Handling HTTP event for process 'master' with path: '/master/api/v1/scheduler' 07:00:18 I0207 07:00:17.981575 2976 http.cpp:420] HTTP POST for /master/api/v1/scheduler from 10.153.254.29:44398 07:00:18 I0207 07:00:17.981762 2976 master.cpp:3745] Processing ACCEPT call for offers: [ fa1554c4-572a-4b89-8994-a89460f588d3-O0 ] on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) for framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) 07:00:18 I0207 07:00:17.981812 2976 master.cpp:3318] Authorizing framework principal 'test-principal' to launch task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb 07:00:18 I0207 07:00:17.981945 2976 master.cpp:3318] Authorizing framework principal 'test-principal' to launch task c24a618d-ce08-4784-b8c7-0eeda79d121b 07:00:18 I0207 07:00:17.982826 2976 master.cpp:8993] Adding task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb with resources cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) 07:00:18 I0207 07:00:17.982899 2976 master.cpp:8993] Adding task c24a618d-ce08-4784-b8c7-0eeda79d121b with resources cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) 07:00:18 I0207 07:00:17.982950 2976 master.cpp:4600] Launching task group { 16b247b5-e1dd-4395-a2d7-71c9c393e5bb, c24a618d-ce08-4784-b8c7-0eeda79d121b } of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) with resources cpus(*)(allocated: *):0.2; mem(*)(allocated: *):64; disk(*)(allocated: *):64 on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) 07:00:18 I0207 07:00:17.983122 2977 slave.cpp:1583] Got assigned task group containing tasks [ 16b247b5-e1dd-4395-a2d7-71c9c393e5bb, c24a618d-ce08-4784-b8c7-0eeda79d121b ] for framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:17.983191 2973 hierarchical.cpp:1079] Recovered cpus(*)(allocated: *):1.7; mem(*)(allocated: *):928; disk(*)(allocated: *):928; ports(*)(allocated: *):[31000-32000] (total: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000], allocated: cpus(*)(allocated: *):0.3; mem(*)(allocated: *):96; disk(*)(allocated: *):96) on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 from framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:17.983423 2977 slave.cpp:1743] Launching task group containing tasks [ 16b247b5-e1dd-4395-a2d7-71c9c393e5bb, c24a618d-ce08-4784-b8c7-0eeda79d121b ] for framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:17.983650 2977 paths.cpp:547] Trying to chown '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974' to user 'root' 07:00:18 I0207 07:00:17.983779 2977 slave.cpp:6414] Launching executor 'default' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 with resources cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 in work directory '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974' 07:00:18 I0207 07:00:17.983988 2977 slave.cpp:2073] Queued task group containing tasks [ 16b247b5-e1dd-4395-a2d7-71c9c393e5bb, c24a618d-ce08-4784-b8c7-0eeda79d121b ] for executor 'default' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:17.984022 2974 docker.cpp:1099] No container info found, skipping launch 07:00:18 I0207 07:00:17.984032 2977 slave.cpp:884] Successfully attached file '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974' 07:00:18 I0207 07:00:17.984192 2975 containerizer.cpp:992] Starting container 4cfc866d-9fef-442b-8682-58dabb305974 for executor 'default' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:17.985002 2976 containerizer.cpp:1538] Launching 'mesos-containerizer' with flags '--help="false" --launch_info="{"command":{"arguments":["mesos-default-executor","--launcher_dir=\/home\/ubuntu\/workspace\/mesos\/Mesos_CI-build\/FLAG\/Clang\/label\/mesos-ec2-ubuntu-16.04\/mesos\/build\/src"],"shell":false,"value":"\/home\/ubuntu\/workspace\/mesos\/Mesos_CI-build\/FLAG\/Clang\/label\/mesos-ec2-ubuntu-16.04\/mesos\/build\/src\/mesos-default-executor"},"environment":{"variables":[{"name":"LIBPROCESS_PORT","value":"0"},{"name":"MESOS_AGENT_ENDPOINT","value":"10.153.254.29:38570"},{"name":"MESOS_CHECKPOINT","value":"0"},{"name":"MESOS_DIRECTORY","value":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974"},{"name":"MESOS_EXECUTOR_ID","value":"default"},{"name":"MESOS_EXECUTOR_SHUTDOWN_GRACE_PERIOD","value":"5secs"},{"name":"MESOS_FRAMEWORK_ID","value":"fa1554c4-572a-4b89-8994-a89460f588d3-0000"},{"name":"MESOS_HTTP_COMMAND_EXECUTOR","value":"0"},{"name":"MESOS_SLAVE_ID","value":"fa1554c4-572a-4b89-8994-a89460f588d3-S0"},{"name":"MESOS_SLAVE_PID","value":"slave(716)@10.153.254.29:38570"},{"name":"MESOS_SANDBOX","value":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974"}]},"user":"root","working_directory":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974"}" --pipe_read="30" --pipe_write="31" --runtime_directory="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/containers/4cfc866d-9fef-442b-8682-58dabb305974" --unshare_namespace_mnt="false"' 07:00:18 I0207 07:00:17.985275 2970 linux_launcher.cpp:429] Launching container 4cfc866d-9fef-442b-8682-58dabb305974 and cloning with namespaces 07:00:18 I0207 07:00:18.011076 2973 fetcher.cpp:349] Starting to fetch URIs for container: 4cfc866d-9fef-442b-8682-58dabb305974, directory: /tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974 07:00:18 I0207 07:00:18.076251 29005 executor.cpp:192] Version: 1.2.0 07:00:18 I0207 07:00:18.078815 2974 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1/executor' 07:00:18 I0207 07:00:18.079205 2975 http.cpp:303] HTTP POST for /slave(716)/api/v1/executor from 10.153.254.29:44400 07:00:18 I0207 07:00:18.079286 2975 slave.cpp:3124] Received Subscribe request for HTTP executor 'default' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:18.080021 2970 slave.cpp:2315] Sending queued task group task group containing tasks [ 16b247b5-e1dd-4395-a2d7-71c9c393e5bb, c24a618d-ce08-4784-b8c7-0eeda79d121b ] to executor 'default' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (via HTTP) 07:00:18 I0207 07:00:18.080541 29024 default_executor.cpp:153] Received SUBSCRIBED event 07:00:18 I0207 07:00:18.082542 29024 default_executor.cpp:157] Subscribed executor on ip-10-153-254-29.ec2.internal 07:00:18 I0207 07:00:18.082628 29024 default_executor.cpp:153] Received LAUNCH_GROUP event 07:00:18 I0207 07:00:18.083161 2975 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1' 07:00:18 I0207 07:00:18.083336 2975 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1' 07:00:18 I0207 07:00:18.083618 2976 http.cpp:303] HTTP POST for /slave(716)/api/v1 from 10.153.254.29:44404 07:00:18 I0207 07:00:18.083688 2976 http.cpp:303] HTTP POST for /slave(716)/api/v1 from 10.153.254.29:44404 07:00:18 I0207 07:00:18.083775 2976 http.cpp:517] Processing call LAUNCH_NESTED_CONTAINER 07:00:18 I0207 07:00:18.083876 2976 http.cpp:517] Processing call LAUNCH_NESTED_CONTAINER 07:00:18 I0207 07:00:18.084066 2972 containerizer.cpp:1805] Starting nested container 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338 07:00:18 I0207 07:00:18.084185 2972 containerizer.cpp:1829] Trying to chown '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974/containers/966d71b2-cbc7-40a6-accf-bef80d3d8338' to user 'root' 07:00:18 I0207 07:00:18.084568 2972 containerizer.cpp:1805] Starting nested container 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e 07:00:18 I0207 07:00:18.084655 2972 containerizer.cpp:1829] Trying to chown '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974/containers/486b0abc-966d-49b7-b2e0-58cd1d4b462e' to user 'root' 07:00:18 I0207 07:00:18.085088 2972 containerizer.cpp:1538] Launching 'mesos-containerizer' with flags '--help="false" --launch_info="{"command":{"shell":true,"value":"sleep 1000"},"environment":{"variables":[{"name":"MESOS_SANDBOX","value":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974\/containers\/966d71b2-cbc7-40a6-accf-bef80d3d8338"}]},"user":"root","working_directory":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974\/containers\/966d71b2-cbc7-40a6-accf-bef80d3d8338"}" --pipe_read="57" --pipe_write="76" --runtime_directory="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/containers/4cfc866d-9fef-442b-8682-58dabb305974/containers/966d71b2-cbc7-40a6-accf-bef80d3d8338" --unshare_namespace_mnt="false"' 07:00:18 I0207 07:00:18.085297 2976 linux_launcher.cpp:429] Launching nested container 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338 and cloning with namespaces 07:00:18 I0207 07:00:18.114851 2972 containerizer.cpp:1538] Launching 'mesos-containerizer' with flags '--help="false" --launch_info="{"command":{"shell":true,"value":"sleep 1000"},"environment":{"variables":[{"name":"MESOS_SANDBOX","value":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974\/containers\/486b0abc-966d-49b7-b2e0-58cd1d4b462e"}]},"user":"root","working_directory":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974\/containers\/486b0abc-966d-49b7-b2e0-58cd1d4b462e"}" --pipe_read="77" --pipe_write="78" --runtime_directory="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/containers/4cfc866d-9fef-442b-8682-58dabb305974/containers/486b0abc-966d-49b7-b2e0-58cd1d4b462e" --unshare_namespace_mnt="false"' 07:00:18 I0207 07:00:18.115092 2974 linux_launcher.cpp:429] Launching nested container 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e and cloning with namespaces 07:00:18 I0207 07:00:18.124974 2970 fetcher.cpp:349] Starting to fetch URIs for container: 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338, directory: /tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974/containers/966d71b2-cbc7-40a6-accf-bef80d3d8338 07:00:18 I0207 07:00:18.126298 2970 fetcher.cpp:349] Starting to fetch URIs for container: 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e, directory: /tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974/containers/486b0abc-966d-49b7-b2e0-58cd1d4b462e 07:00:18 I0207 07:00:18.129250 29022 default_executor.cpp:469] Successfully launched tasks [ 16b247b5-e1dd-4395-a2d7-71c9c393e5bb, c24a618d-ce08-4784-b8c7-0eeda79d121b ] in child containers [ 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338, 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e ] 07:00:18 I0207 07:00:18.130044 29019 default_executor.cpp:542] Waiting for child container 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338 of task '16b247b5-e1dd-4395-a2d7-71c9c393e5bb' 07:00:18 I0207 07:00:18.130199 29019 default_executor.cpp:542] Waiting for child container 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e of task 'c24a618d-ce08-4784-b8c7-0eeda79d121b' 07:00:18 I0207 07:00:18.130437 2975 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1/executor' 07:00:18 I0207 07:00:18.130678 2975 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1/executor' 07:00:18 I0207 07:00:18.130791 2975 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1' 07:00:18 I0207 07:00:18.130939 2975 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1' 07:00:18 I0207 07:00:18.131260 2973 http.cpp:303] HTTP POST for /slave(716)/api/v1 from 10.153.254.29:44408 07:00:18 I0207 07:00:18.131341 2973 http.cpp:303] HTTP POST for /slave(716)/api/v1/executor from 10.153.254.29:44402 07:00:18 I0207 07:00:18.131402 2973 slave.cpp:3771] Handling status update TASK_RUNNING (UUID: d54c9399-1a59-426c-80f2-c5fa491b9215) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:18.131579 2973 http.cpp:303] HTTP POST for /slave(716)/api/v1 from 10.153.254.29:44406 07:00:18 I0207 07:00:18.131680 2973 http.cpp:303] HTTP POST for /slave(716)/api/v1/executor from 10.153.254.29:44402 07:00:18 I0207 07:00:18.131752 2973 slave.cpp:3771] Handling status update TASK_RUNNING (UUID: 10681538-b4e6-4eb8-b8ae-0e7af9b4e009) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:18.132120 2973 http.cpp:517] Processing call WAIT_NESTED_CONTAINER 07:00:18 I0207 07:00:18.132252 2973 http.cpp:517] Processing call WAIT_NESTED_CONTAINER 07:00:18 I0207 07:00:18.132444 2976 status_update_manager.cpp:323] Received status update TASK_RUNNING (UUID: d54c9399-1a59-426c-80f2-c5fa491b9215) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:18.132472 2976 status_update_manager.cpp:500] Creating StatusUpdate stream for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:18.132637 2976 status_update_manager.cpp:377] Forwarding update TASK_RUNNING (UUID: d54c9399-1a59-426c-80f2-c5fa491b9215) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 to the agent 07:00:18 I0207 07:00:18.132741 2973 slave.cpp:4211] Forwarding the update TASK_RUNNING (UUID: d54c9399-1a59-426c-80f2-c5fa491b9215) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 to master@10.153.254.29:38570 07:00:18 I0207 07:00:18.132776 2976 status_update_manager.cpp:323] Received status update TASK_RUNNING (UUID: 10681538-b4e6-4eb8-b8ae-0e7af9b4e009) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:18.132791 2976 status_update_manager.cpp:500] Creating StatusUpdate stream for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:18.132839 2973 slave.cpp:4105] Status update manager successfully handled status update TASK_RUNNING (UUID: d54c9399-1a59-426c-80f2-c5fa491b9215) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:18.132913 2976 status_update_manager.cpp:377] Forwarding update TASK_RUNNING (UUID: 10681538-b4e6-4eb8-b8ae-0e7af9b4e009) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 to the agent 07:00:18 I0207 07:00:18.132949 2972 master.cpp:6094] Status update TASK_RUNNING (UUID: d54c9399-1a59-426c-80f2-c5fa491b9215) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 from agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) 07:00:18 I0207 07:00:18.133024 2974 slave.cpp:4211] Forwarding the update TASK_RUNNING (UUID: 10681538-b4e6-4eb8-b8ae-0e7af9b4e009) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 to master@10.153.254.29:38570 07:00:18 I0207 07:00:18.133051 2972 master.cpp:6162] Forwarding status update TASK_RUNNING (UUID: d54c9399-1a59-426c-80f2-c5fa491b9215) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:18.133170 2974 slave.cpp:4105] Status update manager successfully handled status update TASK_RUNNING (UUID: 10681538-b4e6-4eb8-b8ae-0e7af9b4e009) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:18.133327 29025 default_executor.cpp:153] Received ACKNOWLEDGED event 07:00:18 I0207 07:00:18.133405 2972 master.cpp:8242] Updating the state of task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_RUNNING, status update state: TASK_RUNNING) 07:00:18 I0207 07:00:18.133518 2972 master.cpp:6094] Status update TASK_RUNNING (UUID: 10681538-b4e6-4eb8-b8ae-0e7af9b4e009) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 from agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) 07:00:18 I0207 07:00:18.133553 2972 master.cpp:6162] Forwarding status update TASK_RUNNING (UUID: 10681538-b4e6-4eb8-b8ae-0e7af9b4e009) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:18.133646 2972 master.cpp:8242] Updating the state of task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_RUNNING, status update state: TASK_RUNNING) 07:00:18 I0207 07:00:18.133905 29019 default_executor.cpp:153] Received ACKNOWLEDGED event 07:00:18 I0207 07:00:18.134141 2973 scheduler.cpp:676] Enqueuing event UPDATE received from http://10.153.254.29:38570/master/api/v1/scheduler 07:00:18 I0207 07:00:18.134351 2973 scheduler.cpp:676] Enqueuing event UPDATE received from http://10.153.254.29:38570/master/api/v1/scheduler 07:00:18 I0207 07:00:18.778179 2976 hierarchical.cpp:1907] No inverse offers to send out! 07:00:18 I0207 07:00:18.778226 2976 hierarchical.cpp:1401] Performed allocation for 1 agents in 258865ns 07:00:18 I0207 07:00:18.778333 2972 master.cpp:6932] Sending 1 offers to framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) 07:00:18 I0207 07:00:18.778885 2972 scheduler.cpp:676] Enqueuing event OFFERS received from http://10.153.254.29:38570/master/api/v1/scheduler 07:00:18 I0207 07:00:18.779575 2976 scheduler.cpp:243] Sending ACCEPT call to http://10.153.254.29:38570/master/api/v1/scheduler 07:00:18 I0207 07:00:18.779938 2976 process.cpp:3704] Handling HTTP event for process 'master' with path: '/master/api/v1/scheduler' 07:00:18 I0207 07:00:18.817811 2974 http.cpp:420] HTTP POST for /master/api/v1/scheduler from 10.153.254.29:44398 07:00:18 I0207 07:00:18.817988 2974 master.cpp:3745] Processing ACCEPT call for offers: [ fa1554c4-572a-4b89-8994-a89460f588d3-O1 ] on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) for framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) 07:00:18 I0207 07:00:18.818032 2974 master.cpp:3318] Authorizing framework principal 'test-principal' to launch task 8cd47a02-ff21-4585-ab72-0ce803a4be78 07:00:18 I0207 07:00:18.818761 2970 master.cpp:8993] Adding task 8cd47a02-ff21-4585-ab72-0ce803a4be78 with resources cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) 07:00:18 I0207 07:00:18.818826 2970 master.cpp:4600] Launching task group { 8cd47a02-ff21-4585-ab72-0ce803a4be78 } of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) with resources cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) 07:00:18 I0207 07:00:18.818967 2976 slave.cpp:1583] Got assigned task group containing tasks [ 8cd47a02-ff21-4585-ab72-0ce803a4be78 ] for framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:18.819067 2971 hierarchical.cpp:1079] Recovered cpus(*)(allocated: *):1.6; mem(*)(allocated: *):896; disk(*)(allocated: *):896; ports(*)(allocated: *):[31000-32000] (total: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000], allocated: cpus(*)(allocated: *):0.4; mem(*)(allocated: *):128; disk(*)(allocated: *):128) on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 from framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:18.819103 2971 hierarchical.cpp:1116] Framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 filtered agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 for 5secs 07:00:18 I0207 07:00:18.819105 2976 slave.cpp:1743] Launching task group containing tasks [ 8cd47a02-ff21-4585-ab72-0ce803a4be78 ] for framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:18.819150 2976 slave.cpp:2095] Queued task group containing tasks [ 8cd47a02-ff21-4585-ab72-0ce803a4be78 ] for executor 'default' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (via HTTP) 07:00:18 I0207 07:00:18.819540 2974 slave.cpp:2315] Sending queued task group task group containing tasks [ 8cd47a02-ff21-4585-ab72-0ce803a4be78 ] to executor 'default' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (via HTTP) 07:00:18 I0207 07:00:18.820272 29019 default_executor.cpp:153] Received LAUNCH_GROUP event 07:00:18 I0207 07:00:18.821336 2970 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1' 07:00:18 I0207 07:00:18.821585 2972 http.cpp:303] HTTP POST for /slave(716)/api/v1 from 10.153.254.29:44410 07:00:18 I0207 07:00:18.821693 2972 http.cpp:517] Processing call LAUNCH_NESTED_CONTAINER 07:00:18 I0207 07:00:18.821916 2976 containerizer.cpp:1805] Starting nested container 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8 07:00:18 I0207 07:00:18.822005 2976 containerizer.cpp:1829] Trying to chown '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974/containers/5e04c992-3a62-4187-86b2-2ad4abb2f5e8' to user 'root' 07:00:18 I0207 07:00:18.822497 2975 containerizer.cpp:1538] Launching 'mesos-containerizer' with flags '--help="false" --launch_info="{"command":{"shell":true,"value":"sleep 1000"},"environment":{"variables":[{"name":"MESOS_SANDBOX","value":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974\/containers\/5e04c992-3a62-4187-86b2-2ad4abb2f5e8"}]},"user":"root","working_directory":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974\/containers\/5e04c992-3a62-4187-86b2-2ad4abb2f5e8"}" --pipe_read="77" --pipe_write="78" --runtime_directory="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/containers/4cfc866d-9fef-442b-8682-58dabb305974/containers/5e04c992-3a62-4187-86b2-2ad4abb2f5e8" --unshare_namespace_mnt="false"' 07:00:18 I0207 07:00:18.822722 2977 linux_launcher.cpp:429] Launching nested container 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8 and cloning with namespaces 07:00:18 I0207 07:00:18.851102 2976 fetcher.cpp:349] Starting to fetch URIs for container: 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8, directory: /tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974/containers/5e04c992-3a62-4187-86b2-2ad4abb2f5e8 07:00:18 I0207 07:00:18.853680 29021 default_executor.cpp:469] Successfully launched tasks [ 8cd47a02-ff21-4585-ab72-0ce803a4be78 ] in child containers [ 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8 ] 07:00:18 I0207 07:00:18.854037 29026 default_executor.cpp:542] Waiting for child container 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8 of task '8cd47a02-ff21-4585-ab72-0ce803a4be78' 07:00:18 I0207 07:00:18.854059 2973 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1/executor' 07:00:18 I0207 07:00:18.854372 2976 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1' 07:00:18 I0207 07:00:18.854599 2974 http.cpp:303] HTTP POST for /slave(716)/api/v1 from 10.153.254.29:44412 07:00:18 I0207 07:00:18.854703 2974 http.cpp:517] Processing call WAIT_NESTED_CONTAINER 07:00:18 I0207 07:00:18.893777 2973 http.cpp:303] HTTP POST for /slave(716)/api/v1/executor from 10.153.254.29:44402 07:00:18 I0207 07:00:18.893868 2973 slave.cpp:3771] Handling status update TASK_RUNNING (UUID: 128da3e5-7a2c-4351-a36c-5dd43d7977ea) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:18.894559 2970 status_update_manager.cpp:323] Received status update TASK_RUNNING (UUID: 128da3e5-7a2c-4351-a36c-5dd43d7977ea) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:18.894589 2970 status_update_manager.cpp:500] Creating StatusUpdate stream for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:18.894749 2970 status_update_manager.cpp:377] Forwarding update TASK_RUNNING (UUID: 128da3e5-7a2c-4351-a36c-5dd43d7977ea) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 to the agent 07:00:18 I0207 07:00:18.894865 2977 slave.cpp:4211] Forwarding the update TASK_RUNNING (UUID: 128da3e5-7a2c-4351-a36c-5dd43d7977ea) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 to master@10.153.254.29:38570 07:00:18 I0207 07:00:18.894951 2977 slave.cpp:4105] Status update manager successfully handled status update TASK_RUNNING (UUID: 128da3e5-7a2c-4351-a36c-5dd43d7977ea) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:18.895066 2975 master.cpp:6094] Status update TASK_RUNNING (UUID: 128da3e5-7a2c-4351-a36c-5dd43d7977ea) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 from agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) 07:00:18 I0207 07:00:18.895097 2975 master.cpp:6162] Forwarding status update TASK_RUNNING (UUID: 128da3e5-7a2c-4351-a36c-5dd43d7977ea) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:18.895196 2975 master.cpp:8242] Updating the state of task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_RUNNING, status update state: TASK_RUNNING) 07:00:18 I0207 07:00:18.895474 29025 default_executor.cpp:153] Received ACKNOWLEDGED event 07:00:18 I0207 07:00:18.895576 2971 scheduler.cpp:676] Enqueuing event UPDATE received from http://10.153.254.29:38570/master/api/v1/scheduler 07:00:18 I0207 07:00:18.896118 2972 scheduler.cpp:243] Sending ACKNOWLEDGE call to http://10.153.254.29:38570/master/api/v1/scheduler 07:00:18 I0207 07:00:18.896244 2972 scheduler.cpp:243] Sending ACKNOWLEDGE call to http://10.153.254.29:38570/master/api/v1/scheduler 07:00:18 I0207 07:00:18.896327 2972 scheduler.cpp:243] Sending ACKNOWLEDGE call to http://10.153.254.29:38570/master/api/v1/scheduler 07:00:18 I0207 07:00:18.896453 2972 scheduler.cpp:243] Sending KILL call to http://10.153.254.29:38570/master/api/v1/scheduler 07:00:18 I0207 07:00:18.896493 2975 process.cpp:3704] Handling HTTP event for process 'master' with path: '/master/api/v1/scheduler' 07:00:18 I0207 07:00:18.933679 2976 process.cpp:3704] Handling HTTP event for process 'master' with path: '/master/api/v1/scheduler' 07:00:18 I0207 07:00:18.933753 2976 process.cpp:3704] Handling HTTP event for process 'master' with path: '/master/api/v1/scheduler' 07:00:18 I0207 07:00:18.933818 2976 process.cpp:3704] Handling HTTP event for process 'master' with path: '/master/api/v1/scheduler' 07:00:18 I0207 07:00:18.934253 2976 http.cpp:420] HTTP POST for /master/api/v1/scheduler from 10.153.254.29:44398 07:00:18 I0207 07:00:18.934309 2976 master.cpp:5032] Processing ACKNOWLEDGE call d54c9399-1a59-426c-80f2-c5fa491b9215 for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 07:00:18 I0207 07:00:18.934440 2974 status_update_manager.cpp:395] Received status update acknowledgement (UUID: d54c9399-1a59-426c-80f2-c5fa491b9215) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:18.934512 2976 http.cpp:420] HTTP POST for /master/api/v1/scheduler from 10.153.254.29:44398 07:00:18 I0207 07:00:18.934556 2976 master.cpp:5032] Processing ACKNOWLEDGE call 10681538-b4e6-4eb8-b8ae-0e7af9b4e009 for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 07:00:18 I0207 07:00:18.934666 2973 slave.cpp:3060] Status update manager successfully handled status update acknowledgement (UUID: d54c9399-1a59-426c-80f2-c5fa491b9215) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:18.934710 2976 http.cpp:420] HTTP POST for /master/api/v1/scheduler from 10.153.254.29:44398 07:00:18 I0207 07:00:18.934746 2973 status_update_manager.cpp:395] Received status update acknowledgement (UUID: 10681538-b4e6-4eb8-b8ae-0e7af9b4e009) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:18.934763 2976 master.cpp:5032] Processing ACKNOWLEDGE call 128da3e5-7a2c-4351-a36c-5dd43d7977ea for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 07:00:18 I0207 07:00:18.934803 2973 slave.cpp:3060] Status update manager successfully handled status update acknowledgement (UUID: 10681538-b4e6-4eb8-b8ae-0e7af9b4e009) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:18.934844 2976 http.cpp:420] HTTP POST for /master/api/v1/scheduler from 10.153.254.29:44398 07:00:18 I0207 07:00:18.934875 2976 master.cpp:4851] Processing KILL call for task '16b247b5-e1dd-4395-a2d7-71c9c393e5bb' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) 07:00:18 I0207 07:00:18.934918 2973 status_update_manager.cpp:395] Received status update acknowledgement (UUID: 128da3e5-7a2c-4351-a36c-5dd43d7977ea) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:18.934916 2976 master.cpp:4924] Telling agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) to kill task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) 07:00:18 I0207 07:00:18.935019 2975 slave.cpp:2383] Asked to kill task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:18.935169 2975 slave.cpp:3060] Status update manager successfully handled status update acknowledgement (UUID: 128da3e5-7a2c-4351-a36c-5dd43d7977ea) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:18 I0207 07:00:18.935544 29020 default_executor.cpp:153] Received KILL event 07:00:18 I0207 07:00:18.935567 29020 default_executor.cpp:841] Received kill for task '16b247b5-e1dd-4395-a2d7-71c9c393e5bb' 07:00:18 I0207 07:00:18.935581 29020 default_executor.cpp:813] Killing child container 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338 07:00:18 I0207 07:00:18.936013 2975 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1' 07:00:18 I0207 07:00:18.936257 2976 http.cpp:303] HTTP POST for /slave(716)/api/v1 from 10.153.254.29:44414 07:00:18 I0207 07:00:18.936349 2976 http.cpp:517] Processing call KILL_NESTED_CONTAINER 07:00:18 I0207 07:00:18.936545 2974 containerizer.cpp:2116] Destroying container 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338 in RUNNING state 07:00:18 I0207 07:00:18.936640 2975 linux_launcher.cpp:505] Asked to destroy container 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338 07:00:18 I0207 07:00:18.937069 2975 linux_launcher.cpp:548] Using freezer to destroy cgroup mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/966d71b2-cbc7-40a6-accf-bef80d3d8338 07:00:18 I0207 07:00:18.937824 2971 cgroups.cpp:2726] Freezing cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/966d71b2-cbc7-40a6-accf-bef80d3d8338 07:00:18 I0207 07:00:18.938868 2977 cgroups.cpp:1439] Successfully froze cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/966d71b2-cbc7-40a6-accf-bef80d3d8338 after 1.015808ms 07:00:18 I0207 07:00:18.939909 2975 cgroups.cpp:2744] Thawing cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/966d71b2-cbc7-40a6-accf-bef80d3d8338 07:00:18 I0207 07:00:18.940995 2977 cgroups.cpp:1468] Successfully thawed cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/966d71b2-cbc7-40a6-accf-bef80d3d8338 after 1.072128ms 07:00:19 I0207 07:00:18.975450 2973 containerizer.cpp:2479] Container 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338 has exited 07:00:19 I0207 07:00:18.976356 2973 provisioner.cpp:484] Ignoring destroy request for unknown container 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338 07:00:19 I0207 07:00:18.976426 2973 containerizer.cpp:2395] Checkpointing termination state to nested container's runtime directory '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/containers/4cfc866d-9fef-442b-8682-58dabb305974/containers/966d71b2-cbc7-40a6-accf-bef80d3d8338/termination' 07:00:19 I0207 07:00:18.977567 29023 default_executor.cpp:673] Child container 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338 of task '16b247b5-e1dd-4395-a2d7-71c9c393e5bb' in state TASK_KILLED terminated with status terminated with signal Killed 07:00:19 I0207 07:00:18.977624 29023 default_executor.cpp:708] Killing task group containing tasks [ 16b247b5-e1dd-4395-a2d7-71c9c393e5bb, c24a618d-ce08-4784-b8c7-0eeda79d121b ] 07:00:19 I0207 07:00:18.977648 29023 default_executor.cpp:813] Killing child container 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e 07:00:19 I0207 07:00:18.977864 2973 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1/executor' 07:00:19 I0207 07:00:18.978206 2977 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1' 07:00:19 I0207 07:00:18.978425 2977 http.cpp:303] HTTP POST for /slave(716)/api/v1 from 10.153.254.29:44416 07:00:19 I0207 07:00:18.978505 2977 http.cpp:517] Processing call KILL_NESTED_CONTAINER 07:00:19 I0207 07:00:18.978755 2972 containerizer.cpp:2116] Destroying container 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e in RUNNING state 07:00:19 I0207 07:00:18.978834 2972 linux_launcher.cpp:505] Asked to destroy container 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e 07:00:19 I0207 07:00:18.979177 2972 linux_launcher.cpp:548] Using freezer to destroy cgroup mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/486b0abc-966d-49b7-b2e0-58cd1d4b462e 07:00:19 I0207 07:00:18.979863 2974 cgroups.cpp:2726] Freezing cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/486b0abc-966d-49b7-b2e0-58cd1d4b462e 07:00:19 I0207 07:00:18.980865 2973 cgroups.cpp:1439] Successfully froze cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/486b0abc-966d-49b7-b2e0-58cd1d4b462e after 969984ns 07:00:19 I0207 07:00:18.981984 2971 cgroups.cpp:2744] Thawing cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/486b0abc-966d-49b7-b2e0-58cd1d4b462e 07:00:19 I0207 07:00:18.982986 2971 cgroups.cpp:1468] Successfully thawed cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/486b0abc-966d-49b7-b2e0-58cd1d4b462e after 984832ns 07:00:19 I0207 07:00:19.017686 2977 http.cpp:303] HTTP POST for /slave(716)/api/v1/executor from 10.153.254.29:44402 07:00:19 I0207 07:00:19.017765 2977 slave.cpp:3771] Handling status update TASK_KILLED (UUID: 5811c6a9-1fd6-48a2-90a6-65f5e9c9ee84) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:19 I0207 07:00:19.018388 2977 status_update_manager.cpp:323] Received status update TASK_KILLED (UUID: 5811c6a9-1fd6-48a2-90a6-65f5e9c9ee84) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:19 I0207 07:00:19.018442 2977 status_update_manager.cpp:377] Forwarding update TASK_KILLED (UUID: 5811c6a9-1fd6-48a2-90a6-65f5e9c9ee84) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 to the agent 07:00:19 I0207 07:00:19.018528 2976 slave.cpp:4211] Forwarding the update TASK_KILLED (UUID: 5811c6a9-1fd6-48a2-90a6-65f5e9c9ee84) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 to master@10.153.254.29:38570 07:00:19 I0207 07:00:19.018610 2976 slave.cpp:4105] Status update manager successfully handled status update TASK_KILLED (UUID: 5811c6a9-1fd6-48a2-90a6-65f5e9c9ee84) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:19 I0207 07:00:19.018651 2977 master.cpp:6094] Status update TASK_KILLED (UUID: 5811c6a9-1fd6-48a2-90a6-65f5e9c9ee84) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 from agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) 07:00:19 I0207 07:00:19.018682 2977 master.cpp:6162] Forwarding status update TASK_KILLED (UUID: 5811c6a9-1fd6-48a2-90a6-65f5e9c9ee84) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:19 I0207 07:00:19.018759 2977 master.cpp:8242] Updating the state of task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_KILLED, status update state: TASK_KILLED) 07:00:19 I0207 07:00:19.018950 2974 hierarchical.cpp:1079] Recovered cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 (total: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000], allocated: cpus(*)(allocated: *):0.3; mem(*)(allocated: *):96; disk(*)(allocated: *):96) on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 from framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:19 I0207 07:00:19.019011 29022 default_executor.cpp:153] Received ACKNOWLEDGED event 07:00:19 I0207 07:00:19.019037 2973 scheduler.cpp:676] Enqueuing event UPDATE received from http://10.153.254.29:38570/master/api/v1/scheduler 07:00:19 I0207 07:00:19.076431 2977 containerizer.cpp:2479] Container 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e has exited 07:00:19 I0207 07:00:19.077306 2974 provisioner.cpp:484] Ignoring destroy request for unknown container 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e 07:00:19 I0207 07:00:19.077369 2974 containerizer.cpp:2395] Checkpointing termination state to nested container's runtime directory '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/containers/4cfc866d-9fef-442b-8682-58dabb305974/containers/486b0abc-966d-49b7-b2e0-58cd1d4b462e/termination' 07:00:19 I0207 07:00:19.077934 29025 default_executor.cpp:673] Child container 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e of task 'c24a618d-ce08-4784-b8c7-0eeda79d121b' in state TASK_KILLED terminated with status terminated with signal Killed 07:00:19 I0207 07:00:19.078296 2974 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1/executor' 07:00:19 I0207 07:00:19.117736 2970 http.cpp:303] HTTP POST for /slave(716)/api/v1/executor from 10.153.254.29:44402 07:00:19 I0207 07:00:19.117791 2970 slave.cpp:3771] Handling status update TASK_KILLED (UUID: 9f6f1fc0-5838-4a46-a4c1-4543e28dc1c9) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:19 I0207 07:00:19.118321 2977 status_update_manager.cpp:323] Received status update TASK_KILLED (UUID: 9f6f1fc0-5838-4a46-a4c1-4543e28dc1c9) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:19 I0207 07:00:19.118379 2977 status_update_manager.cpp:377] Forwarding update TASK_KILLED (UUID: 9f6f1fc0-5838-4a46-a4c1-4543e28dc1c9) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 to the agent 07:00:19 I0207 07:00:19.118453 2971 slave.cpp:4211] Forwarding the update TASK_KILLED (UUID: 9f6f1fc0-5838-4a46-a4c1-4543e28dc1c9) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 to master@10.153.254.29:38570 07:00:19 I0207 07:00:19.118526 2971 slave.cpp:4105] Status update manager successfully handled status update TASK_KILLED (UUID: 9f6f1fc0-5838-4a46-a4c1-4543e28dc1c9) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:19 I0207 07:00:19.118571 2970 master.cpp:6094] Status update TASK_KILLED (UUID: 9f6f1fc0-5838-4a46-a4c1-4543e28dc1c9) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 from agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) 07:00:19 I0207 07:00:19.118604 2970 master.cpp:6162] Forwarding status update TASK_KILLED (UUID: 9f6f1fc0-5838-4a46-a4c1-4543e28dc1c9) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:19 I0207 07:00:19.118687 2970 master.cpp:8242] Updating the state of task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_KILLED, status update state: TASK_KILLED) 07:00:19 I0207 07:00:19.118865 2976 hierarchical.cpp:1079] Recovered cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 (total: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000], allocated: cpus(*)(allocated: *):0.2; mem(*)(allocated: *):64; disk(*)(allocated: *):64) on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 from framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:19 I0207 07:00:19.118947 29019 default_executor.cpp:153] Received ACKNOWLEDGED event 07:00:19 I0207 07:00:19.118973 2973 scheduler.cpp:676] Enqueuing event UPDATE received from http://10.153.254.29:38570/master/api/v1/scheduler 07:00:19 I0207 07:00:19.119366 2977 scheduler.cpp:243] Sending KILL call to http://10.153.254.29:38570/master/api/v1/scheduler 07:00:19 I0207 07:00:19.119678 2972 process.cpp:3704] Handling HTTP event for process 'master' with path: '/master/api/v1/scheduler' 07:00:19 I0207 07:00:19.157742 2970 http.cpp:420] HTTP POST for /master/api/v1/scheduler from 10.153.254.29:44398 07:00:19 I0207 07:00:19.157784 2970 master.cpp:4851] Processing KILL call for task '8cd47a02-ff21-4585-ab72-0ce803a4be78' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) 07:00:19 I0207 07:00:19.157804 2970 master.cpp:4924] Telling agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) to kill task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) 07:00:19 I0207 07:00:19.157855 2976 slave.cpp:2383] Asked to kill task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:19 I0207 07:00:19.158260 29024 default_executor.cpp:153] Received KILL event 07:00:19 I0207 07:00:19.158283 29024 default_executor.cpp:841] Received kill for task '8cd47a02-ff21-4585-ab72-0ce803a4be78' 07:00:19 I0207 07:00:19.158294 29024 default_executor.cpp:813] Killing child container 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8 07:00:19 I0207 07:00:19.158717 2974 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1' 07:00:19 I0207 07:00:19.158946 2972 http.cpp:303] HTTP POST for /slave(716)/api/v1 from 10.153.254.29:44418 07:00:19 I0207 07:00:19.159024 2972 http.cpp:517] Processing call KILL_NESTED_CONTAINER 07:00:19 I0207 07:00:19.159195 2976 containerizer.cpp:2116] Destroying container 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8 in RUNNING state 07:00:19 I0207 07:00:19.159293 2972 linux_launcher.cpp:505] Asked to destroy container 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8 07:00:19 I0207 07:00:19.159647 2972 linux_launcher.cpp:548] Using freezer to destroy cgroup mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/5e04c992-3a62-4187-86b2-2ad4abb2f5e8 07:00:19 I0207 07:00:19.160347 2973 cgroups.cpp:2726] Freezing cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/5e04c992-3a62-4187-86b2-2ad4abb2f5e8 07:00:19 I0207 07:00:19.161346 2973 cgroups.cpp:1439] Successfully froze cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/5e04c992-3a62-4187-86b2-2ad4abb2f5e8 after 974080ns 07:00:19 I0207 07:00:19.162377 2972 cgroups.cpp:2744] Thawing cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/5e04c992-3a62-4187-86b2-2ad4abb2f5e8 07:00:19 I0207 07:00:19.163326 2975 cgroups.cpp:1468] Successfully thawed cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/5e04c992-3a62-4187-86b2-2ad4abb2f5e8 after 929792ns 07:00:19 I0207 07:00:19.177110 2975 containerizer.cpp:2479] Container 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8 has exited 07:00:19 I0207 07:00:19.178030 2970 provisioner.cpp:484] Ignoring destroy request for unknown container 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8 07:00:19 I0207 07:00:19.178082 2970 containerizer.cpp:2395] Checkpointing termination state to nested container's runtime directory '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/containers/4cfc866d-9fef-442b-8682-58dabb305974/containers/5e04c992-3a62-4187-86b2-2ad4abb2f5e8/termination' 07:00:19 I0207 07:00:19.178556 29020 default_executor.cpp:673] Child container 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8 of task '8cd47a02-ff21-4585-ab72-0ce803a4be78' in state TASK_KILLED terminated with status terminated with signal Killed 07:00:19 I0207 07:00:19.178586 29020 default_executor.cpp:797] Terminating after 1secs 07:00:19 I0207 07:00:19.181659 2975 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1/executor' 07:00:19 I0207 07:00:19.221710 2972 http.cpp:303] HTTP POST for /slave(716)/api/v1/executor from 10.153.254.29:44402 07:00:19 I0207 07:00:19.221762 2972 slave.cpp:3771] Handling status update TASK_KILLED (UUID: c62e4ad7-468a-4934-9b77-815d878de732) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:19 I0207 07:00:19.222328 2974 status_update_manager.cpp:323] Received status update TASK_KILLED (UUID: c62e4ad7-468a-4934-9b77-815d878de732) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:19 I0207 07:00:19.222389 2974 status_update_manager.cpp:377] Forwarding update TASK_KILLED (UUID: c62e4ad7-468a-4934-9b77-815d878de732) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 to the agent 07:00:19 I0207 07:00:19.222486 2977 slave.cpp:4211] Forwarding the update TASK_KILLED (UUID: c62e4ad7-468a-4934-9b77-815d878de732) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 to master@10.153.254.29:38570 07:00:19 I0207 07:00:19.222591 2977 slave.cpp:4105] Status update manager successfully handled status update TASK_KILLED (UUID: c62e4ad7-468a-4934-9b77-815d878de732) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:19 I0207 07:00:19.222607 2971 master.cpp:6094] Status update TASK_KILLED (UUID: c62e4ad7-468a-4934-9b77-815d878de732) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 from agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) 07:00:19 I0207 07:00:19.222627 2971 master.cpp:6162] Forwarding status update TASK_KILLED (UUID: c62e4ad7-468a-4934-9b77-815d878de732) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:19 I0207 07:00:19.222712 2971 master.cpp:8242] Updating the state of task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_KILLED, status update state: TASK_KILLED) 07:00:19 I0207 07:00:19.222867 2975 hierarchical.cpp:1079] Recovered cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 (total: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000], allocated: cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32) on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 from framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:19 I0207 07:00:19.223067 2970 scheduler.cpp:676] Enqueuing event UPDATE received from http://10.153.254.29:38570/master/api/v1/scheduler 07:00:19 I0207 07:00:19.779280 2973 hierarchical.cpp:1907] No inverse offers to send out! 07:00:19 I0207 07:00:19.779335 2973 hierarchical.cpp:1401] Performed allocation for 1 agents in 276292ns 07:00:19 I0207 07:00:19.779414 2971 master.cpp:6932] Sending 1 offers to framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) 07:00:19 I0207 07:00:19.780038 2973 scheduler.cpp:676] Enqueuing event OFFERS received from http://10.153.254.29:38570/master/api/v1/scheduler 07:00:20 I0207 07:00:20.178755 29020 default_executor.cpp:708] Killing task group containing tasks [ 8cd47a02-ff21-4585-ab72-0ce803a4be78 ] 07:00:20 I0207 07:00:20.284885 2970 containerizer.cpp:2479] Container 4cfc866d-9fef-442b-8682-58dabb305974 has exited 07:00:20 I0207 07:00:20.284914 2970 containerizer.cpp:2116] Destroying container 4cfc866d-9fef-442b-8682-58dabb305974 in RUNNING state 07:00:20 I0207 07:00:20.285010 2975 linux_launcher.cpp:505] Asked to destroy container 4cfc866d-9fef-442b-8682-58dabb305974 07:00:20 I0207 07:00:20.285462 2975 linux_launcher.cpp:548] Using freezer to destroy cgroup mesos/4cfc866d-9fef-442b-8682-58dabb305974 07:00:20 I0207 07:00:20.286226 2977 cgroups.cpp:2726] Freezing cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos 07:00:20 I0207 07:00:20.286248 2974 cgroups.cpp:2726] Freezing cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974 07:00:20 I0207 07:00:20.288529 2975 cgroups.cpp:1439] Successfully froze cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos after 2.279168ms 07:00:20 I0207 07:00:20.288636 2970 cgroups.cpp:1439] Successfully froze cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974 after 2.370048ms 07:00:20 I0207 07:00:20.289970 2973 cgroups.cpp:2744] Thawing cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos 07:00:20 I0207 07:00:20.290127 2975 cgroups.cpp:2744] Thawing cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974 07:00:20 I0207 07:00:20.291142 2973 cgroups.cpp:1468] Successfully thawed cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos after 1.154048ms 07:00:20 I0207 07:00:20.291566 2970 cgroups.cpp:1468] Successfully thawed cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974 after 1.420032ms 07:00:20 I0207 07:00:20.292809 2970 provisioner.cpp:484] Ignoring destroy request for unknown container 4cfc866d-9fef-442b-8682-58dabb305974 07:00:20 I0207 07:00:20.293262 2970 slave.cpp:4706] Executor 'default' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 exited with status 0 07:00:20 I0207 07:00:20.293408 2970 master.cpp:6224] Executor 'default' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal): exited with status 0 07:00:20 I0207 07:00:20.293469 2970 master.cpp:8365] Removing executor 'default' with resources cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) 07:00:20 I0207 07:00:20.293663 2971 hierarchical.cpp:1079] Recovered cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 (total: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000], allocated: cpus(*)(allocated: *):1.9; mem(*)(allocated: *):992; disk(*)(allocated: *):992; ports(*)(allocated: *):[31000-32000]) on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 from framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:20 I0207 07:00:20.293929 2970 scheduler.cpp:676] Enqueuing event FAILURE received from http://10.153.254.29:38570/master/api/v1/scheduler 07:00:20 I0207 07:00:20.294646 2973 master.cpp:1380] Framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) disconnected 07:00:20 I0207 07:00:20.294739 2973 master.cpp:3080] Deactivating framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) 07:00:20 W0207 07:00:20.294898 2973 master.hpp:2262] Unable to send event to framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default): connection closed 07:00:20 I0207 07:00:20.294934 2973 master.cpp:3057] Disconnecting framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) 07:00:20 I0207 07:00:20.294951 2973 master.cpp:1395] Giving framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) 0ns to failover 07:00:20 I0207 07:00:20.295022 2974 hierarchical.cpp:415] Deactivated framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:20 I0207 07:00:20.295150 2974 hierarchical.cpp:1079] Recovered cpus(*)(allocated: *):1.9; mem(*)(allocated: *):992; disk(*)(allocated: *):992; ports(*)(allocated: *):[31000-32000] (total: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000], allocated: {}) on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 from framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:20 I0207 07:00:20.296192 2972 master.cpp:6772] Framework failover timeout, removing framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) 07:00:20 I0207 07:00:20.296218 2972 master.cpp:7657] Removing framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) 07:00:20 I0207 07:00:20.296278 2972 master.cpp:8242] Updating the state of task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_KILLED, status update state: TASK_KILLED) 07:00:20 I0207 07:00:20.296283 2974 slave.cpp:2613] Asked to shut down framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 by master@10.153.254.29:38570 07:00:20 I0207 07:00:20.296320 2974 slave.cpp:2638] Shutting down framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:20 I0207 07:00:20.296336 2974 slave.cpp:4806] Cleaning up executor 'default' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (via HTTP) 07:00:20 I0207 07:00:20.296311 2972 master.cpp:8336] Removing task c24a618d-ce08-4784-b8c7-0eeda79d121b with resources cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) 07:00:20 I0207 07:00:20.296442 2972 master.cpp:8242] Updating the state of task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_KILLED, status update state: TASK_KILLED) 07:00:20 I0207 07:00:20.296480 2971 gc.cpp:55] Scheduling '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974' for gc 6.99999659133037days in the future 07:00:20 I0207 07:00:20.296504 2974 slave.cpp:4894] Cleaning up framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:20 I0207 07:00:20.296465 2972 master.cpp:8336] Removing task 8cd47a02-ff21-4585-ab72-0ce803a4be78 with resources cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) 07:00:20 I0207 07:00:20.296556 2971 gc.cpp:55] Scheduling '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default' for gc 6.99999659133037days in the future 07:00:20 I0207 07:00:20.296576 2972 master.cpp:8242] Updating the state of task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_KILLED, status update state: TASK_KILLED) 07:00:20 I0207 07:00:20.296604 2975 status_update_manager.cpp:285] Closing status update streams for framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:20 I0207 07:00:20.296593 2972 master.cpp:8336] Removing task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb with resources cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) 07:00:20 I0207 07:00:20.296638 2971 gc.cpp:55] Scheduling '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000' for gc 6.99999659133037days in the future 07:00:20 I0207 07:00:20.296641 2975 status_update_manager.cpp:531] Cleaning up status update stream for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:20 I0207 07:00:20.296808 2976 hierarchical.cpp:362] Removed framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:20 I0207 07:00:20.296821 2975 status_update_manager.cpp:531] Cleaning up status update stream for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:20 I0207 07:00:20.296928 2975 status_update_manager.cpp:531] Cleaning up status update stream for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 07:00:20 W0207 07:00:20.297485 2976 containerizer.cpp:2104] Attempted to destroy unknown container 4cfc866d-9fef-442b-8682-58dabb305974 07:00:20 ../../src/tests/cluster.cpp:576: Failure 07:00:20 Value of: containers.get().empty() 07:00:20 Actual: false 07:00:20 Expected: true 07:00:20 Failed to destroy containers: { 4cfc866d-9fef-442b-8682-58dabb305974 } 07:00:20 I0207 07:00:20.297739 2977 slave.cpp:803] Agent terminating 07:00:20 I0207 07:00:20.297816 2973 master.cpp:1263] Agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) disconnected 07:00:20 I0207 07:00:20.297837 2973 master.cpp:3117] Disconnecting agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) 07:00:20 I0207 07:00:20.297860 2973 master.cpp:3136] Deactivating agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) 07:00:20 I0207 07:00:20.297920 2977 hierarchical.cpp:617] Agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 deactivated 07:00:20 I0207 07:00:20.300276 2952 master.cpp:1102] Master terminating 07:00:20 I0207 07:00:20.300390 2971 hierarchical.cpp:548] Removed agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 07:00:20 [ FAILED ] ROOT_DOCKER_DockerAndMesosContainerizers/DefaultExecutorTest.KillTask/0, where GetParam() = "docker,mesos" (2527 ms)
Note that the other parameterized test MesosContainerizer/DefaultExecutorTest.KillTask/0 passes successfully though.
Attachments
Issue Links
- duplicates
-
MESOS-7506 Multiple tests leave orphan containers.
- Resolved
- is depended upon by
-
MESOS-7110 Ensure Mesos can be built and tests successfully on Ubuntu16
- Open
-
MESOS-7112 Ensure Mesos can be built and tests successfully on Debian8
- Open
- is related to
-
MESOS-7216 Delayed executor termination leads to test failures
- Resolved
- relates to
-
MESOS-7506 Multiple tests leave orphan containers.
- Resolved