[MESOS-8123] GPU tests are failing due to TASK_STARTING.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: test
• Labels: flaky-test mesosphere
• Story Points: 1
• Assignee: Benno Evers
• Reporter: Jie Yu
• Shepherd: Jie Yu
• Created: 21/Oct/17 05:23
• Updated: 05/Dec/17 14:20
• Resolved: 13/Nov/17 20:23

Description

For instance: NvidiaGpuTest.ROOT_CGROUPS_NVIDIA_GPU_VerifyDeviceAccess

I1020 22:18:46.180371  1480 exec.cpp:237] Executor registered on agent ca0e7b44-c621-4442-a62e-15f7bf02064b-S0
I1020 22:18:46.185027  1486 executor.cpp:171] Received SUBSCRIBED event
I1020 22:18:46.186005  1486 executor.cpp:175] Subscribed executor on core-dev
I1020 22:18:46.186189  1486 executor.cpp:171] Received LAUNCH event
I1020 22:18:46.188908  1486 executor.cpp:637] Starting task 3c08cf78-575d-4813-82b6-3ace272db35e
I1020 22:18:46.192939  1316 slave.cpp:4407] Handling status update TASK_STARTING (UUID: 87cee290-b2fe-4459-9b75-b9f03aab6492) for task 3c08cf78-575d-4813-82b6-3ace272db35e of fra
mework ca0e7b44-c621-4442-a62e-15f7bf02064b-0000 from executor(1)@10.0.49.2:42711
I1020 22:18:46.196228  1330 status_update_manager.cpp:323] Received status update TASK_STARTING (UUID: 87cee290-b2fe-4459-9b75-b9f03aab6492) for task 3c08cf78-575d-4813-82b6-3ace
272db35e of framework ca0e7b44-c621-4442-a62e-15f7bf02064b-0000
I1020 22:18:46.197510  1329 slave.cpp:4888] Forwarding the update TASK_STARTING (UUID: 87cee290-b2fe-4459-9b75-b9f03aab6492) for task 3c08cf78-575d-4813-82b6-3ace272db35e of fram
ework ca0e7b44-c621-4442-a62e-15f7bf02064b-0000 to master@10.0.49.2:34819
I1020 22:18:46.197927  1329 slave.cpp:4798] Sending acknowledgement for status update TASK_STARTING (UUID: 87cee290-b2fe-4459-9b75-b9f03aab6492) for task 3c08cf78-575d-4813-82b6-
3ace272db35e of framework ca0e7b44-c621-4442-a62e-15f7bf02064b-0000 to executor(1)@10.0.49.2:42711
I1020 22:18:46.198098  1332 master.cpp:6998] Status update TASK_STARTING (UUID: 87cee290-b2fe-4459-9b75-b9f03aab6492) for task 3c08cf78-575d-4813-82b6-3ace272db35e of framework c
a0e7b44-c621-4442-a62e-15f7bf02064b-0000 from agent ca0e7b44-c621-4442-a62e-15f7bf02064b-S0 at slave(1)@10.0.49.2:34819 (core-dev)
I1020 22:18:46.198187  1332 master.cpp:7060] Forwarding status update TASK_STARTING (UUID: 87cee290-b2fe-4459-9b75-b9f03aab6492) for task 3c08cf78-575d-4813-82b6-3ace272db35e of 
framework ca0e7b44-c621-4442-a62e-15f7bf02064b-0000
I1020 22:18:46.198463  1332 master.cpp:9162] Updating the state of task 3c08cf78-575d-4813-82b6-3ace272db35e of framework ca0e7b44-c621-4442-a62e-15f7bf02064b-0000 (latest state:
 TASK_STARTING, status update state: TASK_STARTING)
I1020 22:18:46.199198  1331 master.cpp:5566] Processing ACKNOWLEDGE call 87cee290-b2fe-4459-9b75-b9f03aab6492 for task 3c08cf78-575d-4813-82b6-3ace272db35e of framework ca0e7b44-
c621-4442-a62e-15f7bf02064b-0000 (default) at scheduler-f2b66689-382a-4b8c-bdc9-978cff922409@10.0.49.2:34819 on agent ca0e7b44-c621-4442-a62e-15f7bf02064b-S0
/home/jie/workspace/mesos/src/tests/containerizer/nvidia_gpu_isolator_tests.cpp:142: Failure
      Expected: TASK_RUNNING
To be equal to: statusRunning1->state()
      Which is: TASK_STARTING