[SAMZA-1023] ContainerProcessManager spams the job coordinator log with "TaskManager state" messages

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.11.0
• Fix Version/s: 0.11.0
• Assignee: Branislav Cogic
• Reporter: Jake Maes
• Created: 21/Sep/16 20:23
• Updated: 20/Dec/17 21:37
• Resolved: 29/Sep/16 14:03

Description

There are 2 problems with the message in the Summary:

1. The message is printed every second in the job coordinator log. Do we really want to keep periodically printing that message indefinitely? It would certainly be a departure from our convention thus far.

2. Since it starts with "Too many FailedContainers" it gets interpreted as a problem, some reformatting, reordering, or rewording would help.

2016-09-21 20:10:40.837 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:10:41.837 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:10:42.837 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:10:43.837 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:10:44.838 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:10:45.838 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:10:46.838 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:10:47.838 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:10:48.838 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:10:49.839 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:10:50.839 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:10:51.839 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:10:52.839 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:10:53.839 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:10:54.840 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:10:55.840 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:10:56.840 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:10:57.840 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:10:58.840 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:10:59.841 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:00.841 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:01.841 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:02.841 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:03.841 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:04.842 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:05.842 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:06.842 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:07.842 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:08.843 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:09.843 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:10.843 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:11.843 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:12.843 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:13.844 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:14.844 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:15.844 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:16.844 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:17.844 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:18.845 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:19.845 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:20.845 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:21.845 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:22.845 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:23.846 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:24.846 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:25.846 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:26.846 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:27.846 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:28.847 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:29.847 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:30.847 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:31.847 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:32.847 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:33.848 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:34.848 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:35.848 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:36.848 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:37.848 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:38.849 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:39.849 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:40.849 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:41.849 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:42.850 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:43.850 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:44.850 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:45.850 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:46.851 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:47.851 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:48.851 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:49.851 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:50.851 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:51.852 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:52.852 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:53.852 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:54.852 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:55.852 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true 
2016-09-21 20:11:56.853 [main] ContainerProcessManager [INFO]  TaskManager state: Too many FailedContainers: false No. Completed containers: 0 Num Configured containers: 5 AllocatorThread liveness: true