Uploaded image for project: 'Mesos'
  1. Mesos
  2. MESOS-1614

ExamplesTest.LowLevelSchedulerPthread is flaky

Attach filesAttach ScreenshotVotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Cannot Reproduce
    • None
    • None
    • None
    • None
    • ubuntu-13.10-clang

    Description

      [ RUN      ] ExamplesTest.LowLevelSchedulerPthread
      Using temporary directory '/tmp/ExamplesTest_LowLevelSchedulerPthread_jdkrl2'
      Enabling authentication for the scheduler
      WARNING: Logging before InitGoogleLogging() is written to STDERR
      I0717 04:38:33.746598  6300 process.cpp:1671] libprocess is initialized on 127.0.1.1:36034 for 8 cpus
      I0717 04:38:33.747326  6300 logging.cpp:172] Logging to STDERR
      I0717 04:38:33.747972  6300 scheduler.cpp:132] Version: 0.20.0
      I0717 04:38:33.773912  6300 leveldb.cpp:176] Opened db in 22.974052ms
      I0717 04:38:33.780432  6300 leveldb.cpp:183] Compacted db in 6.249327ms
      I0717 04:38:33.780479  6300 leveldb.cpp:198] Created db iterator in 17429ns
      I0717 04:38:33.780488  6300 leveldb.cpp:204] Seeked to beginning of db in 4360ns
      I0717 04:38:33.780494  6300 leveldb.cpp:273] Iterated through 0 keys in the db in 3563ns
      I0717 04:38:33.780555  6300 replica.cpp:741] Replica recovered with log positions 0 -> 0 with 1 holes and 0 unlearned
      I0717 04:38:33.783352  6300 containerizer.cpp:124] Using isolation: posix/cpu,posix/mem
      I0717 04:38:33.784047  6327 master.cpp:288] Master 20140717-043833-16842879-36034-6300 (saucy) started on 127.0.1.1:36034
      I0717 04:38:33.784579  6327 master.cpp:325] Master only allowing authenticated frameworks to register
      I0717 04:38:33.784590  6327 master.cpp:332] Master allowing unauthenticated slaves to register
      I0717 04:38:33.784606  6327 credentials.hpp:36] Loading credentials for authentication from '/tmp/ExamplesTest_LowLevelSchedulerPthread_jdkrl2/credentials'
      W0717 04:38:33.784695  6327 credentials.hpp:51] Permissions on credentials file '/tmp/ExamplesTest_LowLevelSchedulerPthread_jdkrl2/credentials' are too open. It is recommended that your credentials file is NOT accessible by others.
      I0717 04:38:33.784800  6327 master.cpp:359] Authorization enabled
      I0717 04:38:33.784319  6328 recover.cpp:425] Starting replica recovery
      I0717 04:38:33.785490  6328 recover.cpp:451] Replica is in EMPTY status
      I0717 04:38:33.788049  6327 hierarchical_allocator_process.hpp:301] Initializing hierarchical allocator process with master : master@127.0.1.1:36034
      I0717 04:38:33.788275  6329 master.cpp:122] No whitelist given. Advertising offers for all slaves
      I0717 04:38:33.788422  6325 master.cpp:1128] The newly elected leader is master@127.0.1.1:36034 with id 20140717-043833-16842879-36034-6300
      I0717 04:38:33.789507  6325 master.cpp:1141] Elected as the leading master!
      I0717 04:38:33.789542  6325 master.cpp:959] Recovering from registrar
      I0717 04:38:33.789670  6325 registrar.cpp:313] Recovering registrar
      I0717 04:38:33.789214  6323 replica.cpp:638] Replica in EMPTY status received a broadcasted recover request
      I0717 04:38:33.790441  6323 recover.cpp:188] Received a recover response from a replica in EMPTY status
      I0717 04:38:33.790578  6323 recover.cpp:542] Updating replica status to STARTING
      I0717 04:38:33.792899  6329 slave.cpp:168] Slave started on 1)@127.0.1.1:36034
      I0717 04:38:33.793300  6329 slave.cpp:279] Slave resources: cpus(*):1; mem(*):1001; disk(*):24988; ports(*):[31000-32000]
      I0717 04:38:33.793813  6329 slave.cpp:324] Slave hostname: saucy
      I0717 04:38:33.793838  6329 slave.cpp:325] Slave checkpoint: true
      I0717 04:38:33.794695  6326 state.cpp:33] Recovering state from '/tmp/mesos-7TEGaz/0/meta'
      I0717 04:38:33.794891  6326 status_update_manager.cpp:193] Recovering status update manager
      I0717 04:38:33.795001  6326 containerizer.cpp:287] Recovering containerizer
      I0717 04:38:33.795431  6326 slave.cpp:3127] Finished recovery
      I0717 04:38:33.796114  6323 leveldb.cpp:306] Persisting metadata (8 bytes) to leveldb took 5.442933ms
      I0717 04:38:33.796144  6323 replica.cpp:320] Persisted replica status to STARTING
      I0717 04:38:33.796216  6323 recover.cpp:451] Replica is in STARTING status
      I0717 04:38:33.796465  6323 replica.cpp:638] Replica in STARTING status received a broadcasted recover request
      I0717 04:38:33.796506  6323 recover.cpp:188] Received a recover response from a replica in STARTING status
      I0717 04:38:33.796571  6323 recover.cpp:542] Updating replica status to VOTING
      I0717 04:38:33.797324  6328 slave.cpp:600] New master detected at master@127.0.1.1:36034
      I0717 04:38:33.797612  6328 slave.cpp:636] No credentials provided. Attempting to register without authentication
      I0717 04:38:33.797837  6325 status_update_manager.cpp:167] New master detected at master@127.0.1.1:36034
      I0717 04:38:33.798102  6328 slave.cpp:649] Detecting new master
      I0717 04:38:33.798604  6300 containerizer.cpp:124] Using isolation: posix/cpu,posix/mem
      I0717 04:38:33.799973  6330 slave.cpp:168] Slave started on 2)@127.0.1.1:36034
      I0717 04:38:33.800487  6330 slave.cpp:279] Slave resources: cpus(*):1; mem(*):1001; disk(*):24988; ports(*):[31000-32000]
      I0717 04:38:33.800565  6330 slave.cpp:324] Slave hostname: saucy
      I0717 04:38:33.800576  6330 slave.cpp:325] Slave checkpoint: true
      I0717 04:38:33.801280  6330 state.cpp:33] Recovering state from '/tmp/mesos-7TEGaz/1/meta'
      I0717 04:38:33.801373  6330 status_update_manager.cpp:193] Recovering status update manager
      I0717 04:38:33.801424  6330 containerizer.cpp:287] Recovering containerizer
      I0717 04:38:33.801573  6330 slave.cpp:3127] Finished recovery
      I0717 04:38:33.802162  6323 leveldb.cpp:306] Persisting metadata (8 bytes) to leveldb took 5.568112ms
      I0717 04:38:33.802188  6323 replica.cpp:320] Persisted replica status to VOTING
      I0717 04:38:33.802225  6323 recover.cpp:556] Successfully joined the Paxos group
      I0717 04:38:33.802489  6324 log.cpp:656] Attempting to start the writer
      I0717 04:38:33.803197  6324 replica.cpp:474] Replica received implicit promise request with proposal 1
      I0717 04:38:33.802306  6323 recover.cpp:440] Recover process terminated
      I0717 04:38:33.804124  6330 slave.cpp:600] New master detected at master@127.0.1.1:36034
      I0717 04:38:33.804440  6330 slave.cpp:636] No credentials provided. Attempting to register without authentication
      I0717 04:38:33.804597  6326 status_update_manager.cpp:167] New master detected at master@127.0.1.1:36034
      I0717 04:38:33.804900  6330 slave.cpp:649] Detecting new master
      I0717 04:38:33.805435  6300 containerizer.cpp:124] Using isolation: posix/cpu,posix/mem
      I0717 04:38:33.806625  6325 slave.cpp:168] Slave started on 3)@127.0.1.1:36034
      I0717 04:38:33.807210  6325 slave.cpp:279] Slave resources: cpus(*):1; mem(*):1001; disk(*):24988; ports(*):[31000-32000]
      I0717 04:38:33.807358  6325 slave.cpp:324] Slave hostname: saucy
      I0717 04:38:33.807368  6325 slave.cpp:325] Slave checkpoint: true
      I0717 04:38:33.807651  6325 state.cpp:33] Recovering state from '/tmp/mesos-7TEGaz/2/meta'
      I0717 04:38:33.808022  6325 status_update_manager.cpp:193] Recovering status update manager
      I0717 04:38:33.808068  6325 containerizer.cpp:287] Recovering containerizer
      I0717 04:38:33.808228  6325 slave.cpp:3127] Finished recovery
      I0717 04:38:33.808755  6325 slave.cpp:600] New master detected at master@127.0.1.1:36034
      I0717 04:38:33.808802  6325 slave.cpp:636] No credentials provided. Attempting to register without authentication
      I0717 04:38:33.808819  6325 slave.cpp:649] Detecting new master
      I0717 04:38:33.808842  6325 status_update_manager.cpp:167] New master detected at master@127.0.1.1:36034
      I0717 04:38:33.809497  6324 leveldb.cpp:306] Persisting metadata (8 bytes) to leveldb took 6.294395ms
      I0717 04:38:33.809530  6324 replica.cpp:342] Persisted promised to 1
      I0717 04:38:33.809841  6324 coordinator.cpp:230] Coordinator attemping to fill missing position
      I0717 04:38:33.810288  6324 replica.cpp:375] Replica received explicit promise request for position 0 with proposal 2
      I0717 04:38:33.812147  6329 scheduler.cpp:401] New master detected at master@127.0.1.1:36034
      I0717 04:38:33.812185  6329 scheduler.cpp:450] Authenticating with master master@127.0.1.1:36034
      I0717 04:38:33.812446  6329 authenticatee.hpp:104] Initializing client SASL
      I0717 04:38:33.814846  6329 authenticatee.hpp:128] Creating new client SASL connection
      I0717 04:38:33.815363  6328 master.cpp:849] Dropping 'mesos.internal.AuthenticateMessage' message since not recovered yet
      I0717 04:38:33.816373  6324 leveldb.cpp:343] Persisting action (8 bytes) to leveldb took 6.059198ms
      I0717 04:38:33.816403  6324 replica.cpp:676] Persisted action at 0
      I0717 04:38:33.816862  6324 replica.cpp:508] Replica received write request for position 0
      I0717 04:38:33.816910  6324 leveldb.cpp:438] Reading position from leveldb took 39575ns
      I0717 04:38:33.822876  6324 leveldb.cpp:343] Persisting action (14 bytes) to leveldb took 5.948848ms
      I0717 04:38:33.822906  6324 replica.cpp:676] Persisted action at 0
      I0717 04:38:33.823065  6324 replica.cpp:655] Replica received learned notice for position 0
      I0717 04:38:33.828433  6324 leveldb.cpp:343] Persisting action (16 bytes) to leveldb took 5.3643ms
      I0717 04:38:33.828462  6324 replica.cpp:676] Persisted action at 0
      I0717 04:38:33.828469  6324 replica.cpp:661] Replica learned NOP action at position 0
      I0717 04:38:33.828939  6324 log.cpp:672] Writer started with ending position 0
      I0717 04:38:33.829449  6324 leveldb.cpp:438] Reading position from leveldb took 25009ns
      I0717 04:38:33.836467  6324 registrar.cpp:346] Successfully fetched the registry (0B)
      I0717 04:38:33.836552  6324 registrar.cpp:422] Attempting to update the 'registry'
      I0717 04:38:33.837960  6330 log.cpp:680] Attempting to append 117 bytes to the log
      I0717 04:38:33.838029  6330 coordinator.cpp:340] Coordinator attempting to write APPEND action at position 1
      I0717 04:38:33.838245  6330 replica.cpp:508] Replica received write request for position 1
      I0717 04:38:33.844388  6330 leveldb.cpp:343] Persisting action (134 bytes) to leveldb took 6.148998ms
      I0717 04:38:33.844452  6330 replica.cpp:676] Persisted action at 1
      I0717 04:38:33.844732  6330 replica.cpp:655] Replica received learned notice for position 1
      I0717 04:38:33.854159  6330 leveldb.cpp:343] Persisting action (136 bytes) to leveldb took 9.436644ms
      I0717 04:38:33.854676  6330 replica.cpp:676] Persisted action at 1
      I0717 04:38:33.854869  6330 replica.cpp:661] Replica learned APPEND action at position 1
      I0717 04:38:33.855674  6330 registrar.cpp:479] Successfully updated 'registry'
      I0717 04:38:33.855931  6327 log.cpp:699] Attempting to truncate the log to 1
      I0717 04:38:33.856046  6327 coordinator.cpp:340] Coordinator attempting to write TRUNCATE action at position 2
      I0717 04:38:33.856282  6327 replica.cpp:508] Replica received write request for position 2
      I0717 04:38:33.856947  6330 registrar.cpp:372] Successfully recovered registrar
      I0717 04:38:33.857449  6326 master.cpp:986] Recovered 0 slaves from the Registry (81B) ; allowing 10mins for slaves to re-register
      I0717 04:38:33.866941  6327 leveldb.cpp:343] Persisting action (16 bytes) to leveldb took 10.664049ms
      I0717 04:38:33.867005  6327 replica.cpp:676] Persisted action at 2
      I0717 04:38:33.867207  6327 replica.cpp:655] Replica received learned notice for position 2
      I0717 04:38:33.876960  6327 leveldb.cpp:343] Persisting action (18 bytes) to leveldb took 9.763477ms
      I0717 04:38:33.877111  6327 leveldb.cpp:401] Deleting ~1 keys from leveldb took 68801ns
      I0717 04:38:33.877128  6327 replica.cpp:676] Persisted action at 2
      I0717 04:38:33.877137  6327 replica.cpp:661] Replica learned TRUNCATE action at position 2
      I0717 04:38:34.199687  6329 slave.cpp:971] Will retry registration in 445.955946ms if necessary
      I0717 04:38:34.199873  6329 master.cpp:2789] Registering slave at slave(2)@127.0.1.1:36034 (saucy) with id 20140717-043833-16842879-36034-6300-0
      I0717 04:38:34.200040  6329 registrar.cpp:422] Attempting to update the 'registry'
      I0717 04:38:34.201582  6329 log.cpp:680] Attempting to append 287 bytes to the log
      I0717 04:38:34.201824  6326 coordinator.cpp:340] Coordinator attempting to write APPEND action at position 3
      I0717 04:38:34.202050  6326 replica.cpp:508] Replica received write request for position 3
      I0717 04:38:34.212792  6326 leveldb.cpp:343] Persisting action (306 bytes) to leveldb took 10.748217ms
      I0717 04:38:34.212858  6326 replica.cpp:676] Persisted action at 3
      I0717 04:38:34.213107  6326 replica.cpp:655] Replica received learned notice for position 3
      I0717 04:38:34.222514  6326 leveldb.cpp:343] Persisting action (308 bytes) to leveldb took 9.412656ms
      I0717 04:38:34.222570  6326 replica.cpp:676] Persisted action at 3
      I0717 04:38:34.222580  6326 replica.cpp:661] Replica learned APPEND action at position 3
      I0717 04:38:34.222975  6326 registrar.cpp:479] Successfully updated 'registry'
      I0717 04:38:34.223047  6326 log.cpp:699] Attempting to truncate the log to 3
      I0717 04:38:34.223096  6326 master.cpp:2829] Registered slave 20140717-043833-16842879-36034-6300-0 at slave(2)@127.0.1.1:36034 (saucy)
      I0717 04:38:34.223131  6326 master.cpp:3980] Adding slave 20140717-043833-16842879-36034-6300-0 at slave(2)@127.0.1.1:36034 (saucy) with cpus(*):1; mem(*):1001; disk(*):24988; ports(*):[31000-32000]
      I0717 04:38:34.223294  6326 coordinator.cpp:340] Coordinator attempting to write TRUNCATE action at position 4
      I0717 04:38:34.223394  6326 slave.cpp:767] Registered with master master@127.0.1.1:36034; given slave ID 20140717-043833-16842879-36034-6300-0
      I0717 04:38:34.223723  6326 slave.cpp:780] Checkpointing SlaveInfo to '/tmp/mesos-7TEGaz/1/meta/slaves/20140717-043833-16842879-36034-6300-0/slave.info'
      I0717 04:38:34.224496  6327 hierarchical_allocator_process.hpp:444] Added slave 20140717-043833-16842879-36034-6300-0 (saucy) with cpus(*):1; mem(*):1001; disk(*):24988; ports(*):[31000-32000] (and cpus(*):1; mem(*):1001; disk(*):24988; ports(*):[31000-32000] available)
      I0717 04:38:34.224586  6327 hierarchical_allocator_process.hpp:706] Performed allocation for slave 20140717-043833-16842879-36034-6300-0 in 58036ns
      I0717 04:38:34.224787  6327 replica.cpp:508] Replica received write request for position 4
      I0717 04:38:34.225518  6326 slave.cpp:2324] Received ping from slave-observer(1)@127.0.1.1:36034
      I0717 04:38:34.235950  6327 leveldb.cpp:343] Persisting action (16 bytes) to leveldb took 11.169003ms
      I0717 04:38:34.236026  6327 replica.cpp:676] Persisted action at 4
      I0717 04:38:34.236246  6327 replica.cpp:655] Replica received learned notice for position 4
      I0717 04:38:34.245756  6327 leveldb.cpp:343] Persisting action (18 bytes) to leveldb took 9.498337ms
      I0717 04:38:34.245857  6327 leveldb.cpp:401] Deleting ~2 keys from leveldb took 55523ns
      I0717 04:38:34.245872  6327 replica.cpp:676] Persisted action at 4
      I0717 04:38:34.245882  6327 replica.cpp:661] Replica learned TRUNCATE action at position 4
      I0717 04:38:34.592147  6325 slave.cpp:971] Will retry registration in 1.92618421secs if necessary
      I0717 04:38:34.592283  6325 master.cpp:2789] Registering slave at slave(3)@127.0.1.1:36034 (saucy) with id 20140717-043833-16842879-36034-6300-1
      I0717 04:38:34.592387  6325 registrar.cpp:422] Attempting to update the 'registry'
      I0717 04:38:34.593571  6325 log.cpp:680] Attempting to append 451 bytes to the log
      I0717 04:38:34.593622  6325 coordinator.cpp:340] Coordinator attempting to write APPEND action at position 5
      I0717 04:38:34.593824  6325 replica.cpp:508] Replica received write request for position 5
      I0717 04:38:34.599802  6325 leveldb.cpp:343] Persisting action (470 bytes) to leveldb took 5.984064ms
      I0717 04:38:34.599870  6325 replica.cpp:676] Persisted action at 5
      I0717 04:38:34.600097  6325 replica.cpp:655] Replica received learned notice for position 5
      I0717 04:38:34.606058  6325 leveldb.cpp:343] Persisting action (472 bytes) to leveldb took 5.974228ms
      I0717 04:38:34.606154  6325 replica.cpp:676] Persisted action at 5
      I0717 04:38:34.606168  6325 replica.cpp:661] Replica learned APPEND action at position 5
      I0717 04:38:34.606600  6325 registrar.cpp:479] Successfully updated 'registry'
      I0717 04:38:34.606684  6325 log.cpp:699] Attempting to truncate the log to 5
      I0717 04:38:34.606732  6325 master.cpp:2829] Registered slave 20140717-043833-16842879-36034-6300-1 at slave(3)@127.0.1.1:36034 (saucy)
      I0717 04:38:34.606748  6325 master.cpp:3980] Adding slave 20140717-043833-16842879-36034-6300-1 at slave(3)@127.0.1.1:36034 (saucy) with cpus(*):1; mem(*):1001; disk(*):24988; ports(*):[31000-32000]
      I0717 04:38:34.606849  6325 coordinator.cpp:340] Coordinator attempting to write TRUNCATE action at position 6
      I0717 04:38:34.606914  6325 slave.cpp:767] Registered with master master@127.0.1.1:36034; given slave ID 20140717-043833-16842879-36034-6300-1
      I0717 04:38:34.607238  6328 hierarchical_allocator_process.hpp:444] Added slave 20140717-043833-16842879-36034-6300-1 (saucy) with cpus(*):1; mem(*):1001; disk(*):24988; ports(*):[31000-32000] (and cpus(*):1; mem(*):1001; disk(*):24988; ports(*):[31000-32000] available)
      I0717 04:38:34.607292  6328 hierarchical_allocator_process.hpp:706] Performed allocation for slave 20140717-043833-16842879-36034-6300-1 in 16983ns
      I0717 04:38:34.607431  6328 replica.cpp:508] Replica received write request for position 6
      I0717 04:38:34.608714  6325 slave.cpp:780] Checkpointing SlaveInfo to '/tmp/mesos-7TEGaz/2/meta/slaves/20140717-043833-16842879-36034-6300-1/slave.info'
      I0717 04:38:34.609246  6325 slave.cpp:2324] Received ping from slave-observer(2)@127.0.1.1:36034
      I0717 04:38:34.613265  6328 leveldb.cpp:343] Persisting action (16 bytes) to leveldb took 5.838248ms
      I0717 04:38:34.613322  6328 replica.cpp:676] Persisted action at 6
      I0717 04:38:34.613533  6328 replica.cpp:655] Replica received learned notice for position 6
      I0717 04:38:34.621480  6328 leveldb.cpp:343] Persisting action (18 bytes) to leveldb took 7.961456ms
      I0717 04:38:34.621608  6328 leveldb.cpp:401] Deleting ~2 keys from leveldb took 64709ns
      I0717 04:38:34.621624  6328 replica.cpp:676] Persisted action at 6
      I0717 04:38:34.621634  6328 replica.cpp:661] Replica learned TRUNCATE action at position 6
      I0717 04:38:34.638574  6328 slave.cpp:971] Will retry registration in 1.542495291secs if necessary
      I0717 04:38:34.638694  6328 master.cpp:2789] Registering slave at slave(1)@127.0.1.1:36034 (saucy) with id 20140717-043833-16842879-36034-6300-2
      I0717 04:38:34.638792  6328 registrar.cpp:422] Attempting to update the 'registry'
      I0717 04:38:34.640792  6328 log.cpp:680] Attempting to append 615 bytes to the log
      I0717 04:38:34.641330  6328 coordinator.cpp:340] Coordinator attempting to write APPEND action at position 7
      I0717 04:38:34.641945  6324 replica.cpp:508] Replica received write request for position 7
      I0717 04:38:34.647377  6324 leveldb.cpp:343] Persisting action (634 bytes) to leveldb took 5.428538ms
      I0717 04:38:34.647445  6324 replica.cpp:676] Persisted action at 7
      I0717 04:38:34.647665  6324 replica.cpp:655] Replica received learned notice for position 7
      I0717 04:38:34.655622  6324 leveldb.cpp:343] Persisting action (636 bytes) to leveldb took 8.023735ms
      I0717 04:38:34.655812  6324 replica.cpp:676] Persisted action at 7
      I0717 04:38:34.655827  6324 replica.cpp:661] Replica learned APPEND action at position 7
      I0717 04:38:34.656388  6324 registrar.cpp:479] Successfully updated 'registry'
      I0717 04:38:34.656471  6324 log.cpp:699] Attempting to truncate the log to 7
      I0717 04:38:34.656532  6324 master.cpp:2829] Registered slave 20140717-043833-16842879-36034-6300-2 at slave(1)@127.0.1.1:36034 (saucy)
      I0717 04:38:34.656548  6324 master.cpp:3980] Adding slave 20140717-043833-16842879-36034-6300-2 at slave(1)@127.0.1.1:36034 (saucy) with cpus(*):1; mem(*):1001; disk(*):24988; ports(*):[31000-32000]
      I0717 04:38:34.656697  6324 coordinator.cpp:340] Coordinator attempting to write TRUNCATE action at position 8
      I0717 04:38:34.656795  6324 slave.cpp:767] Registered with master master@127.0.1.1:36034; given slave ID 20140717-043833-16842879-36034-6300-2
      I0717 04:38:34.657362  6324 slave.cpp:780] Checkpointing SlaveInfo to '/tmp/mesos-7TEGaz/0/meta/slaves/20140717-043833-16842879-36034-6300-2/slave.info'
      I0717 04:38:34.658473  6323 replica.cpp:508] Replica received write request for position 8
      I0717 04:38:34.660092  6327 hierarchical_allocator_process.hpp:444] Added slave 20140717-043833-16842879-36034-6300-2 (saucy) with cpus(*):1; mem(*):1001; disk(*):24988; ports(*):[31000-32000] (and cpus(*):1; mem(*):1001; disk(*):24988; ports(*):[31000-32000] available)
      I0717 04:38:34.660212  6327 hierarchical_allocator_process.hpp:706] Performed allocation for slave 20140717-043833-16842879-36034-6300-2 in 33294ns
      I0717 04:38:34.660652  6324 slave.cpp:2324] Received ping from slave-observer(3)@127.0.1.1:36034
      I0717 04:38:34.668640  6323 leveldb.cpp:343] Persisting action (16 bytes) to leveldb took 10.166138ms
      I0717 04:38:34.668723  6323 replica.cpp:676] Persisted action at 8
      I0717 04:38:34.668963  6323 replica.cpp:655] Replica received learned notice for position 8
      I0717 04:38:34.675166  6323 leveldb.cpp:343] Persisting action (18 bytes) to leveldb took 6.214981ms
      I0717 04:38:34.675297  6323 leveldb.cpp:401] Deleting ~2 keys from leveldb took 66810ns
      I0717 04:38:34.675313  6323 replica.cpp:676] Persisted action at 8
      I0717 04:38:34.675323  6323 replica.cpp:661] Replica learned TRUNCATE action at position 8
      I0717 04:38:34.792398  6330 hierarchical_allocator_process.hpp:686] Performed allocation for 3 slaves in 79984ns
      I0717 04:38:35.792776  6330 hierarchical_allocator_process.hpp:686] Performed allocation for 3 slaves in 68027ns
      2014-07-17 04:38:35,951:2966(0x2ae1ab9c4700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:56783] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
      I0717 04:38:36.793910  6330 hierarchical_allocator_process.hpp:686] Performed allocation for 3 slaves in 156643ns
      I0717 04:38:37.794284  6330 hierarchical_allocator_process.hpp:686] Performed allocation for 3 slaves in 66944ns
      I0717 04:38:38.272083  6273 exec.cpp:85] Committing suicide by killing the process group
      I0717 04:38:38.273043  6297 exec.cpp:85] Committing suicide by killing the process group
      I0717 04:38:38.281566  6286 exec.cpp:85] Committing suicide by killing the process group
      I0717 04:38:38.789891  6330 master.cpp:122] No whitelist given. Advertising offers for all slaves
      I0717 04:38:38.795310  6330 hierarchical_allocator_process.hpp:686] Performed allocation for 3 slaves in 75086ns
      W0717 04:38:38.812660  6330 scheduler.cpp:542] Authentication timed out
      I0717 04:38:38.812870  6330 scheduler.cpp:501] Failed to authenticate with master master@127.0.1.1:36034: Authentication discarded
      I0717 04:38:38.812948  6330 scheduler.cpp:450] Authenticating with master master@127.0.1.1:36034
      I0717 04:38:38.813112  6330 authenticatee.hpp:128] Creating new client SASL connection
      I0717 04:38:38.813555  6330 master.cpp:3512] Authenticating scheduler(1)@127.0.1.1:36034
      I0717 04:38:38.813971  6330 authenticator.hpp:94] Initializing server SASL
      I0717 04:38:38.814482  6330 auxprop.cpp:45] Initialized in-memory auxiliary property plugin
      I0717 04:38:38.814496  6330 authenticator.hpp:156] Creating new server SASL connection
      I0717 04:38:38.814681  6330 authenticatee.hpp:219] Received SASL authentication mechanisms: CRAM-MD5
      I0717 04:38:38.814713  6330 authenticatee.hpp:245] Attempting to authenticate with mechanism 'CRAM-MD5'
      I0717 04:38:38.814751  6330 authenticator.hpp:262] Received SASL authentication start
      I0717 04:38:38.814808  6330 authenticator.hpp:384] Authentication requires more steps
      I0717 04:38:38.814847  6330 authenticatee.hpp:265] Received SASL authentication step
      I0717 04:38:38.814884  6330 authenticator.hpp:290] Received SASL authentication step
      I0717 04:38:38.814901  6330 auxprop.cpp:81] Request to lookup properties for user: 'test-principal' realm: 'saucy' server FQDN: 'saucy' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false 
      I0717 04:38:38.814908  6330 auxprop.cpp:153] Looking up auxiliary property '*userPassword'
      I0717 04:38:38.814930  6330 auxprop.cpp:153] Looking up auxiliary property '*cmusaslsecretCRAM-MD5'
      I0717 04:38:38.814940  6330 auxprop.cpp:81] Request to lookup properties for user: 'test-principal' realm: 'saucy' server FQDN: 'saucy' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true 
      I0717 04:38:38.814946  6330 auxprop.cpp:103] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true
      I0717 04:38:38.814950  6330 auxprop.cpp:103] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true
      I0717 04:38:38.814961  6330 authenticator.hpp:376] Authentication success
      I0717 04:38:38.815003  6330 authenticatee.hpp:305] Authentication success
      I0717 04:38:38.815032  6330 master.cpp:3552] Successfully authenticated principal 'test-principal' at scheduler(1)@127.0.1.1:36034
      I0717 04:38:38.815141  6330 scheduler.cpp:520] Successfully authenticated with master master@127.0.1.1:36034
      I0717 04:38:38.816431  6329 master.cpp:1247] Received registration request from scheduler(1)@127.0.1.1:36034
      I0717 04:38:38.816467  6329 master.cpp:1207] Authorizing framework principal 'test-principal' to receive offers for role '*'
      I0717 04:38:38.816725  6329 master.cpp:1306] Registering framework 20140717-043833-16842879-36034-6300-0000 at scheduler(1)@127.0.1.1:36034
      I0717 04:38:38.816964  6329 scheduler.cpp:569] Enqueuing event 1 from master@127.0.1.1:36034
      I0717 04:38:38.817111  6326 hierarchical_allocator_process.hpp:331] Added framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:38.817181  6326 hierarchical_allocator_process.hpp:750] Offering cpus(*):1; mem(*):1001; disk(*):24988; ports(*):[31000-32000] on slave 20140717-043833-16842879-36034-6300-0 to framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:38.817320  6326 hierarchical_allocator_process.hpp:750] Offering cpus(*):1; mem(*):1001; disk(*):24988; ports(*):[31000-32000] on slave 20140717-043833-16842879-36034-6300-1 to framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:38.817379  6326 hierarchical_allocator_process.hpp:750] Offering cpus(*):1; mem(*):1001; disk(*):24988; ports(*):[31000-32000] on slave 20140717-043833-16842879-36034-6300-2 to framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:38.817484  6326 hierarchical_allocator_process.hpp:686] Performed allocation for 3 slaves in 363883ns
      I0717 04:38:38.817601  6326 master.hpp:800] Adding offer 20140717-043833-16842879-36034-6300-0 with resources cpus(*):1; mem(*):1001; disk(*):24988; ports(*):[31000-32000] on slave 20140717-043833-16842879-36034-6300-1 (saucy)
      I0717 04:38:38.817687  6326 master.hpp:800] Adding offer 20140717-043833-16842879-36034-6300-1 with resources cpus(*):1; mem(*):1001; disk(*):24988; ports(*):[31000-32000] on slave 20140717-043833-16842879-36034-6300-2 (saucy)
      I0717 04:38:38.817745  6326 master.hpp:800] Adding offer 20140717-043833-16842879-36034-6300-2 with resources cpus(*):1; mem(*):1001; disk(*):24988; ports(*):[31000-32000] on slave 20140717-043833-16842879-36034-6300-0 (saucy)
      I0717 04:38:38.817777  6326 master.cpp:3459] Sending 3 offers to framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:38.817944  6329 scheduler.cpp:569] Enqueuing event 3 from master@127.0.1.1:36034
      
      Received a REGISTERED event
      Framework '20140717-043833-16842879-36034-6300-0000' registered with Master '20140717-043833-16842879-36034-6300'
      
      Received an OFFERS event
      Offer '20140717-043833-16842879-36034-6300-0' has cpus(*):1; mem(*):1001; disk(*):24988; ports(*):[31000-32000]
      Starting task 0 on saucy
      Offer '20140717-043833-16842879-36034-6300-1' has cpus(*):1; mem(*):1001; disk(*):24988; ports(*):[31000-32000]
      Starting task 1 on saucy
      Offer '20140717-043833-16842879-36034-6300-2' has cpus(*):1; mem(*):1001; disk(*):24988; ports(*):[31000-32000]
      Starting task 2 on saucy
      I0717 04:38:38.819190  6328 master.hpp:810] Removing offer 20140717-043833-16842879-36034-6300-0 with resources cpus(*):1; mem(*):1001; disk(*):24988; ports(*):[31000-32000] on slave 20140717-043833-16842879-36034-6300-1 (saucy)
      I0717 04:38:38.819252  6328 master.cpp:2133] Processing reply for offers: [ 20140717-043833-16842879-36034-6300-0 ] on slave 20140717-043833-16842879-36034-6300-1 at slave(3)@127.0.1.1:36034 (saucy) for framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:38.819340  6328 master.cpp:2219] Authorizing framework principal 'test-principal' to launch task 0 as user 'jenkins'
      I0717 04:38:38.819581  6328 master.hpp:810] Removing offer 20140717-043833-16842879-36034-6300-1 with resources cpus(*):1; mem(*):1001; disk(*):24988; ports(*):[31000-32000] on slave 20140717-043833-16842879-36034-6300-2 (saucy)
      I0717 04:38:38.819622  6328 master.cpp:2133] Processing reply for offers: [ 20140717-043833-16842879-36034-6300-1 ] on slave 20140717-043833-16842879-36034-6300-2 at slave(1)@127.0.1.1:36034 (saucy) for framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:38.819644  6328 master.cpp:2219] Authorizing framework principal 'test-principal' to launch task 1 as user 'jenkins'
      I0717 04:38:38.819766  6328 master.hpp:810] Removing offer 20140717-043833-16842879-36034-6300-2 with resources cpus(*):1; mem(*):1001; disk(*):24988; ports(*):[31000-32000] on slave 20140717-043833-16842879-36034-6300-0 (saucy)
      I0717 04:38:38.819804  6328 master.cpp:2133] Processing reply for offers: [ 20140717-043833-16842879-36034-6300-2 ] on slave 20140717-043833-16842879-36034-6300-0 at slave(2)@127.0.1.1:36034 (saucy) for framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:38.819824  6328 master.cpp:2219] Authorizing framework principal 'test-principal' to launch task 2 as user 'jenkins'
      I0717 04:38:38.820184  6328 master.hpp:772] Adding task 0 with resources cpus(*):1; mem(*):32 on slave 20140717-043833-16842879-36034-6300-1 (saucy)
      I0717 04:38:38.820211  6328 master.cpp:2285] Launching task 0 of framework 20140717-043833-16842879-36034-6300-0000 with resources cpus(*):1; mem(*):32 on slave 20140717-043833-16842879-36034-6300-1 at slave(3)@127.0.1.1:36034 (saucy)
      I0717 04:38:38.820349  6328 master.hpp:772] Adding task 1 with resources cpus(*):1; mem(*):32 on slave 20140717-043833-16842879-36034-6300-2 (saucy)
      I0717 04:38:38.820374  6328 master.cpp:2285] Launching task 1 of framework 20140717-043833-16842879-36034-6300-0000 with resources cpus(*):1; mem(*):32 on slave 20140717-043833-16842879-36034-6300-2 at slave(1)@127.0.1.1:36034 (saucy)
      I0717 04:38:38.820462  6328 master.hpp:772] Adding task 2 with resources cpus(*):1; mem(*):32 on slave 20140717-043833-16842879-36034-6300-0 (saucy)
      I0717 04:38:38.820484  6328 master.cpp:2285] Launching task 2 of framework 20140717-043833-16842879-36034-6300-0000 with resources cpus(*):1; mem(*):32 on slave 20140717-043833-16842879-36034-6300-0 at slave(2)@127.0.1.1:36034 (saucy)
      I0717 04:38:38.820603  6328 slave.cpp:1002] Got assigned task 0 for framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:38.820924  6328 slave.cpp:1112] Launching task 0 for framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:38.821118  6325 hierarchical_allocator_process.hpp:546] Framework 20140717-043833-16842879-36034-6300-0000 left mem(*):969; disk(*):24988; ports(*):[31000-32000] unused on slave 20140717-043833-16842879-36034-6300-1
      I0717 04:38:38.821204  6325 hierarchical_allocator_process.hpp:588] Framework 20140717-043833-16842879-36034-6300-0000 filtered slave 20140717-043833-16842879-36034-6300-1 for 5secs
      I0717 04:38:38.821250  6325 hierarchical_allocator_process.hpp:546] Framework 20140717-043833-16842879-36034-6300-0000 left mem(*):969; disk(*):24988; ports(*):[31000-32000] unused on slave 20140717-043833-16842879-36034-6300-2
      I0717 04:38:38.821295  6325 hierarchical_allocator_process.hpp:588] Framework 20140717-043833-16842879-36034-6300-0000 filtered slave 20140717-043833-16842879-36034-6300-2 for 5secs
      I0717 04:38:38.821316  6325 hierarchical_allocator_process.hpp:546] Framework 20140717-043833-16842879-36034-6300-0000 left mem(*):969; disk(*):24988; ports(*):[31000-32000] unused on slave 20140717-043833-16842879-36034-6300-0
      I0717 04:38:38.821352  6325 hierarchical_allocator_process.hpp:588] Framework 20140717-043833-16842879-36034-6300-0000 filtered slave 20140717-043833-16842879-36034-6300-0 for 5secs
      I0717 04:38:38.821387  6325 slave.cpp:1002] Got assigned task 1 for framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:38.821530  6325 slave.cpp:1112] Launching task 1 for framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:38.823005  6325 slave.cpp:1222] Queuing task '1' for executor default of framework '20140717-043833-16842879-36034-6300-0000
      I0717 04:38:38.823074  6325 slave.cpp:1002] Got assigned task 2 for framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:38.823204  6325 slave.cpp:1112] Launching task 2 for framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:38.824417  6325 slave.cpp:1222] Queuing task '2' for executor default of framework '20140717-043833-16842879-36034-6300-0000
      I0717 04:38:38.824635  6325 containerizer.cpp:427] Starting container '7da37ada-321a-4bc7-94dd-04474ca579f2' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000'
      I0717 04:38:38.824947  6325 containerizer.cpp:427] Starting container '6a0dc6b1-3333-4d96-9daf-c09938254b7c' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000'
      I0717 04:38:38.825068  6327 slave.cpp:561] Successfully attached file '/tmp/mesos-7TEGaz/0/slaves/20140717-043833-16842879-36034-6300-2/frameworks/20140717-043833-16842879-36034-6300-0000/executors/default/runs/7da37ada-321a-4bc7-94dd-04474ca579f2'
      I0717 04:38:38.825130  6323 slave.cpp:561] Successfully attached file '/tmp/mesos-7TEGaz/1/slaves/20140717-043833-16842879-36034-6300-0/frameworks/20140717-043833-16842879-36034-6300-0000/executors/default/runs/6a0dc6b1-3333-4d96-9daf-c09938254b7c'
      I0717 04:38:38.831241  6328 slave.cpp:1222] Queuing task '0' for executor default of framework '20140717-043833-16842879-36034-6300-0000
      I0717 04:38:38.833143  6324 containerizer.cpp:427] Starting container '7f0d6943-0a0e-44d0-bcdc-ba6073506247' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000'
      I0717 04:38:38.834477  6327 launcher.cpp:137] Forked child with pid '6333' for container '7da37ada-321a-4bc7-94dd-04474ca579f2'
      I0717 04:38:38.834861  6329 slave.cpp:561] Successfully attached file '/tmp/mesos-7TEGaz/2/slaves/20140717-043833-16842879-36034-6300-1/frameworks/20140717-043833-16842879-36034-6300-0000/executors/default/runs/7f0d6943-0a0e-44d0-bcdc-ba6073506247'
      I0717 04:38:38.836951  6329 containerizer.cpp:537] Fetching URIs for container '7da37ada-321a-4bc7-94dd-04474ca579f2' using command '/var/jenkins/workspace/mesos-ubuntu-13.10-clang/src/mesos-fetcher'
      I0717 04:38:38.838197  6324 launcher.cpp:137] Forked child with pid '6334' for container '7f0d6943-0a0e-44d0-bcdc-ba6073506247'
      I0717 04:38:38.838896  6324 containerizer.cpp:537] Fetching URIs for container '7f0d6943-0a0e-44d0-bcdc-ba6073506247' using command '/var/jenkins/workspace/mesos-ubuntu-13.10-clang/src/mesos-fetcher'
      I0717 04:38:38.850445  6325 launcher.cpp:137] Forked child with pid '6342' for container '6a0dc6b1-3333-4d96-9daf-c09938254b7c'
      I0717 04:38:38.865761  6325 containerizer.cpp:537] Fetching URIs for container '6a0dc6b1-3333-4d96-9daf-c09938254b7c' using command '/var/jenkins/workspace/mesos-ubuntu-13.10-clang/src/mesos-fetcher'
      2014-07-17 04:38:39,285:2966(0x2ae1ab9c4700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:56783] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
      I0717 04:38:39.796236  6327 hierarchical_allocator_process.hpp:833] Filtered mem(*):969; disk(*):24988; ports(*):[31000-32000] on slave 20140717-043833-16842879-36034-6300-0 for framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:39.796380  6327 hierarchical_allocator_process.hpp:833] Filtered mem(*):969; disk(*):24988; ports(*):[31000-32000] on slave 20140717-043833-16842879-36034-6300-1 for framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:39.796411  6327 hierarchical_allocator_process.hpp:833] Filtered mem(*):969; disk(*):24988; ports(*):[31000-32000] on slave 20140717-043833-16842879-36034-6300-2 for framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:39.796427  6327 hierarchical_allocator_process.hpp:686] Performed allocation for 3 slaves in 356872ns
      I0717 04:38:39.853142  6326 slave.cpp:2469] Monitoring executor 'default' of framework '20140717-043833-16842879-36034-6300-0000' in container '7da37ada-321a-4bc7-94dd-04474ca579f2'
      I0717 04:38:39.877231  6323 slave.cpp:2469] Monitoring executor 'default' of framework '20140717-043833-16842879-36034-6300-0000' in container '7f0d6943-0a0e-44d0-bcdc-ba6073506247'
      I0717 04:38:39.897307  6327 slave.cpp:2469] Monitoring executor 'default' of framework '20140717-043833-16842879-36034-6300-0000' in container '6a0dc6b1-3333-4d96-9daf-c09938254b7c'
      WARNING: Logging before InitGoogleLogging() is written to STDERR
      I0717 04:38:39.982028  6435 process.cpp:1671] libprocess is initialized on 127.0.1.1:51944 for 8 cpus
      I0717 04:38:39.982995  6435 exec.cpp:131] Version: 0.20.0
      I0717 04:38:39.997442  6486 exec.cpp:181] Executor started at: executor(1)@127.0.1.1:51944 with pid 6435
      I0717 04:38:40.001618  6327 slave.cpp:1733] Got registration for executor 'default' of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.002396  6327 slave.cpp:1852] Flushing queued task 1 for executor 'default' of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.003772  6486 exec.cpp:205] Executor registered on slave 20140717-043833-16842879-36034-6300-2
      Registered executor on saucy
      I0717 04:38:40.004578  6486 exec.cpp:217] Executor::registered took 39018ns
      I0717 04:38:40.005199  6485 exec.cpp:292] Executor asked to run task '1'
      Starting task 1
      Finishing task 1
      I0717 04:38:40.005265  6485 exec.cpp:301] Executor::launchTask took 53197ns
      I0717 04:38:40.006037  6485 exec.cpp:524] Executor sending status update TASK_RUNNING (UUID: e3173ae0-6a38-4a4a-bb3d-7607dd065010) for task 1 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.006904  6485 exec.cpp:524] Executor sending status update TASK_FINISHED (UUID: d09b8387-ff16-4801-8f92-fa0428fb1332) for task 1 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.007434  6331 process.cpp:1098] Socket closed while receiving
      I0717 04:38:40.007632  6329 slave.cpp:2087] Handling status update TASK_RUNNING (UUID: e3173ae0-6a38-4a4a-bb3d-7607dd065010) for task 1 of framework 20140717-043833-16842879-36034-6300-0000 from executor(1)@127.0.1.1:51944
      I0717 04:38:40.007812  6329 slave.cpp:2087] Handling status update TASK_FINISHED (UUID: d09b8387-ff16-4801-8f92-fa0428fb1332) for task 1 of framework 20140717-043833-16842879-36034-6300-0000 from executor(1)@127.0.1.1:51944
      I0717 04:38:40.007835  6329 slave.cpp:3769] Terminating task 1
      I0717 04:38:40.007931  6329 status_update_manager.cpp:320] Received status update TASK_RUNNING (UUID: e3173ae0-6a38-4a4a-bb3d-7607dd065010) for task 1 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.007958  6329 status_update_manager.cpp:499] Creating StatusUpdate stream for task 1 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.008110  6329 status_update_manager.cpp:373] Forwarding status update TASK_RUNNING (UUID: e3173ae0-6a38-4a4a-bb3d-7607dd065010) for task 1 of framework 20140717-043833-16842879-36034-6300-0000 to master@127.0.1.1:36034
      I0717 04:38:40.008378  6329 master.cpp:3120] Status update TASK_RUNNING (UUID: e3173ae0-6a38-4a4a-bb3d-7607dd065010) for task 1 of framework 20140717-043833-16842879-36034-6300-0000 from slave 20140717-043833-16842879-36034-6300-2 at slave(1)@127.0.1.1:36034 (saucy)
      I0717 04:38:40.008409  6329 slave.cpp:2245] Status update manager successfully handled status update TASK_RUNNING (UUID: e3173ae0-6a38-4a4a-bb3d-7607dd065010) for task 1 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.008416  6329 slave.cpp:2251] Sending acknowledgement for status update TASK_RUNNING (UUID: e3173ae0-6a38-4a4a-bb3d-7607dd065010) for task 1 of framework 20140717-043833-16842879-36034-6300-0000 to executor(1)@127.0.1.1:51944
      I0717 04:38:40.008640  6329 scheduler.cpp:569] Enqueuing event 5 from master@127.0.1.1:36034
      WARNING: Logging before InitGoogleLogging() is written to STDERR
      I0717 04:38:40.011669  6447 process.cpp:1671] libprocess is initialized on 127.0.1.1:48757 for 8 cpus
      I0717 04:38:40.012619  6447 exec.cpp:131] Version: 0.20.0
      I0717 04:38:40.017104  6488 process.cpp:1037] Socket closed while receiving
      I0717 04:38:40.017566  6324 status_update_manager.cpp:320] Received status update TASK_FINISHED (UUID: d09b8387-ff16-4801-8f92-fa0428fb1332) for task 1 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.017638  6324 slave.cpp:2245] Status update manager successfully handled status update TASK_FINISHED (UUID: d09b8387-ff16-4801-8f92-fa0428fb1332) for task 1 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.017648  6324 slave.cpp:2251] Sending acknowledgement for status update TASK_FINISHED (UUID: d09b8387-ff16-4801-8f92-fa0428fb1332) for task 1 of framework 20140717-043833-16842879-36034-6300-0000 to executor(1)@127.0.1.1:51944
      I0717 04:38:40.018242  6483 exec.cpp:338] Executor received status update acknowledgement e3173ae0-6a38-4a4a-bb3d-7607dd065010 for task 1 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.018740  6487 exec.cpp:338] Executor received status update acknowledgement d09b8387-ff16-4801-8f92-fa0428fb1332 for task 1 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.018936  6331 process.cpp:1098] Socket closed while receiving
      I0717 04:38:40.018997  6488 process.cpp:1037] Socket closed while receiving
      I0717 04:38:40.029072  6494 exec.cpp:181] Executor started at: executor(1)@127.0.1.1:48757 with pid 6447
      WARNING: Logging before InitGoogleLogging() is written to STDERR
      I0717 04:38:40.030581  6459 process.cpp:1671] libprocess is initialized on 127.0.1.1:58876 for 8 cpus
      I0717 04:38:40.031515  6459 exec.cpp:131] Version: 0.20.0
      I0717 04:38:40.033736  6324 slave.cpp:1733] Got registration for executor 'default' of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.034260  6324 slave.cpp:1852] Flushing queued task 0 for executor 'default' of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.034857  6494 exec.cpp:205] Executor registered on slave 20140717-043833-16842879-36034-6300-1
      Registered executor on saucy
      I0717 04:38:40.035632  6494 exec.cpp:217] Executor::registered took 40012ns
      I0717 04:38:40.036208  6496 exec.cpp:292] Executor asked to run task '0'
      Starting task 0
      Finishing task 0
      I0717 04:38:40.036279  6496 exec.cpp:301] Executor::launchTask took 59686ns
      I0717 04:38:40.037132  6496 exec.cpp:524] Executor sending status update TASK_RUNNING (UUID: bf026ea3-d325-4da9-96e4-9e2f3e564203) for task 0 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.037979  6496 exec.cpp:524] Executor sending status update TASK_FINISHED (UUID: 01578ed6-6524-4ad5-8d2d-3026a1c17b56) for task 0 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.039077  6505 exec.cpp:181] Executor started at: executor(1)@127.0.1.1:58876 with pid 6459
      I0717 04:38:40.039760  6331 process.cpp:1098] Socket closed while receiving
      I0717 04:38:40.040000  6327 slave.cpp:2087] Handling status update TASK_RUNNING (UUID: bf026ea3-d325-4da9-96e4-9e2f3e564203) for task 0 of framework 20140717-043833-16842879-36034-6300-0000 from executor(1)@127.0.1.1:48757
      I0717 04:38:40.040104  6327 slave.cpp:2087] Handling status update TASK_FINISHED (UUID: 01578ed6-6524-4ad5-8d2d-3026a1c17b56) for task 0 of framework 20140717-043833-16842879-36034-6300-0000 from executor(1)@127.0.1.1:48757
      I0717 04:38:40.040123  6327 slave.cpp:3769] Terminating task 0
      I0717 04:38:40.040189  6327 slave.cpp:1733] Got registration for executor 'default' of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.040387  6327 slave.cpp:1852] Flushing queued task 2 for executor 'default' of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.040452  6327 status_update_manager.cpp:320] Received status update TASK_RUNNING (UUID: bf026ea3-d325-4da9-96e4-9e2f3e564203) for task 0 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.040465  6327 status_update_manager.cpp:499] Creating StatusUpdate stream for task 0 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.040565  6327 status_update_manager.cpp:373] Forwarding status update TASK_RUNNING (UUID: bf026ea3-d325-4da9-96e4-9e2f3e564203) for task 0 of framework 20140717-043833-16842879-36034-6300-0000 to master@127.0.1.1:36034
      I0717 04:38:40.040818  6327 master.cpp:3120] Status update TASK_RUNNING (UUID: bf026ea3-d325-4da9-96e4-9e2f3e564203) for task 0 of framework 20140717-043833-16842879-36034-6300-0000 from slave 20140717-043833-16842879-36034-6300-1 at slave(3)@127.0.1.1:36034 (saucy)
      I0717 04:38:40.040848  6327 slave.cpp:2245] Status update manager successfully handled status update TASK_RUNNING (UUID: bf026ea3-d325-4da9-96e4-9e2f3e564203) for task 0 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.040855  6327 slave.cpp:2251] Sending acknowledgement for status update TASK_RUNNING (UUID: bf026ea3-d325-4da9-96e4-9e2f3e564203) for task 0 of framework 20140717-043833-16842879-36034-6300-0000 to executor(1)@127.0.1.1:48757
      I0717 04:38:40.041088  6497 process.cpp:1037] Socket closed while receiving
      I0717 04:38:40.041842  6493 exec.cpp:338] Executor received status update acknowledgement bf026ea3-d325-4da9-96e4-9e2f3e564203 for task 0 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.042143  6331 process.cpp:1098] Socket closed while receiving
      I0717 04:38:40.042202  6497 process.cpp:1037] Socket closed while receiving
      I0717 04:38:40.042575  6505 exec.cpp:205] Executor registered on slave 20140717-043833-16842879-36034-6300-0
      Registered executor on saucy
      I0717 04:38:40.043478  6505 exec.cpp:217] Executor::registered took 42500ns
      I0717 04:38:40.043810  6323 status_update_manager.cpp:320] Received status update TASK_FINISHED (UUID: 01578ed6-6524-4ad5-8d2d-3026a1c17b56) for task 0 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.043862  6323 slave.cpp:2245] Status update manager successfully handled status update TASK_FINISHED (UUID: 01578ed6-6524-4ad5-8d2d-3026a1c17b56) for task 0 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.043872  6323 slave.cpp:2251] Sending acknowledgement for status update TASK_FINISHED (UUID: 01578ed6-6524-4ad5-8d2d-3026a1c17b56) for task 0 of framework 20140717-043833-16842879-36034-6300-0000 to executor(1)@127.0.1.1:48757
      I0717 04:38:40.044559  6331 process.cpp:1098] Socket closed while receiving
      I0717 04:38:40.044724  6493 exec.cpp:338] Executor received status update acknowledgement 01578ed6-6524-4ad5-8d2d-3026a1c17b56 for task 0 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.044855  6506 process.cpp:1037] Socket closed while receiving
      I0717 04:38:40.045069  6503 exec.cpp:292] Executor asked to run task '2'
      Starting task 2
      Finishing task 2
      I0717 04:38:40.045124  6503 exec.cpp:301] Executor::launchTask took 43139ns
      I0717 04:38:40.045903  6503 exec.cpp:524] Executor sending status update TASK_RUNNING (UUID: da3ee0a4-533d-4b0a-b321-c979f203fa71) for task 2 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.046766  6503 exec.cpp:524] Executor sending status update TASK_FINISHED (UUID: 55d3a6ae-73bf-459a-9da0-72e6fe039311) for task 2 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.046989  6331 process.cpp:1098] Socket closed while receiving
      I0717 04:38:40.047068  6497 process.cpp:1037] Socket closed while receiving
      I0717 04:38:40.049463  6326 slave.cpp:2087] Handling status update TASK_RUNNING (UUID: da3ee0a4-533d-4b0a-b321-c979f203fa71) for task 2 of framework 20140717-043833-16842879-36034-6300-0000 from executor(1)@127.0.1.1:58876
      I0717 04:38:40.049573  6326 slave.cpp:2087] Handling status update TASK_FINISHED (UUID: 55d3a6ae-73bf-459a-9da0-72e6fe039311) for task 2 of framework 20140717-043833-16842879-36034-6300-0000 from executor(1)@127.0.1.1:58876
      I0717 04:38:40.049593  6326 slave.cpp:3769] Terminating task 2
      I0717 04:38:40.049650  6326 status_update_manager.cpp:320] Received status update TASK_RUNNING (UUID: da3ee0a4-533d-4b0a-b321-c979f203fa71) for task 2 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.049661  6326 status_update_manager.cpp:499] Creating StatusUpdate stream for task 2 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.049753  6326 status_update_manager.cpp:373] Forwarding status update TASK_RUNNING (UUID: da3ee0a4-533d-4b0a-b321-c979f203fa71) for task 2 of framework 20140717-043833-16842879-36034-6300-0000 to master@127.0.1.1:36034
      I0717 04:38:40.049957  6326 master.cpp:3120] Status update TASK_RUNNING (UUID: da3ee0a4-533d-4b0a-b321-c979f203fa71) for task 2 of framework 20140717-043833-16842879-36034-6300-0000 from slave 20140717-043833-16842879-36034-6300-0 at slave(2)@127.0.1.1:36034 (saucy)
      I0717 04:38:40.049981  6326 slave.cpp:2245] Status update manager successfully handled status update TASK_RUNNING (UUID: da3ee0a4-533d-4b0a-b321-c979f203fa71) for task 2 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.049989  6326 slave.cpp:2251] Sending acknowledgement for status update TASK_RUNNING (UUID: da3ee0a4-533d-4b0a-b321-c979f203fa71) for task 2 of framework 20140717-043833-16842879-36034-6300-0000 to executor(1)@127.0.1.1:58876
      I0717 04:38:40.051632  6502 exec.cpp:338] Executor received status update acknowledgement da3ee0a4-533d-4b0a-b321-c979f203fa71 for task 2 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.051846  6331 process.cpp:1098] Socket closed while receiving
      I0717 04:38:40.051908  6506 process.cpp:1037] Socket closed while receiving
      I0717 04:38:40.052304  6326 status_update_manager.cpp:320] Received status update TASK_FINISHED (UUID: 55d3a6ae-73bf-459a-9da0-72e6fe039311) for task 2 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.052378  6326 slave.cpp:2245] Status update manager successfully handled status update TASK_FINISHED (UUID: 55d3a6ae-73bf-459a-9da0-72e6fe039311) for task 2 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.052389  6326 slave.cpp:2251] Sending acknowledgement for status update TASK_FINISHED (UUID: 55d3a6ae-73bf-459a-9da0-72e6fe039311) for task 2 of framework 20140717-043833-16842879-36034-6300-0000 to executor(1)@127.0.1.1:58876
      I0717 04:38:40.052777  6502 exec.cpp:338] Executor received status update acknowledgement 55d3a6ae-73bf-459a-9da0-72e6fe039311 for task 2 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.052956  6331 process.cpp:1098] Socket closed while receiving
      I0717 04:38:40.053042  6506 process.cpp:1037] Socket closed while receiving
      I0717 04:38:40.797358  6328 hierarchical_allocator_process.hpp:833] Filtered mem(*):969; disk(*):24988; ports(*):[31000-32000] on slave 20140717-043833-16842879-36034-6300-0 for framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.797482  6328 hierarchical_allocator_process.hpp:833] Filtered mem(*):969; disk(*):24988; ports(*):[31000-32000] on slave 20140717-043833-16842879-36034-6300-1 for framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.797520  6328 hierarchical_allocator_process.hpp:833] Filtered mem(*):969; disk(*):24988; ports(*):[31000-32000] on slave 20140717-043833-16842879-36034-6300-2 for framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:40.797538  6328 hierarchical_allocator_process.hpp:686] Performed allocation for 3 slaves in 375909ns
      I0717 04:38:40.877815  6324 monitor.cpp:140] Failed to collect resource usage for container '7f0d6943-0a0e-44d0-bcdc-ba6073506247' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 7f0d6943-0a0e-44d0-bcdc-ba6073506247
      I0717 04:38:40.898144  6324 monitor.cpp:140] Failed to collect resource usage for container '6a0dc6b1-3333-4d96-9daf-c09938254b7c' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 6a0dc6b1-3333-4d96-9daf-c09938254b7c
      I0717 04:38:41.798256  6325 hierarchical_allocator_process.hpp:833] Filtered mem(*):969; disk(*):24988; ports(*):[31000-32000] on slave 20140717-043833-16842879-36034-6300-0 for framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:41.798368  6325 hierarchical_allocator_process.hpp:833] Filtered mem(*):969; disk(*):24988; ports(*):[31000-32000] on slave 20140717-043833-16842879-36034-6300-1 for framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:41.798399  6325 hierarchical_allocator_process.hpp:833] Filtered mem(*):969; disk(*):24988; ports(*):[31000-32000] on slave 20140717-043833-16842879-36034-6300-2 for framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:41.798424  6325 hierarchical_allocator_process.hpp:686] Performed allocation for 3 slaves in 343698ns
      I0717 04:38:41.878417  6325 monitor.cpp:140] Failed to collect resource usage for container '7f0d6943-0a0e-44d0-bcdc-ba6073506247' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 7f0d6943-0a0e-44d0-bcdc-ba6073506247
      I0717 04:38:41.898753  6325 monitor.cpp:140] Failed to collect resource usage for container '6a0dc6b1-3333-4d96-9daf-c09938254b7c' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 6a0dc6b1-3333-4d96-9daf-c09938254b7c
      2014-07-17 04:38:42,621:2966(0x2ae1ab9c4700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:56783] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
      I0717 04:38:42.799217  6324 hierarchical_allocator_process.hpp:833] Filtered mem(*):969; disk(*):24988; ports(*):[31000-32000] on slave 20140717-043833-16842879-36034-6300-0 for framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:42.799331  6324 hierarchical_allocator_process.hpp:833] Filtered mem(*):969; disk(*):24988; ports(*):[31000-32000] on slave 20140717-043833-16842879-36034-6300-1 for framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:42.799365  6324 hierarchical_allocator_process.hpp:833] Filtered mem(*):969; disk(*):24988; ports(*):[31000-32000] on slave 20140717-043833-16842879-36034-6300-2 for framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:42.799382  6324 hierarchical_allocator_process.hpp:686] Performed allocation for 3 slaves in 380133ns
      I0717 04:38:42.879386  6324 monitor.cpp:140] Failed to collect resource usage for container '7f0d6943-0a0e-44d0-bcdc-ba6073506247' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 7f0d6943-0a0e-44d0-bcdc-ba6073506247
      I0717 04:38:42.899734  6324 monitor.cpp:140] Failed to collect resource usage for container '6a0dc6b1-3333-4d96-9daf-c09938254b7c' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 6a0dc6b1-3333-4d96-9daf-c09938254b7c
      I0717 04:38:43.790885  6327 master.cpp:122] No whitelist given. Advertising offers for all slaves
      I0717 04:38:43.800112  6327 hierarchical_allocator_process.hpp:833] Filtered mem(*):969; disk(*):24988; ports(*):[31000-32000] on slave 20140717-043833-16842879-36034-6300-0 for framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:43.800199  6327 hierarchical_allocator_process.hpp:833] Filtered mem(*):969; disk(*):24988; ports(*):[31000-32000] on slave 20140717-043833-16842879-36034-6300-1 for framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:43.800228  6327 hierarchical_allocator_process.hpp:833] Filtered mem(*):969; disk(*):24988; ports(*):[31000-32000] on slave 20140717-043833-16842879-36034-6300-2 for framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:43.800245  6327 hierarchical_allocator_process.hpp:686] Performed allocation for 3 slaves in 218602ns
      I0717 04:38:43.880075  6327 monitor.cpp:140] Failed to collect resource usage for container '7f0d6943-0a0e-44d0-bcdc-ba6073506247' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 7f0d6943-0a0e-44d0-bcdc-ba6073506247
      I0717 04:38:43.900444  6327 monitor.cpp:140] Failed to collect resource usage for container '6a0dc6b1-3333-4d96-9daf-c09938254b7c' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 6a0dc6b1-3333-4d96-9daf-c09938254b7c
      I0717 04:38:44.801024  6326 hierarchical_allocator_process.hpp:686] Performed allocation for 3 slaves in 296707ns
      I0717 04:38:44.881173  6326 monitor.cpp:140] Failed to collect resource usage for container '7f0d6943-0a0e-44d0-bcdc-ba6073506247' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 7f0d6943-0a0e-44d0-bcdc-ba6073506247
      I0717 04:38:44.901456  6326 monitor.cpp:140] Failed to collect resource usage for container '6a0dc6b1-3333-4d96-9daf-c09938254b7c' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 6a0dc6b1-3333-4d96-9daf-c09938254b7c
      I0717 04:38:45.802383  6328 hierarchical_allocator_process.hpp:686] Performed allocation for 3 slaves in 152861ns
      I0717 04:38:45.881592  6328 monitor.cpp:140] Failed to collect resource usage for container '7f0d6943-0a0e-44d0-bcdc-ba6073506247' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 7f0d6943-0a0e-44d0-bcdc-ba6073506247
      I0717 04:38:45.901924  6328 monitor.cpp:140] Failed to collect resource usage for container '6a0dc6b1-3333-4d96-9daf-c09938254b7c' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 6a0dc6b1-3333-4d96-9daf-c09938254b7c
      2014-07-17 04:38:45,957:2966(0x2ae1ab9c4700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:56783] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
      I0717 04:38:46.803221  6323 hierarchical_allocator_process.hpp:686] Performed allocation for 3 slaves in 218158ns
      I0717 04:38:46.882403  6323 monitor.cpp:140] Failed to collect resource usage for container '7f0d6943-0a0e-44d0-bcdc-ba6073506247' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 7f0d6943-0a0e-44d0-bcdc-ba6073506247
      I0717 04:38:46.902801  6323 monitor.cpp:140] Failed to collect resource usage for container '6a0dc6b1-3333-4d96-9daf-c09938254b7c' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 6a0dc6b1-3333-4d96-9daf-c09938254b7c
      I0717 04:38:47.804126  6324 hierarchical_allocator_process.hpp:686] Performed allocation for 3 slaves in 284723ns
      I0717 04:38:47.883178  6324 monitor.cpp:140] Failed to collect resource usage for container '7f0d6943-0a0e-44d0-bcdc-ba6073506247' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 7f0d6943-0a0e-44d0-bcdc-ba6073506247
      I0717 04:38:47.903535  6324 monitor.cpp:140] Failed to collect resource usage for container '6a0dc6b1-3333-4d96-9daf-c09938254b7c' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 6a0dc6b1-3333-4d96-9daf-c09938254b7c
      I0717 04:38:48.792024  6325 master.cpp:122] No whitelist given. Advertising offers for all slaves
      I0717 04:38:48.805207  6325 hierarchical_allocator_process.hpp:686] Performed allocation for 3 slaves in 189717ns
      I0717 04:38:48.884423  6325 monitor.cpp:140] Failed to collect resource usage for container '7f0d6943-0a0e-44d0-bcdc-ba6073506247' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 7f0d6943-0a0e-44d0-bcdc-ba6073506247
      I0717 04:38:48.904686  6325 monitor.cpp:140] Failed to collect resource usage for container '6a0dc6b1-3333-4d96-9daf-c09938254b7c' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 6a0dc6b1-3333-4d96-9daf-c09938254b7c
      I0717 04:38:49.225215  6325 slave.cpp:2324] Received ping from slave-observer(1)@127.0.1.1:36034
      2014-07-17 04:38:49,293:2966(0x2ae1ab9c4700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:56783] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
      I0717 04:38:49.607985  6326 slave.cpp:2324] Received ping from slave-observer(2)@127.0.1.1:36034
      I0717 04:38:49.659140  6326 slave.cpp:2324] Received ping from slave-observer(3)@127.0.1.1:36034
      I0717 04:38:49.805444  6326 hierarchical_allocator_process.hpp:686] Performed allocation for 3 slaves in 115242ns
      I0717 04:38:49.885674  6326 monitor.cpp:140] Failed to collect resource usage for container '7f0d6943-0a0e-44d0-bcdc-ba6073506247' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 7f0d6943-0a0e-44d0-bcdc-ba6073506247
      I0717 04:38:49.905050  6326 monitor.cpp:140] Failed to collect resource usage for container '6a0dc6b1-3333-4d96-9daf-c09938254b7c' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 6a0dc6b1-3333-4d96-9daf-c09938254b7c
      W0717 04:38:50.009380  6326 status_update_manager.cpp:477] Resending status update TASK_RUNNING (UUID: e3173ae0-6a38-4a4a-bb3d-7607dd065010) for task 1 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:50.009464  6326 status_update_manager.cpp:373] Forwarding status update TASK_RUNNING (UUID: e3173ae0-6a38-4a4a-bb3d-7607dd065010) for task 1 of framework 20140717-043833-16842879-36034-6300-0000 to master@127.0.1.1:36034
      I0717 04:38:50.009923  6326 master.cpp:3120] Status update TASK_RUNNING (UUID: e3173ae0-6a38-4a4a-bb3d-7607dd065010) for task 1 of framework 20140717-043833-16842879-36034-6300-0000 from slave 20140717-043833-16842879-36034-6300-2 at slave(1)@127.0.1.1:36034 (saucy)
      W0717 04:38:50.041579  6326 status_update_manager.cpp:477] Resending status update TASK_RUNNING (UUID: bf026ea3-d325-4da9-96e4-9e2f3e564203) for task 0 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:50.041630  6326 status_update_manager.cpp:373] Forwarding status update TASK_RUNNING (UUID: bf026ea3-d325-4da9-96e4-9e2f3e564203) for task 0 of framework 20140717-043833-16842879-36034-6300-0000 to master@127.0.1.1:36034
      I0717 04:38:50.041787  6326 master.cpp:3120] Status update TASK_RUNNING (UUID: bf026ea3-d325-4da9-96e4-9e2f3e564203) for task 0 of framework 20140717-043833-16842879-36034-6300-0000 from slave 20140717-043833-16842879-36034-6300-1 at slave(3)@127.0.1.1:36034 (saucy)
      W0717 04:38:50.050722  6326 status_update_manager.cpp:477] Resending status update TASK_RUNNING (UUID: da3ee0a4-533d-4b0a-b321-c979f203fa71) for task 2 of framework 20140717-043833-16842879-36034-6300-0000
      I0717 04:38:50.050755  6326 status_update_manager.cpp:373] Forwarding status update TASK_RUNNING (UUID: da3ee0a4-533d-4b0a-b321-c979f203fa71) for task 2 of framework 20140717-043833-16842879-36034-6300-0000 to master@127.0.1.1:36034
      I0717 04:38:50.050868  6326 master.cpp:3120] Status update TASK_RUNNING (UUID: da3ee0a4-533d-4b0a-b321-c979f203fa71) for task 2 of framework 20140717-043833-16842879-36034-6300-0000 from slave 20140717-043833-16842879-36034-6300-0 at slave(2)@127.0.1.1:36034 (saucy)
      I0717 04:38:50.805856  6327 hierarchical_allocator_process.hpp:686] Performed allocation for 3 slaves in 165698ns
      I0717 04:38:50.886025  6327 monitor.cpp:140] Failed to collect resource usage for container '7f0d6943-0a0e-44d0-bcdc-ba6073506247' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 7f0d6943-0a0e-44d0-bcdc-ba6073506247
      I0717 04:38:50.905370  6327 monitor.cpp:140] Failed to collect resource usage for container '6a0dc6b1-3333-4d96-9daf-c09938254b7c' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 6a0dc6b1-3333-4d96-9daf-c09938254b7c
      I0717 04:38:51.806257  6323 hierarchical_allocator_process.hpp:686] Performed allocation for 3 slaves in 138388ns
      I0717 04:38:51.886451  6323 monitor.cpp:140] Failed to collect resource usage for container '7f0d6943-0a0e-44d0-bcdc-ba6073506247' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 7f0d6943-0a0e-44d0-bcdc-ba6073506247
      I0717 04:38:52.053143  6323 monitor.cpp:140] Failed to collect resource usage for container '6a0dc6b1-3333-4d96-9daf-c09938254b7c' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 6a0dc6b1-3333-4d96-9daf-c09938254b7c
      2014-07-17 04:38:52,637:2966(0x2ae1ab9c4700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:56783] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
      I0717 04:38:52.806648  6324 hierarchical_allocator_process.hpp:686] Performed allocation for 3 slaves in 238547ns
      I0717 04:38:53.033411  6324 monitor.cpp:140] Failed to collect resource usage for container '7f0d6943-0a0e-44d0-bcdc-ba6073506247' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 7f0d6943-0a0e-44d0-bcdc-ba6073506247
      I0717 04:38:53.053628  6324 monitor.cpp:140] Failed to collect resource usage for container '6a0dc6b1-3333-4d96-9daf-c09938254b7c' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 6a0dc6b1-3333-4d96-9daf-c09938254b7c
      I0717 04:38:53.792706  6328 master.cpp:122] No whitelist given. Advertising offers for all slaves
      I0717 04:38:53.970262  6328 hierarchical_allocator_process.hpp:686] Performed allocation for 3 slaves in 211830ns
      I0717 04:38:54.034374  6328 monitor.cpp:140] Failed to collect resource usage for container '7f0d6943-0a0e-44d0-bcdc-ba6073506247' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 7f0d6943-0a0e-44d0-bcdc-ba6073506247
      I0717 04:38:54.054642  6328 monitor.cpp:140] Failed to collect resource usage for container '6a0dc6b1-3333-4d96-9daf-c09938254b7c' for executor 'default' of framework '20140717-043833-16842879-36034-6300-0000': Unknown container: 6a0dc6b1-3333-4d96-9daf-c09938254b7c
      
      

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            vinodkone Vinod Kone
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment