[==========] Running 5 tests from 1 test case. [----------] Global test environment set-up. [----------] 5 tests from RemoteKsckTest [ RUN ] RemoteKsckTest.TestMasterOk WARNING: Logging before InitGoogleLogging() is written to STDERR I0219 21:02:54.601838 18449 test_util.cc:117] Using random seed: 1424408574 I0219 21:02:54.646947 18449 fs_manager.cc:193] Generated new instance metadata in path /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestMasterOk.1424408574588976-18449/minicluster-data/master-0-root/instance: uuid: "c62a51ece62c47d895a6e9bf888b0fb5" format_stamp: "Formatted at 2015-02-20 05:02:54 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:02:54.669968 18449 fs_manager.cc:131] Opened local filesystem: /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestMasterOk.1424408574588976-18449/minicluster-data/master-0-root uuid: "c62a51ece62c47d895a6e9bf888b0fb5" format_stamp: "Formatted at 2015-02-20 05:02:54 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:02:55.081701 18449 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:38899 I0219 21:02:55.082996 18449 webserver.cc:108] Starting webserver on 0.0.0.0:0 I0219 21:02:55.083106 18449 webserver.cc:117] Document root disabled I0219 21:02:55.085835 18449 webserver.cc:197] Webserver started. Bound to: http://0.0.0.0:57868/ I0219 21:02:55.136553 18756 tablet_bootstrap.cc:290] Tablet 00000000000000000000000000000000: Bootstrap starting. I0219 21:02:55.146303 18756 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 00000000000000000000000000000000 creating new one. I0219 21:02:55.149827 18756 log.cc:257] Log is configured to *not* fsync() on all Append() calls I0219 21:02:55.172013 18756 tablet_bootstrap.cc:290] Tablet 00000000000000000000000000000000: No bootstrap required, opened a new log I0219 21:02:55.206265 18785 change_config_transaction.cc:129] T 00000000000000000000000000000000 P c62a51ece62c47d895a6e9bf888b0fb5: Configuration changed Changed from: opid_index: -1 local: true peers { permanent_uuid: "c62a51ece62c47d895a6e9bf888b0fb5" role: LEADER } Changed to: opid_index: 1 local: true peers { permanent_uuid: "c62a51ece62c47d895a6e9bf888b0fb5" role: LEADER } I0219 21:02:55.207587 18785 sys_catalog.cc:202] T 00000000000000000000000000000000 P c62a51ece62c47d895a6e9bf888b0fb5 [sys.catalog]: SysCatalogTable state changed. New quorum config:opid_index: 1 local: true peers { permanent_uuid: "c62a51ece62c47d895a6e9bf888b0fb5" role: LEADER } I0219 21:02:55.207933 18785 sys_catalog.cc:205] T 00000000000000000000000000000000 P c62a51ece62c47d895a6e9bf888b0fb5 [sys.catalog]: This master's current role is: LEADER, previous role was: FOLLOWER I0219 21:02:55.207703 18756 sys_catalog.cc:268] T 00000000000000000000000000000000 P c62a51ece62c47d895a6e9bf888b0fb5 [sys.catalog]: configured and running, proceeding with master startup. I0219 21:02:55.220691 18793 catalog_manager.cc:397] Loading tables and tablets metadata into memory... W0219 21:02:55.236835 18798 catalog_manager.cc:270] Catalog manager is not initialized! I0219 21:02:55.293130 18449 fs_manager.cc:193] Generated new instance metadata in path /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestMasterOk.1424408574588976-18449/minicluster-data/ts-0-root/instance: uuid: "a23c963cc2c64632bbdea9c1539b30a8" format_stamp: "Formatted at 2015-02-20 05:02:55 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:02:55.320492 18449 fs_manager.cc:131] Opened local filesystem: /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestMasterOk.1424408574588976-18449/minicluster-data/ts-0-root uuid: "a23c963cc2c64632bbdea9c1539b30a8" format_stamp: "Formatted at 2015-02-20 05:02:55 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:02:55.480525 18449 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:47899 I0219 21:02:55.481175 18449 webserver.cc:108] Starting webserver on 0.0.0.0:0 I0219 21:02:55.481295 18449 webserver.cc:117] Document root disabled I0219 21:02:55.484086 18449 webserver.cc:197] Webserver started. Bound to: http://0.0.0.0:43465/ I0219 21:02:55.486825 18449 maintenance_manager.cc:111] MaintenanceManager: targeting memory size of 23.515860 GB I0219 21:02:55.505815 18872 heartbeater.cc:219] Connected to a leader master server at 127.0.0.1:38899 I0219 21:02:55.506131 18872 heartbeater.cc:289] Registering TS with master... I0219 21:02:55.506513 18872 heartbeater.cc:295] Sending a full tablet report to master... I0219 21:02:55.508919 18704 ts_manager.cc:66] Registered new tablet server { permanent_uuid: "a23c963cc2c64632bbdea9c1539b30a8" instance_seqno: 1424408575477866 } with Master I0219 21:02:55.541091 18449 fs_manager.cc:193] Generated new instance metadata in path /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestMasterOk.1424408574588976-18449/minicluster-data/ts-1-root/instance: uuid: "f368131df0684fcd94566a9538713a4c" format_stamp: "Formatted at 2015-02-20 05:02:55 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:02:55.567219 18449 fs_manager.cc:131] Opened local filesystem: /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestMasterOk.1424408574588976-18449/minicluster-data/ts-1-root uuid: "f368131df0684fcd94566a9538713a4c" format_stamp: "Formatted at 2015-02-20 05:02:55 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:02:55.703899 18449 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:44728 I0219 21:02:55.704558 18449 webserver.cc:108] Starting webserver on 0.0.0.0:0 I0219 21:02:55.704684 18449 webserver.cc:117] Document root disabled I0219 21:02:55.707957 18449 webserver.cc:197] Webserver started. Bound to: http://0.0.0.0:55374/ I0219 21:02:55.709431 18449 maintenance_manager.cc:111] MaintenanceManager: targeting memory size of 23.515860 GB I0219 21:02:55.717965 18933 heartbeater.cc:219] Connected to a leader master server at 127.0.0.1:38899 I0219 21:02:55.718293 18933 heartbeater.cc:289] Registering TS with master... I0219 21:02:55.718535 18933 heartbeater.cc:295] Sending a full tablet report to master... I0219 21:02:55.719969 18713 ts_manager.cc:66] Registered new tablet server { permanent_uuid: "f368131df0684fcd94566a9538713a4c" instance_seqno: 1424408575701527 } with Master I0219 21:02:55.763412 18449 fs_manager.cc:193] Generated new instance metadata in path /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestMasterOk.1424408574588976-18449/minicluster-data/ts-2-root/instance: uuid: "870aee24421545209809d234697decb0" format_stamp: "Formatted at 2015-02-20 05:02:55 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:02:55.795189 18449 fs_manager.cc:131] Opened local filesystem: /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestMasterOk.1424408574588976-18449/minicluster-data/ts-2-root uuid: "870aee24421545209809d234697decb0" format_stamp: "Formatted at 2015-02-20 05:02:55 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:02:55.944125 18449 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:35523 I0219 21:02:55.944716 18449 webserver.cc:108] Starting webserver on 0.0.0.0:0 I0219 21:02:55.944838 18449 webserver.cc:117] Document root disabled I0219 21:02:55.952853 18449 webserver.cc:197] Webserver started. Bound to: http://0.0.0.0:55687/ I0219 21:02:55.956081 18449 maintenance_manager.cc:111] MaintenanceManager: targeting memory size of 23.515860 GB I0219 21:02:55.972861 19003 heartbeater.cc:219] Connected to a leader master server at 127.0.0.1:38899 I0219 21:02:55.973018 19003 heartbeater.cc:289] Registering TS with master... I0219 21:02:55.973191 19003 heartbeater.cc:295] Sending a full tablet report to master... I0219 21:02:55.974778 18707 ts_manager.cc:66] Registered new tablet server { permanent_uuid: "870aee24421545209809d234697decb0" instance_seqno: 1424408575934166 } with Master I0219 21:02:55.975276 18449 mini_cluster.cc:276] 3 TS(s) registered with Master after 0.00733963s I0219 21:02:56.055387 18707 catalog_manager.cc:562] CreateTable from {real_user=jenkins, eff_user=} at 127.0.0.1:53929: name: "ksck-test-table" schema { columns { name: "key" type: UINT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION } columns { name: "int_val" type: UINT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION } } pre_split_keys: "\000\000\000\000" pre_split_keys: "\000\000\000\001" num_replicas: 3 I0219 21:02:56.166867 18826 tablet_service.cc:389] Processing CreateTablet for tablet b538f64abff6421b9b2fcbfc34fe9aa6 (table=ksck-test-table [id=af42d202884f44529e2e6c4caa703373]), range=["\x00\x00\x00\x01", ""] I0219 21:02:56.167068 18828 tablet_service.cc:389] Processing CreateTablet for tablet e557230bff5343aa94b77257f2e3d64e (table=ksck-test-table [id=af42d202884f44529e2e6c4caa703373]), range=["", "\x00\x00\x00\x00"] I0219 21:02:56.167098 18830 tablet_service.cc:389] Processing CreateTablet for tablet e17b0b00dda2421b9c3e9aa4de6ee00d (table=ksck-test-table [id=af42d202884f44529e2e6c4caa703373]), range=["\x00\x00\x00\x00", "\x00\x00\x00\x01"] I0219 21:02:56.169848 18907 tablet_service.cc:389] Processing CreateTablet for tablet b538f64abff6421b9b2fcbfc34fe9aa6 (table=ksck-test-table [id=af42d202884f44529e2e6c4caa703373]), range=["\x00\x00\x00\x01", ""] I0219 21:02:56.169569 18969 tablet_service.cc:389] Processing CreateTablet for tablet b538f64abff6421b9b2fcbfc34fe9aa6 (table=ksck-test-table [id=af42d202884f44529e2e6c4caa703373]), range=["\x00\x00\x00\x01", ""] I0219 21:02:56.171100 18910 tablet_service.cc:389] Processing CreateTablet for tablet e557230bff5343aa94b77257f2e3d64e (table=ksck-test-table [id=af42d202884f44529e2e6c4caa703373]), range=["", "\x00\x00\x00\x00"] I0219 21:02:56.172039 18970 tablet_service.cc:389] Processing CreateTablet for tablet e17b0b00dda2421b9c3e9aa4de6ee00d (table=ksck-test-table [id=af42d202884f44529e2e6c4caa703373]), range=["\x00\x00\x00\x00", "\x00\x00\x00\x01"] I0219 21:02:56.174582 18973 tablet_service.cc:389] Processing CreateTablet for tablet e557230bff5343aa94b77257f2e3d64e (table=ksck-test-table [id=af42d202884f44529e2e6c4caa703373]), range=["", "\x00\x00\x00\x00"] I0219 21:02:56.174366 18908 tablet_service.cc:389] Processing CreateTablet for tablet e17b0b00dda2421b9c3e9aa4de6ee00d (table=ksck-test-table [id=af42d202884f44529e2e6c4caa703373]), range=["\x00\x00\x00\x00", "\x00\x00\x00\x01"] I0219 21:02:56.398645 18830 ts_tablet_manager.cc:449] Registered tablet e17b0b00dda2421b9c3e9aa4de6ee00d I0219 21:02:56.468060 19065 ts_tablet_manager.cc:314] Bootstrapping tablet: e17b0b00dda2421b9c3e9aa4de6ee00d I0219 21:02:56.539896 19065 tablet_bootstrap.cc:290] Tablet e17b0b00dda2421b9c3e9aa4de6ee00d: Bootstrap starting. I0219 21:02:56.554517 19065 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: e17b0b00dda2421b9c3e9aa4de6ee00d creating new one. I0219 21:02:56.680177 19065 tablet_bootstrap.cc:290] Tablet e17b0b00dda2421b9c3e9aa4de6ee00d: No bootstrap required, opened a new log I0219 21:02:56.685756 19065 ts_tablet_manager.cc:319] Time spent tablet e17b0b00dda2421b9c3e9aa4de6ee00d bootstrap: real 0.216s user 0.014s sys 0.014s I0219 21:02:56.706533 19065 raft_consensus.cc:194] T e17b0b00dda2421b9c3e9aa4de6ee00d P a23c963cc2c64632bbdea9c1539b30a8 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0219 21:02:56.709987 19065 raft_consensus.cc:399] T e17b0b00dda2421b9c3e9aa4de6ee00d P a23c963cc2c64632bbdea9c1539b30a8 [FOLLOWER]: Becoming Follower/Learner. State: Replica: a23c963cc2c64632bbdea9c1539b30a8, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:02:56.712417 19065 consensus_queue.cc:127] T e17b0b00dda2421b9c3e9aa4de6ee00d P a23c963cc2c64632bbdea9c1539b30a8 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0219 21:02:56.717023 19065 ts_tablet_manager.cc:339] Time spent starting tablet e17b0b00dda2421b9c3e9aa4de6ee00d: real 0.031s user 0.010s sys 0.005s I0219 21:02:56.791867 18826 ts_tablet_manager.cc:449] Registered tablet b538f64abff6421b9b2fcbfc34fe9aa6 I0219 21:02:56.792824 19065 ts_tablet_manager.cc:314] Bootstrapping tablet: b538f64abff6421b9b2fcbfc34fe9aa6 I0219 21:02:56.799427 18969 ts_tablet_manager.cc:449] Registered tablet b538f64abff6421b9b2fcbfc34fe9aa6 I0219 21:02:56.810751 18907 ts_tablet_manager.cc:449] Registered tablet b538f64abff6421b9b2fcbfc34fe9aa6 I0219 21:02:56.813295 19065 tablet_bootstrap.cc:290] Tablet b538f64abff6421b9b2fcbfc34fe9aa6: Bootstrap starting. I0219 21:02:56.848067 18910 ts_tablet_manager.cc:449] Registered tablet e557230bff5343aa94b77257f2e3d64e I0219 21:02:56.849874 19195 ts_tablet_manager.cc:314] Bootstrapping tablet: b538f64abff6421b9b2fcbfc34fe9aa6 I0219 21:02:56.861289 19065 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: b538f64abff6421b9b2fcbfc34fe9aa6 creating new one. I0219 21:02:56.876929 18828 ts_tablet_manager.cc:449] Registered tablet e557230bff5343aa94b77257f2e3d64e I0219 21:02:56.878818 19199 ts_tablet_manager.cc:314] Bootstrapping tablet: b538f64abff6421b9b2fcbfc34fe9aa6 I0219 21:02:56.899303 19199 tablet_bootstrap.cc:290] Tablet b538f64abff6421b9b2fcbfc34fe9aa6: Bootstrap starting. I0219 21:02:56.903213 19195 tablet_bootstrap.cc:290] Tablet b538f64abff6421b9b2fcbfc34fe9aa6: Bootstrap starting. I0219 21:02:56.928290 19201 ts_tablet_manager.cc:314] Bootstrapping tablet: e557230bff5343aa94b77257f2e3d64e I0219 21:02:56.928491 19195 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: b538f64abff6421b9b2fcbfc34fe9aa6 creating new one. I0219 21:02:56.939409 19199 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: b538f64abff6421b9b2fcbfc34fe9aa6 creating new one. I0219 21:02:56.941609 19205 ts_tablet_manager.cc:314] Bootstrapping tablet: e557230bff5343aa94b77257f2e3d64e I0219 21:02:56.958503 18973 ts_tablet_manager.cc:449] Registered tablet e557230bff5343aa94b77257f2e3d64e I0219 21:02:56.979971 19065 tablet_bootstrap.cc:290] Tablet b538f64abff6421b9b2fcbfc34fe9aa6: No bootstrap required, opened a new log I0219 21:02:56.982970 19065 ts_tablet_manager.cc:319] Time spent tablet b538f64abff6421b9b2fcbfc34fe9aa6 bootstrap: real 0.190s user 0.011s sys 0.016s I0219 21:02:57.009419 19216 ts_tablet_manager.cc:314] Bootstrapping tablet: e557230bff5343aa94b77257f2e3d64e I0219 21:02:57.009135 19195 tablet_bootstrap.cc:290] Tablet b538f64abff6421b9b2fcbfc34fe9aa6: No bootstrap required, opened a new log I0219 21:02:57.012156 19201 tablet_bootstrap.cc:290] Tablet e557230bff5343aa94b77257f2e3d64e: Bootstrap starting. I0219 21:02:57.014220 19195 ts_tablet_manager.cc:319] Time spent tablet b538f64abff6421b9b2fcbfc34fe9aa6 bootstrap: real 0.164s user 0.018s sys 0.011s I0219 21:02:57.015393 19205 tablet_bootstrap.cc:290] Tablet e557230bff5343aa94b77257f2e3d64e: Bootstrap starting. I0219 21:02:57.041564 18908 ts_tablet_manager.cc:449] Registered tablet e17b0b00dda2421b9c3e9aa4de6ee00d I0219 21:02:57.044636 19205 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: e557230bff5343aa94b77257f2e3d64e creating new one. I0219 21:02:57.048636 19201 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: e557230bff5343aa94b77257f2e3d64e creating new one. I0219 21:02:57.052808 19199 tablet_bootstrap.cc:290] Tablet b538f64abff6421b9b2fcbfc34fe9aa6: No bootstrap required, opened a new log I0219 21:02:57.053841 19065 raft_consensus.cc:194] T b538f64abff6421b9b2fcbfc34fe9aa6 P a23c963cc2c64632bbdea9c1539b30a8 [CANDIDATE]: Replica starting. Triggering 0 pending transactions. I0219 21:02:57.059373 19195 raft_consensus.cc:194] T b538f64abff6421b9b2fcbfc34fe9aa6 P 870aee24421545209809d234697decb0 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0219 21:02:57.059648 19195 raft_consensus.cc:399] T b538f64abff6421b9b2fcbfc34fe9aa6 P 870aee24421545209809d234697decb0 [FOLLOWER]: Becoming Follower/Learner. State: Replica: 870aee24421545209809d234697decb0, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:02:57.060318 19195 consensus_queue.cc:127] T b538f64abff6421b9b2fcbfc34fe9aa6 P 870aee24421545209809d234697decb0 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0219 21:02:57.061389 19195 ts_tablet_manager.cc:339] Time spent starting tablet b538f64abff6421b9b2fcbfc34fe9aa6: real 0.046s user 0.009s sys 0.002s I0219 21:02:57.061519 19199 ts_tablet_manager.cc:319] Time spent tablet b538f64abff6421b9b2fcbfc34fe9aa6 bootstrap: real 0.179s user 0.015s sys 0.016s I0219 21:02:57.065768 19216 tablet_bootstrap.cc:290] Tablet e557230bff5343aa94b77257f2e3d64e: Bootstrap starting. I0219 21:02:57.072453 19216 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: e557230bff5343aa94b77257f2e3d64e creating new one. I0219 21:02:57.074690 19199 raft_consensus.cc:194] T b538f64abff6421b9b2fcbfc34fe9aa6 P f368131df0684fcd94566a9538713a4c [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0219 21:02:57.075819 19199 raft_consensus.cc:399] T b538f64abff6421b9b2fcbfc34fe9aa6 P f368131df0684fcd94566a9538713a4c [FOLLOWER]: Becoming Follower/Learner. State: Replica: f368131df0684fcd94566a9538713a4c, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:02:57.076660 19199 consensus_queue.cc:127] T b538f64abff6421b9b2fcbfc34fe9aa6 P f368131df0684fcd94566a9538713a4c [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0219 21:02:57.078604 19220 ts_tablet_manager.cc:314] Bootstrapping tablet: e17b0b00dda2421b9c3e9aa4de6ee00d I0219 21:02:57.091102 19199 ts_tablet_manager.cc:339] Time spent starting tablet b538f64abff6421b9b2fcbfc34fe9aa6: real 0.029s user 0.007s sys 0.003s I0219 21:02:57.115857 19205 tablet_bootstrap.cc:290] Tablet e557230bff5343aa94b77257f2e3d64e: No bootstrap required, opened a new log I0219 21:02:57.118397 19205 ts_tablet_manager.cc:319] Time spent tablet e557230bff5343aa94b77257f2e3d64e bootstrap: real 0.175s user 0.014s sys 0.020s I0219 21:02:57.120831 19220 tablet_bootstrap.cc:290] Tablet e17b0b00dda2421b9c3e9aa4de6ee00d: Bootstrap starting. I0219 21:02:57.121772 18970 ts_tablet_manager.cc:449] Registered tablet e17b0b00dda2421b9c3e9aa4de6ee00d I0219 21:02:57.122078 19195 ts_tablet_manager.cc:314] Bootstrapping tablet: e17b0b00dda2421b9c3e9aa4de6ee00d I0219 21:02:57.143869 19205 raft_consensus.cc:194] T e557230bff5343aa94b77257f2e3d64e P a23c963cc2c64632bbdea9c1539b30a8 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0219 21:02:57.147393 19201 tablet_bootstrap.cc:290] Tablet e557230bff5343aa94b77257f2e3d64e: No bootstrap required, opened a new log I0219 21:02:57.145164 19205 raft_consensus.cc:399] T e557230bff5343aa94b77257f2e3d64e P a23c963cc2c64632bbdea9c1539b30a8 [FOLLOWER]: Becoming Follower/Learner. State: Replica: a23c963cc2c64632bbdea9c1539b30a8, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:02:57.150605 19205 consensus_queue.cc:127] T e557230bff5343aa94b77257f2e3d64e P a23c963cc2c64632bbdea9c1539b30a8 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0219 21:02:57.151137 19195 tablet_bootstrap.cc:290] Tablet e17b0b00dda2421b9c3e9aa4de6ee00d: Bootstrap starting. I0219 21:02:57.150101 19201 ts_tablet_manager.cc:319] Time spent tablet e557230bff5343aa94b77257f2e3d64e bootstrap: real 0.222s user 0.015s sys 0.020s I0219 21:02:57.151973 19205 ts_tablet_manager.cc:339] Time spent starting tablet e557230bff5343aa94b77257f2e3d64e: real 0.033s user 0.009s sys 0.002s I0219 21:02:57.156278 19220 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: e17b0b00dda2421b9c3e9aa4de6ee00d creating new one. I0219 21:02:57.157198 19216 tablet_bootstrap.cc:290] Tablet e557230bff5343aa94b77257f2e3d64e: No bootstrap required, opened a new log I0219 21:02:57.159440 19216 ts_tablet_manager.cc:319] Time spent tablet e557230bff5343aa94b77257f2e3d64e bootstrap: real 0.149s user 0.011s sys 0.018s I0219 21:02:57.160441 19065 raft_consensus.cc:361] T b538f64abff6421b9b2fcbfc34fe9aa6 P a23c963cc2c64632bbdea9c1539b30a8 [LEADER]: Becoming Leader. State: Replica: a23c963cc2c64632bbdea9c1539b30a8, State: 1, Role: LEADER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:02:57.162401 19065 consensus_queue.cc:119] T b538f64abff6421b9b2fcbfc34fe9aa6 P a23c963cc2c64632bbdea9c1539b30a8 [LEADER]: queue going to LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 1, Majority size: 2, State: 1, Mode: LEADER I0219 21:02:57.166465 19195 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: e17b0b00dda2421b9c3e9aa4de6ee00d creating new one. I0219 21:02:57.166816 19201 raft_consensus.cc:194] T e557230bff5343aa94b77257f2e3d64e P f368131df0684fcd94566a9538713a4c [CANDIDATE]: Replica starting. Triggering 0 pending transactions. I0219 21:02:57.186264 19220 tablet_bootstrap.cc:290] Tablet e17b0b00dda2421b9c3e9aa4de6ee00d: No bootstrap required, opened a new log I0219 21:02:57.189287 19201 raft_consensus.cc:361] T e557230bff5343aa94b77257f2e3d64e P f368131df0684fcd94566a9538713a4c [LEADER]: Becoming Leader. State: Replica: f368131df0684fcd94566a9538713a4c, State: 1, Role: LEADER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:02:57.189705 19201 consensus_queue.cc:119] T e557230bff5343aa94b77257f2e3d64e P f368131df0684fcd94566a9538713a4c [LEADER]: queue going to LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 1, Majority size: 2, State: 1, Mode: LEADER I0219 21:02:57.190289 19220 ts_tablet_manager.cc:319] Time spent tablet e17b0b00dda2421b9c3e9aa4de6ee00d bootstrap: real 0.111s user 0.012s sys 0.017s I0219 21:02:57.193984 19216 raft_consensus.cc:194] T e557230bff5343aa94b77257f2e3d64e P 870aee24421545209809d234697decb0 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0219 21:02:57.194264 19216 raft_consensus.cc:399] T e557230bff5343aa94b77257f2e3d64e P 870aee24421545209809d234697decb0 [FOLLOWER]: Becoming Follower/Learner. State: Replica: 870aee24421545209809d234697decb0, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:02:57.194799 19216 consensus_queue.cc:127] T e557230bff5343aa94b77257f2e3d64e P 870aee24421545209809d234697decb0 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0219 21:02:57.196591 19216 ts_tablet_manager.cc:339] Time spent starting tablet e557230bff5343aa94b77257f2e3d64e: real 0.037s user 0.007s sys 0.005s I0219 21:02:57.204697 19220 raft_consensus.cc:194] T e17b0b00dda2421b9c3e9aa4de6ee00d P f368131df0684fcd94566a9538713a4c [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0219 21:02:57.204970 19220 raft_consensus.cc:399] T e17b0b00dda2421b9c3e9aa4de6ee00d P f368131df0684fcd94566a9538713a4c [FOLLOWER]: Becoming Follower/Learner. State: Replica: f368131df0684fcd94566a9538713a4c, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:02:57.205657 19220 consensus_queue.cc:127] T e17b0b00dda2421b9c3e9aa4de6ee00d P f368131df0684fcd94566a9538713a4c [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0219 21:02:57.210382 19220 ts_tablet_manager.cc:339] Time spent starting tablet e17b0b00dda2421b9c3e9aa4de6ee00d: real 0.020s user 0.010s sys 0.000s I0219 21:02:57.223582 19195 tablet_bootstrap.cc:290] Tablet e17b0b00dda2421b9c3e9aa4de6ee00d: No bootstrap required, opened a new log I0219 21:02:57.226160 19195 ts_tablet_manager.cc:319] Time spent tablet e17b0b00dda2421b9c3e9aa4de6ee00d bootstrap: real 0.104s user 0.018s sys 0.010s W0219 21:02:57.231962 19239 raft_consensus_state.cc:477] T b538f64abff6421b9b2fcbfc34fe9aa6 P a23c963cc2c64632bbdea9c1539b30a8 [LEADER]: Can't advance the committed index across term boundaries yet. Last committed operation was: term: 0 index: 0 New majority replicated is: term: 0 index: 0. Current term is: 1 I0219 21:02:57.234375 19065 ts_tablet_manager.cc:339] Time spent starting tablet b538f64abff6421b9b2fcbfc34fe9aa6: real 0.251s user 0.036s sys 0.013s W0219 21:02:57.234313 19242 raft_consensus_state.cc:477] T e557230bff5343aa94b77257f2e3d64e P f368131df0684fcd94566a9538713a4c [LEADER]: Can't advance the committed index across term boundaries yet. Last committed operation was: term: 0 index: 0 New majority replicated is: term: 0 index: 0. Current term is: 1 I0219 21:02:57.234998 19201 ts_tablet_manager.cc:339] Time spent starting tablet e557230bff5343aa94b77257f2e3d64e: real 0.083s user 0.016s sys 0.012s I0219 21:02:57.254879 19195 raft_consensus.cc:194] T e17b0b00dda2421b9c3e9aa4de6ee00d P 870aee24421545209809d234697decb0 [CANDIDATE]: Replica starting. Triggering 0 pending transactions. I0219 21:02:57.265627 19195 raft_consensus.cc:361] T e17b0b00dda2421b9c3e9aa4de6ee00d P 870aee24421545209809d234697decb0 [LEADER]: Becoming Leader. State: Replica: 870aee24421545209809d234697decb0, State: 1, Role: LEADER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:02:57.266095 19195 consensus_queue.cc:119] T e17b0b00dda2421b9c3e9aa4de6ee00d P 870aee24421545209809d234697decb0 [LEADER]: queue going to LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 1, Majority size: 2, State: 1, Mode: LEADER INFO: Connected to the Master I0219 21:02:57.266711 18449 tablet_server.cc:114] TabletServer shutting down... I0219 21:02:57.272873 19195 ts_tablet_manager.cc:339] Time spent starting tablet e17b0b00dda2421b9c3e9aa4de6ee00d: real 0.046s user 0.018s sys 0.004s W0219 21:02:57.277111 19254 raft_consensus_state.cc:477] T e17b0b00dda2421b9c3e9aa4de6ee00d P 870aee24421545209809d234697decb0 [LEADER]: Can't advance the committed index across term boundaries yet. Last committed operation was: term: 0 index: 0 New majority replicated is: term: 0 index: 0. Current term is: 1 I0219 21:02:57.306442 18449 ts_tablet_manager.cc:394] Shutting down tablet manager... I0219 21:02:57.307299 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: b538f64abff6421b9b2fcbfc34fe9aa6 I0219 21:02:57.307813 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(b538f64abff6421b9b2fcbfc34fe9aa6) I0219 21:02:57.308137 18449 raft_consensus.cc:983] T b538f64abff6421b9b2fcbfc34fe9aa6 P a23c963cc2c64632bbdea9c1539b30a8 [LEADER]: Raft consensus shutting down. I0219 21:02:57.309039 18449 consensus_peers.cc:211] T b538f64abff6421b9b2fcbfc34fe9aa6 P a23c963cc2c64632bbdea9c1539b30a8: Closing peer: f368131df0684fcd94566a9538713a4c I0219 21:02:57.309617 18449 consensus_peers.cc:211] T b538f64abff6421b9b2fcbfc34fe9aa6 P a23c963cc2c64632bbdea9c1539b30a8: Closing peer: 870aee24421545209809d234697decb0 I0219 21:02:57.310428 18449 raft_consensus_state.cc:365] T b538f64abff6421b9b2fcbfc34fe9aa6 P a23c963cc2c64632bbdea9c1539b30a8 [LEADER]: Trying to abort 1 pending transactions. I0219 21:02:57.310601 18449 raft_consensus_state.cc:370] T b538f64abff6421b9b2fcbfc34fe9aa6 P a23c963cc2c64632bbdea9c1539b30a8 [LEADER]: Aborting transaction as it isn't in flight: id { term: 1 index: 1 } op_type: CHANGE_CONFIG_OP change_config_request { tablet_id: "b538f64abff6421b9b2fcbfc34fe9aa6" old_config { opid_index: -1 local: false peers { permanent_uuid: "f368131df0684fcd94566a9538713a4c" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 44728 } } peers { permanent_uuid: "a23c963cc2c64632bbdea9c1539b30a8" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 47899 } } peers { permanent_uuid: "870aee24421545209809d234697decb0" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35523 } } } new_config { local: false peers { permanent_uuid: "f368131df0684fcd94566a9538713a4c" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 44728 } } peers { permanent_uuid: "a23c963cc2c64632bbdea9c1539b30a8" role: LEADER last_known_addr { host: "127.0.0.1" port: 47899 } } peers { permanent_uuid: "870aee24421545209809d234697decb0" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35523 } } } } I0219 21:02:57.312157 18449 raft_consensus.cc:998] T b538f64abff6421b9b2fcbfc34fe9aa6 P a23c963cc2c64632bbdea9c1539b30a8 [LEADER]: Raft consensus Shutdown! I0219 21:02:57.312417 18449 transaction_tracker.cc:126] Dumping currently running transactions: I0219 21:02:57.312917 18449 transaction_tracker.cc:128] ChangeConfigTransaction [type=REPLICA, state=ChangeConfigTransactionState [opid=term: 1 index: 1, timestamp=1, request=tablet_id: "b538f64abff6421b9b2fcbfc34fe9aa6" old_config { opid_index: -1 local: false peers { permanent_uuid: "f368131df0684fcd94566a9538713a4c" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 44728 } } peers { permanent_uuid: "a23c963cc2c64632bbdea9c1539b30a8" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 47899 } } peers { permanent_uuid: "870aee24421545209809d234697decb0" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35523 } } } new_config { local: false peers { permanent_uuid: "f368131df0684fcd94566a9538713a4c" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 44728 } } peers { permanent_uuid: "a23c963cc2c64632bbdea9c1539b30a8" role: LEADER last_known_addr { host: "127.0.0.1" port: 47899 } } peers { permanent_uuid: "870aee24421545209809d234697decb0" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35523 } } }]] I0219 21:02:57.312898 19262 change_config_transaction.cc:129] T b538f64abff6421b9b2fcbfc34fe9aa6 P a23c963cc2c64632bbdea9c1539b30a8: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "f368131df0684fcd94566a9538713a4c" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 44728 } } peers { permanent_uuid: "a23c963cc2c64632bbdea9c1539b30a8" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 47899 } } peers { permanent_uuid: "870aee24421545209809d234697decb0" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35523 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "f368131df0684fcd94566a9538713a4c" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 44728 } } peers { permanent_uuid: "a23c963cc2c64632bbdea9c1539b30a8" role: LEADER last_known_addr { host: "127.0.0.1" port: 47899 } } peers { permanent_uuid: "870aee24421545209809d234697decb0" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35523 } } I0219 21:02:57.315539 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: e17b0b00dda2421b9c3e9aa4de6ee00d I0219 21:02:57.315716 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(e17b0b00dda2421b9c3e9aa4de6ee00d) I0219 21:02:57.316674 18449 raft_consensus.cc:983] T e17b0b00dda2421b9c3e9aa4de6ee00d P a23c963cc2c64632bbdea9c1539b30a8 [FOLLOWER]: Raft consensus shutting down. I0219 21:02:57.317528 18449 raft_consensus_state.cc:365] T e17b0b00dda2421b9c3e9aa4de6ee00d P a23c963cc2c64632bbdea9c1539b30a8 [FOLLOWER]: Trying to abort 0 pending transactions. I0219 21:02:57.317689 18449 raft_consensus.cc:998] T e17b0b00dda2421b9c3e9aa4de6ee00d P a23c963cc2c64632bbdea9c1539b30a8 [FOLLOWER]: Raft consensus Shutdown! I0219 21:02:57.318631 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: e557230bff5343aa94b77257f2e3d64e I0219 21:02:57.318804 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(e557230bff5343aa94b77257f2e3d64e) I0219 21:02:57.318938 18449 raft_consensus.cc:983] T e557230bff5343aa94b77257f2e3d64e P a23c963cc2c64632bbdea9c1539b30a8 [FOLLOWER]: Raft consensus shutting down. I0219 21:02:57.319134 18449 raft_consensus_state.cc:365] T e557230bff5343aa94b77257f2e3d64e P a23c963cc2c64632bbdea9c1539b30a8 [FOLLOWER]: Trying to abort 0 pending transactions. I0219 21:02:57.319284 18449 raft_consensus.cc:998] T e557230bff5343aa94b77257f2e3d64e P a23c963cc2c64632bbdea9c1539b30a8 [FOLLOWER]: Raft consensus Shutdown! I0219 21:02:57.320745 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(b538f64abff6421b9b2fcbfc34fe9aa6) I0219 21:02:57.320922 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(b538f64abff6421b9b2fcbfc34fe9aa6) I0219 21:02:57.321084 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(b538f64abff6421b9b2fcbfc34fe9aa6) I0219 21:02:57.324005 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(e17b0b00dda2421b9c3e9aa4de6ee00d) I0219 21:02:57.324156 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(e17b0b00dda2421b9c3e9aa4de6ee00d) I0219 21:02:57.324297 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(e17b0b00dda2421b9c3e9aa4de6ee00d) I0219 21:02:57.325489 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(e557230bff5343aa94b77257f2e3d64e) I0219 21:02:57.325637 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(e557230bff5343aa94b77257f2e3d64e) I0219 21:02:57.325773 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(e557230bff5343aa94b77257f2e3d64e) I0219 21:02:57.326890 18449 tablet_server.cc:123] TabletServer shut down complete. Bye! I0219 21:02:57.327013 18449 tablet_server.cc:114] TabletServer shutting down... I0219 21:02:57.327183 18449 tablet_server.cc:123] TabletServer shut down complete. Bye! I0219 21:02:57.332424 18449 tablet_server.cc:114] TabletServer shutting down... I0219 21:02:57.349726 18449 ts_tablet_manager.cc:394] Shutting down tablet manager... I0219 21:02:57.350059 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: e17b0b00dda2421b9c3e9aa4de6ee00d I0219 21:02:57.350263 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(e17b0b00dda2421b9c3e9aa4de6ee00d) I0219 21:02:57.350424 18449 raft_consensus.cc:983] T e17b0b00dda2421b9c3e9aa4de6ee00d P f368131df0684fcd94566a9538713a4c [FOLLOWER]: Raft consensus shutting down. I0219 21:02:57.350697 18449 raft_consensus_state.cc:365] T e17b0b00dda2421b9c3e9aa4de6ee00d P f368131df0684fcd94566a9538713a4c [FOLLOWER]: Trying to abort 0 pending transactions. I0219 21:02:57.350867 18449 raft_consensus.cc:998] T e17b0b00dda2421b9c3e9aa4de6ee00d P f368131df0684fcd94566a9538713a4c [FOLLOWER]: Raft consensus Shutdown! I0219 21:02:57.352362 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: b538f64abff6421b9b2fcbfc34fe9aa6 I0219 21:02:57.352536 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(b538f64abff6421b9b2fcbfc34fe9aa6) I0219 21:02:57.352656 18449 raft_consensus.cc:983] T b538f64abff6421b9b2fcbfc34fe9aa6 P f368131df0684fcd94566a9538713a4c [FOLLOWER]: Raft consensus shutting down. I0219 21:02:57.352845 18449 raft_consensus_state.cc:365] T b538f64abff6421b9b2fcbfc34fe9aa6 P f368131df0684fcd94566a9538713a4c [FOLLOWER]: Trying to abort 0 pending transactions. I0219 21:02:57.352980 18449 raft_consensus.cc:998] T b538f64abff6421b9b2fcbfc34fe9aa6 P f368131df0684fcd94566a9538713a4c [FOLLOWER]: Raft consensus Shutdown! I0219 21:02:57.354624 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: e557230bff5343aa94b77257f2e3d64e I0219 21:02:57.354778 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(e557230bff5343aa94b77257f2e3d64e) I0219 21:02:57.354889 18449 raft_consensus.cc:983] T e557230bff5343aa94b77257f2e3d64e P f368131df0684fcd94566a9538713a4c [LEADER]: Raft consensus shutting down. I0219 21:02:57.355492 18449 consensus_peers.cc:211] T e557230bff5343aa94b77257f2e3d64e P f368131df0684fcd94566a9538713a4c: Closing peer: a23c963cc2c64632bbdea9c1539b30a8 I0219 21:02:57.356367 18449 consensus_peers.cc:211] T e557230bff5343aa94b77257f2e3d64e P f368131df0684fcd94566a9538713a4c: Closing peer: 870aee24421545209809d234697decb0 I0219 21:02:57.356789 18449 raft_consensus_state.cc:365] T e557230bff5343aa94b77257f2e3d64e P f368131df0684fcd94566a9538713a4c [LEADER]: Trying to abort 1 pending transactions. I0219 21:02:57.356959 18449 raft_consensus_state.cc:370] T e557230bff5343aa94b77257f2e3d64e P f368131df0684fcd94566a9538713a4c [LEADER]: Aborting transaction as it isn't in flight: id { term: 1 index: 1 } op_type: CHANGE_CONFIG_OP change_config_request { tablet_id: "e557230bff5343aa94b77257f2e3d64e" old_config { opid_index: -1 local: false peers { permanent_uuid: "f368131df0684fcd94566a9538713a4c" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 44728 } } peers { permanent_uuid: "a23c963cc2c64632bbdea9c1539b30a8" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 47899 } } peers { permanent_uuid: "870aee24421545209809d234697decb0" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35523 } } } new_config { local: false peers { permanent_uuid: "f368131df0684fcd94566a9538713a4c" role: LEADER last_known_addr { host: "127.0.0.1" port: 44728 } } peers { permanent_uuid: "a23c963cc2c64632bbdea9c1539b30a8" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 47899 } } peers { permanent_uuid: "870aee24421545209809d234697decb0" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35523 } } } } I0219 21:02:57.358266 18449 raft_consensus.cc:998] T e557230bff5343aa94b77257f2e3d64e P f368131df0684fcd94566a9538713a4c [LEADER]: Raft consensus Shutdown! I0219 21:02:57.358530 18449 transaction_tracker.cc:126] Dumping currently running transactions: I0219 21:02:57.358700 18449 transaction_tracker.cc:128] ChangeConfigTransaction [type=REPLICA, state=ChangeConfigTransactionState [opid=term: 1 index: 1, timestamp=1, request=tablet_id: "e557230bff5343aa94b77257f2e3d64e" old_config { opid_index: -1 local: false peers { permanent_uuid: "f368131df0684fcd94566a9538713a4c" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 44728 } } peers { permanent_uuid: "a23c963cc2c64632bbdea9c1539b30a8" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 47899 } } peers { permanent_uuid: "870aee24421545209809d234697decb0" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35523 } } } new_config { local: false peers { permanent_uuid: "f368131df0684fcd94566a9538713a4c" role: LEADER last_known_addr { host: "127.0.0.1" port: 44728 } } peers { permanent_uuid: "a23c963cc2c64632bbdea9c1539b30a8" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 47899 } } peers { permanent_uuid: "870aee24421545209809d234697decb0" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35523 } } }]] I0219 21:02:57.358850 19267 change_config_transaction.cc:129] T e557230bff5343aa94b77257f2e3d64e P f368131df0684fcd94566a9538713a4c: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "f368131df0684fcd94566a9538713a4c" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 44728 } } peers { permanent_uuid: "a23c963cc2c64632bbdea9c1539b30a8" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 47899 } } peers { permanent_uuid: "870aee24421545209809d234697decb0" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35523 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "f368131df0684fcd94566a9538713a4c" role: LEADER last_known_addr { host: "127.0.0.1" port: 44728 } } peers { permanent_uuid: "a23c963cc2c64632bbdea9c1539b30a8" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 47899 } } peers { permanent_uuid: "870aee24421545209809d234697decb0" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35523 } } I0219 21:02:57.360113 18449 transaction_tracker.cc:126] Dumping currently running transactions: I0219 21:02:57.360220 18449 transaction_tracker.cc:128] ChangeConfigTransaction [type=REPLICA, state=ChangeConfigTransactionState [opid=term: 1 index: 1, timestamp=1, request=(none)]] I0219 21:02:57.362988 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(e17b0b00dda2421b9c3e9aa4de6ee00d) I0219 21:02:57.363211 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(e17b0b00dda2421b9c3e9aa4de6ee00d) I0219 21:02:57.363373 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(e17b0b00dda2421b9c3e9aa4de6ee00d) I0219 21:02:57.364634 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(b538f64abff6421b9b2fcbfc34fe9aa6) I0219 21:02:57.364799 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(b538f64abff6421b9b2fcbfc34fe9aa6) I0219 21:02:57.364950 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(b538f64abff6421b9b2fcbfc34fe9aa6) I0219 21:02:57.366085 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(e557230bff5343aa94b77257f2e3d64e) I0219 21:02:57.366240 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(e557230bff5343aa94b77257f2e3d64e) I0219 21:02:57.366385 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(e557230bff5343aa94b77257f2e3d64e) I0219 21:02:57.367624 18449 tablet_server.cc:123] TabletServer shut down complete. Bye! I0219 21:02:57.367738 18449 tablet_server.cc:114] TabletServer shutting down... I0219 21:02:57.367913 18449 tablet_server.cc:123] TabletServer shut down complete. Bye! I0219 21:02:57.371898 18449 tablet_server.cc:114] TabletServer shutting down... I0219 21:02:57.390575 18449 ts_tablet_manager.cc:394] Shutting down tablet manager... I0219 21:02:57.390866 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: e17b0b00dda2421b9c3e9aa4de6ee00d I0219 21:02:57.391074 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(e17b0b00dda2421b9c3e9aa4de6ee00d) I0219 21:02:57.391228 18449 raft_consensus.cc:983] T e17b0b00dda2421b9c3e9aa4de6ee00d P 870aee24421545209809d234697decb0 [LEADER]: Raft consensus shutting down. I0219 21:02:57.391983 18449 consensus_peers.cc:211] T e17b0b00dda2421b9c3e9aa4de6ee00d P 870aee24421545209809d234697decb0: Closing peer: f368131df0684fcd94566a9538713a4c I0219 21:02:57.392804 18449 consensus_peers.cc:211] T e17b0b00dda2421b9c3e9aa4de6ee00d P 870aee24421545209809d234697decb0: Closing peer: a23c963cc2c64632bbdea9c1539b30a8 I0219 21:02:57.393223 18449 raft_consensus_state.cc:365] T e17b0b00dda2421b9c3e9aa4de6ee00d P 870aee24421545209809d234697decb0 [LEADER]: Trying to abort 1 pending transactions. I0219 21:02:57.393367 18449 raft_consensus_state.cc:370] T e17b0b00dda2421b9c3e9aa4de6ee00d P 870aee24421545209809d234697decb0 [LEADER]: Aborting transaction as it isn't in flight: id { term: 1 index: 1 } op_type: CHANGE_CONFIG_OP change_config_request { tablet_id: "e17b0b00dda2421b9c3e9aa4de6ee00d" old_config { opid_index: -1 local: false peers { permanent_uuid: "f368131df0684fcd94566a9538713a4c" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 44728 } } peers { permanent_uuid: "a23c963cc2c64632bbdea9c1539b30a8" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 47899 } } peers { permanent_uuid: "870aee24421545209809d234697decb0" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 35523 } } } new_config { local: false peers { permanent_uuid: "f368131df0684fcd94566a9538713a4c" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 44728 } } peers { permanent_uuid: "a23c963cc2c64632bbdea9c1539b30a8" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 47899 } } peers { permanent_uuid: "870aee24421545209809d234697decb0" role: LEADER last_known_addr { host: "127.0.0.1" port: 35523 } } } } I0219 21:02:57.394598 18449 raft_consensus.cc:998] T e17b0b00dda2421b9c3e9aa4de6ee00d P 870aee24421545209809d234697decb0 [LEADER]: Raft consensus Shutdown! I0219 21:02:57.394834 18449 transaction_tracker.cc:126] Dumping currently running transactions: I0219 21:02:57.394929 18449 transaction_tracker.cc:128] ChangeConfigTransaction [type=REPLICA, state=ChangeConfigTransactionState [opid=term: 1 index: 1, timestamp=1, request=tablet_id: "e17b0b00dda2421b9c3e9aa4de6ee00d" old_config { opid_index: -1 local: false peers { permanent_uuid: "f368131df0684fcd94566a9538713a4c" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 44728 } } peers { permanent_uuid: "a23c963cc2c64632bbdea9c1539b30a8" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 47899 } } peers { permanent_uuid: "870aee24421545209809d234697decb0" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 35523 } } } new_config { local: false peers { permanent_uuid: "f368131df0684fcd94566a9538713a4c" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 44728 } } peers { permanent_uuid: "a23c963cc2c64632bbdea9c1539b30a8" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 47899 } } peers { permanent_uuid: "870aee24421545209809d234697decb0" role: LEADER last_known_addr { host: "127.0.0.1" port: 35523 } } }]] I0219 21:02:57.395192 19272 change_config_transaction.cc:129] T e17b0b00dda2421b9c3e9aa4de6ee00d P 870aee24421545209809d234697decb0: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "f368131df0684fcd94566a9538713a4c" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 44728 } } peers { permanent_uuid: "a23c963cc2c64632bbdea9c1539b30a8" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 47899 } } peers { permanent_uuid: "870aee24421545209809d234697decb0" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 35523 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "f368131df0684fcd94566a9538713a4c" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 44728 } } peers { permanent_uuid: "a23c963cc2c64632bbdea9c1539b30a8" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 47899 } } peers { permanent_uuid: "870aee24421545209809d234697decb0" role: LEADER last_known_addr { host: "127.0.0.1" port: 35523 } } I0219 21:02:57.397809 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: b538f64abff6421b9b2fcbfc34fe9aa6 I0219 21:02:57.397989 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(b538f64abff6421b9b2fcbfc34fe9aa6) I0219 21:02:57.398130 18449 raft_consensus.cc:983] T b538f64abff6421b9b2fcbfc34fe9aa6 P 870aee24421545209809d234697decb0 [FOLLOWER]: Raft consensus shutting down. I0219 21:02:57.398347 18449 raft_consensus_state.cc:365] T b538f64abff6421b9b2fcbfc34fe9aa6 P 870aee24421545209809d234697decb0 [FOLLOWER]: Trying to abort 0 pending transactions. I0219 21:02:57.398529 18449 raft_consensus.cc:998] T b538f64abff6421b9b2fcbfc34fe9aa6 P 870aee24421545209809d234697decb0 [FOLLOWER]: Raft consensus Shutdown! I0219 21:02:57.400187 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: e557230bff5343aa94b77257f2e3d64e I0219 21:02:57.400356 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(e557230bff5343aa94b77257f2e3d64e) I0219 21:02:57.400511 18449 raft_consensus.cc:983] T e557230bff5343aa94b77257f2e3d64e P 870aee24421545209809d234697decb0 [FOLLOWER]: Raft consensus shutting down. I0219 21:02:57.400725 18449 raft_consensus_state.cc:365] T e557230bff5343aa94b77257f2e3d64e P 870aee24421545209809d234697decb0 [FOLLOWER]: Trying to abort 0 pending transactions. I0219 21:02:57.400892 18449 raft_consensus.cc:998] T e557230bff5343aa94b77257f2e3d64e P 870aee24421545209809d234697decb0 [FOLLOWER]: Raft consensus Shutdown! I0219 21:02:57.402540 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(e17b0b00dda2421b9c3e9aa4de6ee00d) I0219 21:02:57.402712 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(e17b0b00dda2421b9c3e9aa4de6ee00d) I0219 21:02:57.402881 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(e17b0b00dda2421b9c3e9aa4de6ee00d) I0219 21:02:57.404301 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(b538f64abff6421b9b2fcbfc34fe9aa6) I0219 21:02:57.404467 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(b538f64abff6421b9b2fcbfc34fe9aa6) I0219 21:02:57.404638 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(b538f64abff6421b9b2fcbfc34fe9aa6) I0219 21:02:57.405804 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(e557230bff5343aa94b77257f2e3d64e) I0219 21:02:57.405962 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(e557230bff5343aa94b77257f2e3d64e) I0219 21:02:57.406105 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(e557230bff5343aa94b77257f2e3d64e) I0219 21:02:57.407243 18449 tablet_server.cc:123] TabletServer shut down complete. Bye! I0219 21:02:57.407356 18449 tablet_server.cc:114] TabletServer shutting down... I0219 21:02:57.407965 18449 tablet_server.cc:123] TabletServer shut down complete. Bye! I0219 21:02:57.412349 18449 master.cc:130] Master@127.0.0.1:38899 shutting down... I0219 21:02:57.426723 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: 00000000000000000000000000000000 I0219 21:02:57.429111 18449 master.cc:133] Master@127.0.0.1:38899 shutdown complete. [ OK ] RemoteKsckTest.TestMasterOk (2859 ms) [ RUN ] RemoteKsckTest.TestTabletServersOk I0219 21:02:57.456342 18449 test_util.cc:117] Using random seed: 1424408577 I0219 21:02:57.489636 18449 fs_manager.cc:193] Generated new instance metadata in path /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestTabletServersOk.1424408574588976-18449/minicluster-data/master-0-root/instance: uuid: "4417bee36eae44ad81fd4a8ca19b1b58" format_stamp: "Formatted at 2015-02-20 05:02:57 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:02:57.507207 18449 fs_manager.cc:131] Opened local filesystem: /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestTabletServersOk.1424408574588976-18449/minicluster-data/master-0-root uuid: "4417bee36eae44ad81fd4a8ca19b1b58" format_stamp: "Formatted at 2015-02-20 05:02:57 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:02:57.530879 18449 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:37391 I0219 21:02:57.531555 18449 webserver.cc:108] Starting webserver on 0.0.0.0:0 I0219 21:02:57.531672 18449 webserver.cc:117] Document root disabled I0219 21:02:57.532439 18449 webserver.cc:197] Webserver started. Bound to: http://0.0.0.0:60496/ I0219 21:02:57.554369 19349 tablet_bootstrap.cc:290] Tablet 00000000000000000000000000000000: Bootstrap starting. I0219 21:02:57.560340 19349 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 00000000000000000000000000000000 creating new one. I0219 21:02:57.565799 19349 tablet_bootstrap.cc:290] Tablet 00000000000000000000000000000000: No bootstrap required, opened a new log I0219 21:02:57.588019 19367 change_config_transaction.cc:129] T 00000000000000000000000000000000 P 4417bee36eae44ad81fd4a8ca19b1b58: Configuration changed Changed from: opid_index: -1 local: true peers { permanent_uuid: "4417bee36eae44ad81fd4a8ca19b1b58" role: LEADER } Changed to: opid_index: 1 local: true peers { permanent_uuid: "4417bee36eae44ad81fd4a8ca19b1b58" role: LEADER } I0219 21:02:57.588474 19367 sys_catalog.cc:202] T 00000000000000000000000000000000 P 4417bee36eae44ad81fd4a8ca19b1b58 [sys.catalog]: SysCatalogTable state changed. New quorum config:opid_index: 1 local: true peers { permanent_uuid: "4417bee36eae44ad81fd4a8ca19b1b58" role: LEADER } I0219 21:02:57.588731 19367 sys_catalog.cc:205] T 00000000000000000000000000000000 P 4417bee36eae44ad81fd4a8ca19b1b58 [sys.catalog]: This master's current role is: LEADER, previous role was: FOLLOWER I0219 21:02:57.588757 19349 sys_catalog.cc:268] T 00000000000000000000000000000000 P 4417bee36eae44ad81fd4a8ca19b1b58 [sys.catalog]: configured and running, proceeding with master startup. I0219 21:02:57.591213 19390 catalog_manager.cc:397] Loading tables and tablets metadata into memory... I0219 21:02:57.631036 18449 fs_manager.cc:193] Generated new instance metadata in path /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestTabletServersOk.1424408574588976-18449/minicluster-data/ts-0-root/instance: uuid: "f094cd13cf8c48fcadfd7dfd3976a398" format_stamp: "Formatted at 2015-02-20 05:02:57 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:02:57.659009 18449 fs_manager.cc:131] Opened local filesystem: /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestTabletServersOk.1424408574588976-18449/minicluster-data/ts-0-root uuid: "f094cd13cf8c48fcadfd7dfd3976a398" format_stamp: "Formatted at 2015-02-20 05:02:57 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:02:57.709427 18449 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:59754 I0219 21:02:57.709993 18449 webserver.cc:108] Starting webserver on 0.0.0.0:0 I0219 21:02:57.710093 18449 webserver.cc:117] Document root disabled I0219 21:02:57.714797 18449 webserver.cc:197] Webserver started. Bound to: http://0.0.0.0:35157/ I0219 21:02:57.721426 18449 maintenance_manager.cc:111] MaintenanceManager: targeting memory size of 23.515860 GB I0219 21:02:57.741688 19455 heartbeater.cc:219] Connected to a leader master server at 127.0.0.1:37391 I0219 21:02:57.741829 19455 heartbeater.cc:289] Registering TS with master... I0219 21:02:57.741986 19455 heartbeater.cc:295] Sending a full tablet report to master... I0219 21:02:57.743048 19327 ts_manager.cc:66] Registered new tablet server { permanent_uuid: "f094cd13cf8c48fcadfd7dfd3976a398" instance_seqno: 1424408577708559 } with Master I0219 21:02:57.783412 18449 fs_manager.cc:193] Generated new instance metadata in path /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestTabletServersOk.1424408574588976-18449/minicluster-data/ts-1-root/instance: uuid: "aa90039972cc480089bed3a1f3bf952c" format_stamp: "Formatted at 2015-02-20 05:02:57 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:02:57.809964 18449 fs_manager.cc:131] Opened local filesystem: /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestTabletServersOk.1424408574588976-18449/minicluster-data/ts-1-root uuid: "aa90039972cc480089bed3a1f3bf952c" format_stamp: "Formatted at 2015-02-20 05:02:57 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:02:57.952329 18449 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:60838 I0219 21:02:57.952939 18449 webserver.cc:108] Starting webserver on 0.0.0.0:0 I0219 21:02:57.953050 18449 webserver.cc:117] Document root disabled I0219 21:02:57.955327 18449 webserver.cc:197] Webserver started. Bound to: http://0.0.0.0:34023/ I0219 21:02:57.957242 18449 maintenance_manager.cc:111] MaintenanceManager: targeting memory size of 23.515860 GB I0219 21:02:57.972631 19554 heartbeater.cc:219] Connected to a leader master server at 127.0.0.1:37391 I0219 21:02:57.976393 19554 heartbeater.cc:289] Registering TS with master... I0219 21:02:57.976624 19554 heartbeater.cc:295] Sending a full tablet report to master... I0219 21:02:57.979214 19328 ts_manager.cc:66] Registered new tablet server { permanent_uuid: "aa90039972cc480089bed3a1f3bf952c" instance_seqno: 1424408577950838 } with Master I0219 21:02:58.000532 18449 fs_manager.cc:193] Generated new instance metadata in path /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestTabletServersOk.1424408574588976-18449/minicluster-data/ts-2-root/instance: uuid: "504935b256704386aff5580d38efd8da" format_stamp: "Formatted at 2015-02-20 05:02:57 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:02:58.036079 18449 fs_manager.cc:131] Opened local filesystem: /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestTabletServersOk.1424408574588976-18449/minicluster-data/ts-2-root uuid: "504935b256704386aff5580d38efd8da" format_stamp: "Formatted at 2015-02-20 05:02:57 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:02:58.087033 18449 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:57762 I0219 21:02:58.087678 18449 webserver.cc:108] Starting webserver on 0.0.0.0:0 I0219 21:02:58.087776 18449 webserver.cc:117] Document root disabled I0219 21:02:58.089198 18449 webserver.cc:197] Webserver started. Bound to: http://0.0.0.0:52161/ I0219 21:02:58.091564 18449 maintenance_manager.cc:111] MaintenanceManager: targeting memory size of 23.515860 GB I0219 21:02:58.099016 19603 heartbeater.cc:219] Connected to a leader master server at 127.0.0.1:37391 I0219 21:02:58.099210 19603 heartbeater.cc:289] Registering TS with master... I0219 21:02:58.099427 19603 heartbeater.cc:295] Sending a full tablet report to master... I0219 21:02:58.100639 19329 ts_manager.cc:66] Registered new tablet server { permanent_uuid: "504935b256704386aff5580d38efd8da" instance_seqno: 1424408578084700 } with Master I0219 21:02:58.101591 18449 mini_cluster.cc:276] 3 TS(s) registered with Master after 0.00759895s I0219 21:02:58.115902 19335 catalog_manager.cc:562] CreateTable from {real_user=jenkins, eff_user=} at 127.0.0.1:46033: name: "ksck-test-table" schema { columns { name: "key" type: UINT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION } columns { name: "int_val" type: UINT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION } } pre_split_keys: "\000\000\000\000" pre_split_keys: "\000\000\000\001" num_replicas: 3 I0219 21:02:58.163501 19429 tablet_service.cc:389] Processing CreateTablet for tablet 36bdb5905c524c81b7b9050353dabda4 (table=ksck-test-table [id=f7fe9a8c227b4f8390e7e9f8997f9156]), range=["\x00\x00\x00\x01", ""] I0219 21:02:58.163988 19432 tablet_service.cc:389] Processing CreateTablet for tablet 3278d9fd9fa94c2ca65a21e36b338e58 (table=ksck-test-table [id=f7fe9a8c227b4f8390e7e9f8997f9156]), range=["", "\x00\x00\x00\x00"] I0219 21:02:58.163988 19430 tablet_service.cc:389] Processing CreateTablet for tablet 37ade4af36924cf1a3f53ac08ca30507 (table=ksck-test-table [id=f7fe9a8c227b4f8390e7e9f8997f9156]), range=["\x00\x00\x00\x00", "\x00\x00\x00\x01"] I0219 21:02:58.164021 19519 tablet_service.cc:389] Processing CreateTablet for tablet 36bdb5905c524c81b7b9050353dabda4 (table=ksck-test-table [id=f7fe9a8c227b4f8390e7e9f8997f9156]), range=["\x00\x00\x00\x01", ""] I0219 21:02:58.165596 19521 tablet_service.cc:389] Processing CreateTablet for tablet 37ade4af36924cf1a3f53ac08ca30507 (table=ksck-test-table [id=f7fe9a8c227b4f8390e7e9f8997f9156]), range=["\x00\x00\x00\x00", "\x00\x00\x00\x01"] I0219 21:02:58.170505 19581 tablet_service.cc:389] Processing CreateTablet for tablet 36bdb5905c524c81b7b9050353dabda4 (table=ksck-test-table [id=f7fe9a8c227b4f8390e7e9f8997f9156]), range=["\x00\x00\x00\x01", ""] I0219 21:02:58.171670 19582 tablet_service.cc:389] Processing CreateTablet for tablet 37ade4af36924cf1a3f53ac08ca30507 (table=ksck-test-table [id=f7fe9a8c227b4f8390e7e9f8997f9156]), range=["\x00\x00\x00\x00", "\x00\x00\x00\x01"] I0219 21:02:58.171829 19522 tablet_service.cc:389] Processing CreateTablet for tablet 3278d9fd9fa94c2ca65a21e36b338e58 (table=ksck-test-table [id=f7fe9a8c227b4f8390e7e9f8997f9156]), range=["", "\x00\x00\x00\x00"] I0219 21:02:58.173240 19583 tablet_service.cc:389] Processing CreateTablet for tablet 3278d9fd9fa94c2ca65a21e36b338e58 (table=ksck-test-table [id=f7fe9a8c227b4f8390e7e9f8997f9156]), range=["", "\x00\x00\x00\x00"] I0219 21:02:58.384209 19522 ts_tablet_manager.cc:449] Registered tablet 3278d9fd9fa94c2ca65a21e36b338e58 I0219 21:02:58.454629 19675 ts_tablet_manager.cc:314] Bootstrapping tablet: 3278d9fd9fa94c2ca65a21e36b338e58 I0219 21:02:58.499446 19675 tablet_bootstrap.cc:290] Tablet 3278d9fd9fa94c2ca65a21e36b338e58: Bootstrap starting. I0219 21:02:58.517772 19675 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 3278d9fd9fa94c2ca65a21e36b338e58 creating new one. I0219 21:02:58.699744 19675 tablet_bootstrap.cc:290] Tablet 3278d9fd9fa94c2ca65a21e36b338e58: No bootstrap required, opened a new log I0219 21:02:58.702491 19675 ts_tablet_manager.cc:319] Time spent tablet 3278d9fd9fa94c2ca65a21e36b338e58 bootstrap: real 0.248s user 0.015s sys 0.010s I0219 21:02:58.722098 19675 raft_consensus.cc:194] T 3278d9fd9fa94c2ca65a21e36b338e58 P aa90039972cc480089bed3a1f3bf952c [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0219 21:02:58.727948 19675 raft_consensus.cc:399] T 3278d9fd9fa94c2ca65a21e36b338e58 P aa90039972cc480089bed3a1f3bf952c [FOLLOWER]: Becoming Follower/Learner. State: Replica: aa90039972cc480089bed3a1f3bf952c, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:02:58.729825 19675 consensus_queue.cc:127] T 3278d9fd9fa94c2ca65a21e36b338e58 P aa90039972cc480089bed3a1f3bf952c [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0219 21:02:58.735960 19675 ts_tablet_manager.cc:339] Time spent starting tablet 3278d9fd9fa94c2ca65a21e36b338e58: real 0.033s user 0.007s sys 0.004s I0219 21:02:58.837553 19519 ts_tablet_manager.cc:449] Registered tablet 36bdb5905c524c81b7b9050353dabda4 I0219 21:02:58.838552 19521 ts_tablet_manager.cc:449] Registered tablet 37ade4af36924cf1a3f53ac08ca30507 I0219 21:02:58.851567 19675 ts_tablet_manager.cc:314] Bootstrapping tablet: 36bdb5905c524c81b7b9050353dabda4 I0219 21:02:58.892817 19583 ts_tablet_manager.cc:449] Registered tablet 3278d9fd9fa94c2ca65a21e36b338e58 I0219 21:02:58.904331 19675 tablet_bootstrap.cc:290] Tablet 36bdb5905c524c81b7b9050353dabda4: Bootstrap starting. I0219 21:02:58.929595 19429 ts_tablet_manager.cc:449] Registered tablet 36bdb5905c524c81b7b9050353dabda4 I0219 21:02:58.934499 19675 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 36bdb5905c524c81b7b9050353dabda4 creating new one. I0219 21:02:58.936933 19432 ts_tablet_manager.cc:449] Registered tablet 3278d9fd9fa94c2ca65a21e36b338e58 I0219 21:02:58.965581 19815 ts_tablet_manager.cc:314] Bootstrapping tablet: 37ade4af36924cf1a3f53ac08ca30507 I0219 21:02:59.000838 19823 ts_tablet_manager.cc:314] Bootstrapping tablet: 3278d9fd9fa94c2ca65a21e36b338e58 I0219 21:02:59.020458 19582 ts_tablet_manager.cc:449] Registered tablet 37ade4af36924cf1a3f53ac08ca30507 I0219 21:02:59.024431 19815 tablet_bootstrap.cc:290] Tablet 37ade4af36924cf1a3f53ac08ca30507: Bootstrap starting. I0219 21:02:59.029597 19675 tablet_bootstrap.cc:290] Tablet 36bdb5905c524c81b7b9050353dabda4: No bootstrap required, opened a new log I0219 21:02:59.034459 19828 ts_tablet_manager.cc:314] Bootstrapping tablet: 36bdb5905c524c81b7b9050353dabda4 I0219 21:02:59.036834 19675 ts_tablet_manager.cc:319] Time spent tablet 36bdb5905c524c81b7b9050353dabda4 bootstrap: real 0.185s user 0.014s sys 0.014s I0219 21:02:59.037099 19845 ts_tablet_manager.cc:314] Bootstrapping tablet: 3278d9fd9fa94c2ca65a21e36b338e58 I0219 21:02:59.043422 19815 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 37ade4af36924cf1a3f53ac08ca30507 creating new one. I0219 21:02:59.056216 19846 ts_tablet_manager.cc:314] Bootstrapping tablet: 37ade4af36924cf1a3f53ac08ca30507 I0219 21:02:59.059499 19823 tablet_bootstrap.cc:290] Tablet 3278d9fd9fa94c2ca65a21e36b338e58: Bootstrap starting. I0219 21:02:59.066925 19823 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 3278d9fd9fa94c2ca65a21e36b338e58 creating new one. I0219 21:02:59.085108 19675 raft_consensus.cc:194] T 36bdb5905c524c81b7b9050353dabda4 P aa90039972cc480089bed3a1f3bf952c [CANDIDATE]: Replica starting. Triggering 0 pending transactions. I0219 21:02:59.089406 19430 ts_tablet_manager.cc:449] Registered tablet 37ade4af36924cf1a3f53ac08ca30507 I0219 21:02:59.089444 19828 tablet_bootstrap.cc:290] Tablet 36bdb5905c524c81b7b9050353dabda4: Bootstrap starting. I0219 21:02:59.101096 19845 tablet_bootstrap.cc:290] Tablet 3278d9fd9fa94c2ca65a21e36b338e58: Bootstrap starting. I0219 21:02:59.111173 19828 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 36bdb5905c524c81b7b9050353dabda4 creating new one. I0219 21:02:59.115634 19581 ts_tablet_manager.cc:449] Registered tablet 36bdb5905c524c81b7b9050353dabda4 I0219 21:02:59.117660 19846 tablet_bootstrap.cc:290] Tablet 37ade4af36924cf1a3f53ac08ca30507: Bootstrap starting. I0219 21:02:59.124902 19815 tablet_bootstrap.cc:290] Tablet 37ade4af36924cf1a3f53ac08ca30507: No bootstrap required, opened a new log I0219 21:02:59.127923 19815 ts_tablet_manager.cc:319] Time spent tablet 37ade4af36924cf1a3f53ac08ca30507 bootstrap: real 0.162s user 0.015s sys 0.013s I0219 21:02:59.132180 19846 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 37ade4af36924cf1a3f53ac08ca30507 creating new one. I0219 21:02:59.132640 19823 tablet_bootstrap.cc:290] Tablet 3278d9fd9fa94c2ca65a21e36b338e58: No bootstrap required, opened a new log I0219 21:02:59.134445 19845 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 3278d9fd9fa94c2ca65a21e36b338e58 creating new one. I0219 21:02:59.135828 19851 ts_tablet_manager.cc:314] Bootstrapping tablet: 37ade4af36924cf1a3f53ac08ca30507 I0219 21:02:59.135459 19823 ts_tablet_manager.cc:319] Time spent tablet 3278d9fd9fa94c2ca65a21e36b338e58 bootstrap: real 0.134s user 0.009s sys 0.013s I0219 21:02:59.150648 19856 ts_tablet_manager.cc:314] Bootstrapping tablet: 36bdb5905c524c81b7b9050353dabda4 I0219 21:02:59.155972 19823 raft_consensus.cc:194] T 3278d9fd9fa94c2ca65a21e36b338e58 P 504935b256704386aff5580d38efd8da [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0219 21:02:59.158054 19815 raft_consensus.cc:194] T 37ade4af36924cf1a3f53ac08ca30507 P aa90039972cc480089bed3a1f3bf952c [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0219 21:02:59.156641 19823 raft_consensus.cc:399] T 3278d9fd9fa94c2ca65a21e36b338e58 P 504935b256704386aff5580d38efd8da [FOLLOWER]: Becoming Follower/Learner. State: Replica: 504935b256704386aff5580d38efd8da, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:02:59.158360 19815 raft_consensus.cc:399] T 37ade4af36924cf1a3f53ac08ca30507 P aa90039972cc480089bed3a1f3bf952c [FOLLOWER]: Becoming Follower/Learner. State: Replica: aa90039972cc480089bed3a1f3bf952c, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:02:59.159497 19823 consensus_queue.cc:127] T 3278d9fd9fa94c2ca65a21e36b338e58 P 504935b256704386aff5580d38efd8da [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0219 21:02:59.159276 19815 consensus_queue.cc:127] T 37ade4af36924cf1a3f53ac08ca30507 P aa90039972cc480089bed3a1f3bf952c [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0219 21:02:59.160519 19823 ts_tablet_manager.cc:339] Time spent starting tablet 3278d9fd9fa94c2ca65a21e36b338e58: real 0.023s user 0.005s sys 0.005s I0219 21:02:59.168112 19815 ts_tablet_manager.cc:339] Time spent starting tablet 37ade4af36924cf1a3f53ac08ca30507: real 0.040s user 0.007s sys 0.004s I0219 21:02:59.178889 19851 tablet_bootstrap.cc:290] Tablet 37ade4af36924cf1a3f53ac08ca30507: Bootstrap starting. I0219 21:02:59.198221 19856 tablet_bootstrap.cc:290] Tablet 36bdb5905c524c81b7b9050353dabda4: Bootstrap starting. I0219 21:02:59.204244 19828 tablet_bootstrap.cc:290] Tablet 36bdb5905c524c81b7b9050353dabda4: No bootstrap required, opened a new log I0219 21:02:59.207072 19828 ts_tablet_manager.cc:319] Time spent tablet 36bdb5905c524c81b7b9050353dabda4 bootstrap: real 0.172s user 0.013s sys 0.012s I0219 21:02:59.213057 19856 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 36bdb5905c524c81b7b9050353dabda4 creating new one. I0219 21:02:59.215829 19675 raft_consensus.cc:361] T 36bdb5905c524c81b7b9050353dabda4 P aa90039972cc480089bed3a1f3bf952c [LEADER]: Becoming Leader. State: Replica: aa90039972cc480089bed3a1f3bf952c, State: 1, Role: LEADER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:02:59.216204 19675 consensus_queue.cc:119] T 36bdb5905c524c81b7b9050353dabda4 P aa90039972cc480089bed3a1f3bf952c [LEADER]: queue going to LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 1, Majority size: 2, State: 1, Mode: LEADER I0219 21:02:59.215627 19828 raft_consensus.cc:194] T 36bdb5905c524c81b7b9050353dabda4 P f094cd13cf8c48fcadfd7dfd3976a398 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0219 21:02:59.213394 19845 tablet_bootstrap.cc:290] Tablet 3278d9fd9fa94c2ca65a21e36b338e58: No bootstrap required, opened a new log I0219 21:02:59.217866 19828 raft_consensus.cc:399] T 36bdb5905c524c81b7b9050353dabda4 P f094cd13cf8c48fcadfd7dfd3976a398 [FOLLOWER]: Becoming Follower/Learner. State: Replica: f094cd13cf8c48fcadfd7dfd3976a398, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:02:59.221590 19845 ts_tablet_manager.cc:319] Time spent tablet 3278d9fd9fa94c2ca65a21e36b338e58 bootstrap: real 0.182s user 0.016s sys 0.016s I0219 21:02:59.221581 19828 consensus_queue.cc:127] T 36bdb5905c524c81b7b9050353dabda4 P f094cd13cf8c48fcadfd7dfd3976a398 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0219 21:02:59.218750 19851 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 37ade4af36924cf1a3f53ac08ca30507 creating new one. I0219 21:02:59.224536 19828 ts_tablet_manager.cc:339] Time spent starting tablet 36bdb5905c524c81b7b9050353dabda4: real 0.017s user 0.008s sys 0.001s I0219 21:02:59.226752 19846 tablet_bootstrap.cc:290] Tablet 37ade4af36924cf1a3f53ac08ca30507: No bootstrap required, opened a new log I0219 21:02:59.231987 19846 ts_tablet_manager.cc:319] Time spent tablet 37ade4af36924cf1a3f53ac08ca30507 bootstrap: real 0.175s user 0.016s sys 0.009s I0219 21:02:59.235818 19845 raft_consensus.cc:194] T 3278d9fd9fa94c2ca65a21e36b338e58 P f094cd13cf8c48fcadfd7dfd3976a398 [CANDIDATE]: Replica starting. Triggering 0 pending transactions. I0219 21:02:59.252866 19845 raft_consensus.cc:361] T 3278d9fd9fa94c2ca65a21e36b338e58 P f094cd13cf8c48fcadfd7dfd3976a398 [LEADER]: Becoming Leader. State: Replica: f094cd13cf8c48fcadfd7dfd3976a398, State: 1, Role: LEADER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:02:59.254120 19845 consensus_queue.cc:119] T 3278d9fd9fa94c2ca65a21e36b338e58 P f094cd13cf8c48fcadfd7dfd3976a398 [LEADER]: queue going to LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 1, Majority size: 2, State: 1, Mode: LEADER I0219 21:02:59.258013 19856 tablet_bootstrap.cc:290] Tablet 36bdb5905c524c81b7b9050353dabda4: No bootstrap required, opened a new log I0219 21:02:59.257987 19846 raft_consensus.cc:194] T 37ade4af36924cf1a3f53ac08ca30507 P 504935b256704386aff5580d38efd8da [CANDIDATE]: Replica starting. Triggering 0 pending transactions. W0219 21:02:59.258553 19869 raft_consensus_state.cc:477] T 36bdb5905c524c81b7b9050353dabda4 P aa90039972cc480089bed3a1f3bf952c [LEADER]: Can't advance the committed index across term boundaries yet. Last committed operation was: term: 0 index: 0 New majority replicated is: term: 0 index: 0. Current term is: 1 I0219 21:02:59.259618 19675 ts_tablet_manager.cc:339] Time spent starting tablet 36bdb5905c524c81b7b9050353dabda4: real 0.222s user 0.025s sys 0.014s I0219 21:02:59.261473 19851 tablet_bootstrap.cc:290] Tablet 37ade4af36924cf1a3f53ac08ca30507: No bootstrap required, opened a new log I0219 21:02:59.265848 19851 ts_tablet_manager.cc:319] Time spent tablet 37ade4af36924cf1a3f53ac08ca30507 bootstrap: real 0.130s user 0.017s sys 0.007s I0219 21:02:59.265946 19856 ts_tablet_manager.cc:319] Time spent tablet 36bdb5905c524c81b7b9050353dabda4 bootstrap: real 0.114s user 0.015s sys 0.009s I0219 21:02:59.274379 19846 raft_consensus.cc:361] T 37ade4af36924cf1a3f53ac08ca30507 P 504935b256704386aff5580d38efd8da [LEADER]: Becoming Leader. State: Replica: 504935b256704386aff5580d38efd8da, State: 1, Role: LEADER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:02:59.274847 19846 consensus_queue.cc:119] T 37ade4af36924cf1a3f53ac08ca30507 P 504935b256704386aff5580d38efd8da [LEADER]: queue going to LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 1, Majority size: 2, State: 1, Mode: LEADER I0219 21:02:59.293237 19851 raft_consensus.cc:194] T 37ade4af36924cf1a3f53ac08ca30507 P f094cd13cf8c48fcadfd7dfd3976a398 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0219 21:02:59.293597 19851 raft_consensus.cc:399] T 37ade4af36924cf1a3f53ac08ca30507 P f094cd13cf8c48fcadfd7dfd3976a398 [FOLLOWER]: Becoming Follower/Learner. State: Replica: f094cd13cf8c48fcadfd7dfd3976a398, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:02:59.294157 19851 consensus_queue.cc:127] T 37ade4af36924cf1a3f53ac08ca30507 P f094cd13cf8c48fcadfd7dfd3976a398 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0219 21:02:59.294618 19856 raft_consensus.cc:194] T 36bdb5905c524c81b7b9050353dabda4 P 504935b256704386aff5580d38efd8da [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0219 21:02:59.295922 19851 ts_tablet_manager.cc:339] Time spent starting tablet 37ade4af36924cf1a3f53ac08ca30507: real 0.030s user 0.007s sys 0.003s I0219 21:02:59.296427 19856 raft_consensus.cc:399] T 36bdb5905c524c81b7b9050353dabda4 P 504935b256704386aff5580d38efd8da [FOLLOWER]: Becoming Follower/Learner. State: Replica: 504935b256704386aff5580d38efd8da, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} W0219 21:02:59.297521 19883 raft_consensus_state.cc:477] T 3278d9fd9fa94c2ca65a21e36b338e58 P f094cd13cf8c48fcadfd7dfd3976a398 [LEADER]: Can't advance the committed index across term boundaries yet. Last committed operation was: term: 0 index: 0 New majority replicated is: term: 0 index: 0. Current term is: 1 I0219 21:02:59.297477 19856 consensus_queue.cc:127] T 36bdb5905c524c81b7b9050353dabda4 P 504935b256704386aff5580d38efd8da [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0219 21:02:59.299044 19845 ts_tablet_manager.cc:339] Time spent starting tablet 3278d9fd9fa94c2ca65a21e36b338e58: real 0.077s user 0.013s sys 0.009s I0219 21:02:59.301955 19846 ts_tablet_manager.cc:339] Time spent starting tablet 37ade4af36924cf1a3f53ac08ca30507: real 0.068s user 0.011s sys 0.014s W0219 21:02:59.300340 19888 raft_consensus_state.cc:477] T 37ade4af36924cf1a3f53ac08ca30507 P 504935b256704386aff5580d38efd8da [LEADER]: Can't advance the committed index across term boundaries yet. Last committed operation was: term: 0 index: 0 New majority replicated is: term: 0 index: 0. Current term is: 1 I0219 21:02:59.302997 19856 ts_tablet_manager.cc:339] Time spent starting tablet 36bdb5905c524c81b7b9050353dabda4: real 0.036s user 0.007s sys 0.004s INFO: Connected to all 3 Tablet Servers I0219 21:02:59.390071 18449 tablet_server.cc:114] TabletServer shutting down... I0219 21:02:59.414754 18449 ts_tablet_manager.cc:394] Shutting down tablet manager... I0219 21:02:59.415916 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: 37ade4af36924cf1a3f53ac08ca30507 I0219 21:02:59.416049 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(37ade4af36924cf1a3f53ac08ca30507) I0219 21:02:59.416148 18449 raft_consensus.cc:983] T 37ade4af36924cf1a3f53ac08ca30507 P f094cd13cf8c48fcadfd7dfd3976a398 [FOLLOWER]: Raft consensus shutting down. I0219 21:02:59.416589 18449 raft_consensus_state.cc:365] T 37ade4af36924cf1a3f53ac08ca30507 P f094cd13cf8c48fcadfd7dfd3976a398 [FOLLOWER]: Trying to abort 0 pending transactions. I0219 21:02:59.416697 18449 raft_consensus.cc:998] T 37ade4af36924cf1a3f53ac08ca30507 P f094cd13cf8c48fcadfd7dfd3976a398 [FOLLOWER]: Raft consensus Shutdown! I0219 21:02:59.417795 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: 36bdb5905c524c81b7b9050353dabda4 I0219 21:02:59.417917 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(36bdb5905c524c81b7b9050353dabda4) I0219 21:02:59.418007 18449 raft_consensus.cc:983] T 36bdb5905c524c81b7b9050353dabda4 P f094cd13cf8c48fcadfd7dfd3976a398 [FOLLOWER]: Raft consensus shutting down. I0219 21:02:59.418160 18449 raft_consensus_state.cc:365] T 36bdb5905c524c81b7b9050353dabda4 P f094cd13cf8c48fcadfd7dfd3976a398 [FOLLOWER]: Trying to abort 0 pending transactions. I0219 21:02:59.418261 18449 raft_consensus.cc:998] T 36bdb5905c524c81b7b9050353dabda4 P f094cd13cf8c48fcadfd7dfd3976a398 [FOLLOWER]: Raft consensus Shutdown! I0219 21:02:59.419085 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: 3278d9fd9fa94c2ca65a21e36b338e58 I0219 21:02:59.419270 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(3278d9fd9fa94c2ca65a21e36b338e58) I0219 21:02:59.419399 18449 raft_consensus.cc:983] T 3278d9fd9fa94c2ca65a21e36b338e58 P f094cd13cf8c48fcadfd7dfd3976a398 [LEADER]: Raft consensus shutting down. I0219 21:02:59.419765 18449 consensus_peers.cc:211] T 3278d9fd9fa94c2ca65a21e36b338e58 P f094cd13cf8c48fcadfd7dfd3976a398: Closing peer: aa90039972cc480089bed3a1f3bf952c I0219 21:02:59.420156 18449 consensus_peers.cc:211] T 3278d9fd9fa94c2ca65a21e36b338e58 P f094cd13cf8c48fcadfd7dfd3976a398: Closing peer: 504935b256704386aff5580d38efd8da I0219 21:02:59.420454 18449 raft_consensus_state.cc:365] T 3278d9fd9fa94c2ca65a21e36b338e58 P f094cd13cf8c48fcadfd7dfd3976a398 [LEADER]: Trying to abort 1 pending transactions. I0219 21:02:59.420558 18449 raft_consensus_state.cc:370] T 3278d9fd9fa94c2ca65a21e36b338e58 P f094cd13cf8c48fcadfd7dfd3976a398 [LEADER]: Aborting transaction as it isn't in flight: id { term: 1 index: 1 } op_type: CHANGE_CONFIG_OP change_config_request { tablet_id: "3278d9fd9fa94c2ca65a21e36b338e58" old_config { opid_index: -1 local: false peers { permanent_uuid: "f094cd13cf8c48fcadfd7dfd3976a398" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 59754 } } peers { permanent_uuid: "aa90039972cc480089bed3a1f3bf952c" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60838 } } peers { permanent_uuid: "504935b256704386aff5580d38efd8da" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 57762 } } } new_config { local: false peers { permanent_uuid: "f094cd13cf8c48fcadfd7dfd3976a398" role: LEADER last_known_addr { host: "127.0.0.1" port: 59754 } } peers { permanent_uuid: "aa90039972cc480089bed3a1f3bf952c" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60838 } } peers { permanent_uuid: "504935b256704386aff5580d38efd8da" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 57762 } } } } I0219 21:02:59.422313 18449 raft_consensus.cc:998] T 3278d9fd9fa94c2ca65a21e36b338e58 P f094cd13cf8c48fcadfd7dfd3976a398 [LEADER]: Raft consensus Shutdown! I0219 21:02:59.422560 18449 transaction_tracker.cc:126] Dumping currently running transactions: I0219 21:02:59.422673 18449 transaction_tracker.cc:128] ChangeConfigTransaction [type=REPLICA, state=ChangeConfigTransactionState [opid=term: 1 index: 1, timestamp=1, request=tablet_id: "3278d9fd9fa94c2ca65a21e36b338e58" old_config { opid_index: -1 local: false peers { permanent_uuid: "f094cd13cf8c48fcadfd7dfd3976a398" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 59754 } } peers { permanent_uuid: "aa90039972cc480089bed3a1f3bf952c" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60838 } } peers { permanent_uuid: "504935b256704386aff5580d38efd8da" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 57762 } } } new_config { local: false peers { permanent_uuid: "f094cd13cf8c48fcadfd7dfd3976a398" role: LEADER last_known_addr { host: "127.0.0.1" port: 59754 } } peers { permanent_uuid: "aa90039972cc480089bed3a1f3bf952c" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60838 } } peers { permanent_uuid: "504935b256704386aff5580d38efd8da" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 57762 } } }]] I0219 21:02:59.422907 19907 change_config_transaction.cc:129] T 3278d9fd9fa94c2ca65a21e36b338e58 P f094cd13cf8c48fcadfd7dfd3976a398: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "f094cd13cf8c48fcadfd7dfd3976a398" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 59754 } } peers { permanent_uuid: "aa90039972cc480089bed3a1f3bf952c" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60838 } } peers { permanent_uuid: "504935b256704386aff5580d38efd8da" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 57762 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "f094cd13cf8c48fcadfd7dfd3976a398" role: LEADER last_known_addr { host: "127.0.0.1" port: 59754 } } peers { permanent_uuid: "aa90039972cc480089bed3a1f3bf952c" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60838 } } peers { permanent_uuid: "504935b256704386aff5580d38efd8da" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 57762 } } I0219 21:02:59.425978 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(37ade4af36924cf1a3f53ac08ca30507) I0219 21:02:59.426398 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(37ade4af36924cf1a3f53ac08ca30507) I0219 21:02:59.426560 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(37ade4af36924cf1a3f53ac08ca30507) I0219 21:02:59.428138 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(36bdb5905c524c81b7b9050353dabda4) I0219 21:02:59.428302 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(36bdb5905c524c81b7b9050353dabda4) I0219 21:02:59.428428 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(36bdb5905c524c81b7b9050353dabda4) I0219 21:02:59.429729 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(3278d9fd9fa94c2ca65a21e36b338e58) I0219 21:02:59.430042 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(3278d9fd9fa94c2ca65a21e36b338e58) I0219 21:02:59.430160 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(3278d9fd9fa94c2ca65a21e36b338e58) I0219 21:02:59.431176 18449 tablet_server.cc:123] TabletServer shut down complete. Bye! I0219 21:02:59.431252 18449 tablet_server.cc:114] TabletServer shutting down... I0219 21:02:59.431370 18449 tablet_server.cc:123] TabletServer shut down complete. Bye! I0219 21:02:59.436012 18449 tablet_server.cc:114] TabletServer shutting down... I0219 21:02:59.453415 18449 ts_tablet_manager.cc:394] Shutting down tablet manager... I0219 21:02:59.454833 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: 37ade4af36924cf1a3f53ac08ca30507 I0219 21:02:59.455031 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(37ade4af36924cf1a3f53ac08ca30507) I0219 21:02:59.455170 18449 raft_consensus.cc:983] T 37ade4af36924cf1a3f53ac08ca30507 P aa90039972cc480089bed3a1f3bf952c [FOLLOWER]: Raft consensus shutting down. I0219 21:02:59.455342 18449 raft_consensus_state.cc:365] T 37ade4af36924cf1a3f53ac08ca30507 P aa90039972cc480089bed3a1f3bf952c [FOLLOWER]: Trying to abort 0 pending transactions. I0219 21:02:59.455447 18449 raft_consensus.cc:998] T 37ade4af36924cf1a3f53ac08ca30507 P aa90039972cc480089bed3a1f3bf952c [FOLLOWER]: Raft consensus Shutdown! I0219 21:02:59.457211 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: 36bdb5905c524c81b7b9050353dabda4 I0219 21:02:59.457329 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(36bdb5905c524c81b7b9050353dabda4) I0219 21:02:59.457418 18449 raft_consensus.cc:983] T 36bdb5905c524c81b7b9050353dabda4 P aa90039972cc480089bed3a1f3bf952c [LEADER]: Raft consensus shutting down. I0219 21:02:59.457972 18449 consensus_peers.cc:211] T 36bdb5905c524c81b7b9050353dabda4 P aa90039972cc480089bed3a1f3bf952c: Closing peer: f094cd13cf8c48fcadfd7dfd3976a398 I0219 21:02:59.458822 18449 consensus_peers.cc:211] T 36bdb5905c524c81b7b9050353dabda4 P aa90039972cc480089bed3a1f3bf952c: Closing peer: 504935b256704386aff5580d38efd8da I0219 21:02:59.459112 18449 raft_consensus_state.cc:365] T 36bdb5905c524c81b7b9050353dabda4 P aa90039972cc480089bed3a1f3bf952c [LEADER]: Trying to abort 1 pending transactions. I0219 21:02:59.459211 18449 raft_consensus_state.cc:370] T 36bdb5905c524c81b7b9050353dabda4 P aa90039972cc480089bed3a1f3bf952c [LEADER]: Aborting transaction as it isn't in flight: id { term: 1 index: 1 } op_type: CHANGE_CONFIG_OP change_config_request { tablet_id: "36bdb5905c524c81b7b9050353dabda4" old_config { opid_index: -1 local: false peers { permanent_uuid: "f094cd13cf8c48fcadfd7dfd3976a398" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 59754 } } peers { permanent_uuid: "aa90039972cc480089bed3a1f3bf952c" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 60838 } } peers { permanent_uuid: "504935b256704386aff5580d38efd8da" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 57762 } } } new_config { local: false peers { permanent_uuid: "f094cd13cf8c48fcadfd7dfd3976a398" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 59754 } } peers { permanent_uuid: "aa90039972cc480089bed3a1f3bf952c" role: LEADER last_known_addr { host: "127.0.0.1" port: 60838 } } peers { permanent_uuid: "504935b256704386aff5580d38efd8da" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 57762 } } } } I0219 21:02:59.460346 18449 raft_consensus.cc:998] T 36bdb5905c524c81b7b9050353dabda4 P aa90039972cc480089bed3a1f3bf952c [LEADER]: Raft consensus Shutdown! I0219 21:02:59.460564 18449 transaction_tracker.cc:126] Dumping currently running transactions: I0219 21:02:59.460682 18449 transaction_tracker.cc:128] ChangeConfigTransaction [type=REPLICA, state=ChangeConfigTransactionState [opid=term: 1 index: 1, timestamp=1, request=tablet_id: "36bdb5905c524c81b7b9050353dabda4" old_config { opid_index: -1 local: false peers { permanent_uuid: "f094cd13cf8c48fcadfd7dfd3976a398" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 59754 } } peers { permanent_uuid: "aa90039972cc480089bed3a1f3bf952c" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 60838 } } peers { permanent_uuid: "504935b256704386aff5580d38efd8da" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 57762 } } } new_config { local: false peers { permanent_uuid: "f094cd13cf8c48fcadfd7dfd3976a398" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 59754 } } peers { permanent_uuid: "aa90039972cc480089bed3a1f3bf952c" role: LEADER last_known_addr { host: "127.0.0.1" port: 60838 } } peers { permanent_uuid: "504935b256704386aff5580d38efd8da" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 57762 } } }]] I0219 21:02:59.460978 19928 change_config_transaction.cc:129] T 36bdb5905c524c81b7b9050353dabda4 P aa90039972cc480089bed3a1f3bf952c: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "f094cd13cf8c48fcadfd7dfd3976a398" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 59754 } } peers { permanent_uuid: "aa90039972cc480089bed3a1f3bf952c" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 60838 } } peers { permanent_uuid: "504935b256704386aff5580d38efd8da" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 57762 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "f094cd13cf8c48fcadfd7dfd3976a398" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 59754 } } peers { permanent_uuid: "aa90039972cc480089bed3a1f3bf952c" role: LEADER last_known_addr { host: "127.0.0.1" port: 60838 } } peers { permanent_uuid: "504935b256704386aff5580d38efd8da" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 57762 } } I0219 21:02:59.461721 18449 transaction_tracker.cc:126] Dumping currently running transactions: I0219 21:02:59.461807 18449 transaction_tracker.cc:128] ChangeConfigTransaction [type=REPLICA, state=ChangeConfigTransactionState [opid=term: 1 index: 1, timestamp=1, request=(none)]] I0219 21:02:59.464336 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: 3278d9fd9fa94c2ca65a21e36b338e58 I0219 21:02:59.464452 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(3278d9fd9fa94c2ca65a21e36b338e58) I0219 21:02:59.464558 18449 raft_consensus.cc:983] T 3278d9fd9fa94c2ca65a21e36b338e58 P aa90039972cc480089bed3a1f3bf952c [FOLLOWER]: Raft consensus shutting down. I0219 21:02:59.464704 18449 raft_consensus_state.cc:365] T 3278d9fd9fa94c2ca65a21e36b338e58 P aa90039972cc480089bed3a1f3bf952c [FOLLOWER]: Trying to abort 0 pending transactions. I0219 21:02:59.464818 18449 raft_consensus.cc:998] T 3278d9fd9fa94c2ca65a21e36b338e58 P aa90039972cc480089bed3a1f3bf952c [FOLLOWER]: Raft consensus Shutdown! I0219 21:02:59.466583 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(37ade4af36924cf1a3f53ac08ca30507) I0219 21:02:59.466701 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(37ade4af36924cf1a3f53ac08ca30507) I0219 21:02:59.467058 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(37ade4af36924cf1a3f53ac08ca30507) I0219 21:02:59.468189 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(36bdb5905c524c81b7b9050353dabda4) I0219 21:02:59.468575 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(36bdb5905c524c81b7b9050353dabda4) I0219 21:02:59.468729 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(36bdb5905c524c81b7b9050353dabda4) I0219 21:02:59.469576 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(3278d9fd9fa94c2ca65a21e36b338e58) I0219 21:02:59.469676 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(3278d9fd9fa94c2ca65a21e36b338e58) I0219 21:02:59.469771 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(3278d9fd9fa94c2ca65a21e36b338e58) I0219 21:02:59.471590 18449 tablet_server.cc:123] TabletServer shut down complete. Bye! I0219 21:02:59.471699 18449 tablet_server.cc:114] TabletServer shutting down... I0219 21:02:59.471878 18449 tablet_server.cc:123] TabletServer shut down complete. Bye! I0219 21:02:59.477183 18449 tablet_server.cc:114] TabletServer shutting down... I0219 21:02:59.501783 18449 ts_tablet_manager.cc:394] Shutting down tablet manager... I0219 21:02:59.502624 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: 36bdb5905c524c81b7b9050353dabda4 I0219 21:02:59.503298 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(36bdb5905c524c81b7b9050353dabda4) I0219 21:02:59.503384 18449 raft_consensus.cc:983] T 36bdb5905c524c81b7b9050353dabda4 P 504935b256704386aff5580d38efd8da [FOLLOWER]: Raft consensus shutting down. I0219 21:02:59.503533 18449 raft_consensus_state.cc:365] T 36bdb5905c524c81b7b9050353dabda4 P 504935b256704386aff5580d38efd8da [FOLLOWER]: Trying to abort 0 pending transactions. I0219 21:02:59.503634 18449 raft_consensus.cc:998] T 36bdb5905c524c81b7b9050353dabda4 P 504935b256704386aff5580d38efd8da [FOLLOWER]: Raft consensus Shutdown! I0219 21:02:59.505915 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: 37ade4af36924cf1a3f53ac08ca30507 I0219 21:02:59.506145 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(37ade4af36924cf1a3f53ac08ca30507) I0219 21:02:59.506283 18449 raft_consensus.cc:983] T 37ade4af36924cf1a3f53ac08ca30507 P 504935b256704386aff5580d38efd8da [LEADER]: Raft consensus shutting down. I0219 21:02:59.506952 18449 consensus_peers.cc:211] T 37ade4af36924cf1a3f53ac08ca30507 P 504935b256704386aff5580d38efd8da: Closing peer: f094cd13cf8c48fcadfd7dfd3976a398 I0219 21:02:59.508060 18449 consensus_peers.cc:211] T 37ade4af36924cf1a3f53ac08ca30507 P 504935b256704386aff5580d38efd8da: Closing peer: aa90039972cc480089bed3a1f3bf952c I0219 21:02:59.509654 18449 raft_consensus_state.cc:365] T 37ade4af36924cf1a3f53ac08ca30507 P 504935b256704386aff5580d38efd8da [LEADER]: Trying to abort 1 pending transactions. I0219 21:02:59.509815 18449 raft_consensus_state.cc:370] T 37ade4af36924cf1a3f53ac08ca30507 P 504935b256704386aff5580d38efd8da [LEADER]: Aborting transaction as it isn't in flight: id { term: 1 index: 1 } op_type: CHANGE_CONFIG_OP change_config_request { tablet_id: "37ade4af36924cf1a3f53ac08ca30507" old_config { opid_index: -1 local: false peers { permanent_uuid: "f094cd13cf8c48fcadfd7dfd3976a398" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 59754 } } peers { permanent_uuid: "aa90039972cc480089bed3a1f3bf952c" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60838 } } peers { permanent_uuid: "504935b256704386aff5580d38efd8da" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 57762 } } } new_config { local: false peers { permanent_uuid: "f094cd13cf8c48fcadfd7dfd3976a398" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 59754 } } peers { permanent_uuid: "aa90039972cc480089bed3a1f3bf952c" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60838 } } peers { permanent_uuid: "504935b256704386aff5580d38efd8da" role: LEADER last_known_addr { host: "127.0.0.1" port: 57762 } } } } I0219 21:02:59.511096 18449 raft_consensus.cc:998] T 37ade4af36924cf1a3f53ac08ca30507 P 504935b256704386aff5580d38efd8da [LEADER]: Raft consensus Shutdown! I0219 21:02:59.511350 18449 transaction_tracker.cc:126] Dumping currently running transactions: I0219 21:02:59.511482 18449 transaction_tracker.cc:128] ChangeConfigTransaction [type=REPLICA, state=ChangeConfigTransactionState [opid=term: 1 index: 1, timestamp=1, request=tablet_id: "37ade4af36924cf1a3f53ac08ca30507" old_config { opid_index: -1 local: false peers { permanent_uuid: "f094cd13cf8c48fcadfd7dfd3976a398" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 59754 } } peers { permanent_uuid: "aa90039972cc480089bed3a1f3bf952c" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60838 } } peers { permanent_uuid: "504935b256704386aff5580d38efd8da" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 57762 } } } new_config { local: false peers { permanent_uuid: "f094cd13cf8c48fcadfd7dfd3976a398" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 59754 } } peers { permanent_uuid: "aa90039972cc480089bed3a1f3bf952c" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60838 } } peers { permanent_uuid: "504935b256704386aff5580d38efd8da" role: LEADER last_known_addr { host: "127.0.0.1" port: 57762 } } }]] I0219 21:02:59.511893 19963 change_config_transaction.cc:129] T 37ade4af36924cf1a3f53ac08ca30507 P 504935b256704386aff5580d38efd8da: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "f094cd13cf8c48fcadfd7dfd3976a398" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 59754 } } peers { permanent_uuid: "aa90039972cc480089bed3a1f3bf952c" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60838 } } peers { permanent_uuid: "504935b256704386aff5580d38efd8da" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 57762 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "f094cd13cf8c48fcadfd7dfd3976a398" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 59754 } } peers { permanent_uuid: "aa90039972cc480089bed3a1f3bf952c" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60838 } } peers { permanent_uuid: "504935b256704386aff5580d38efd8da" role: LEADER last_known_addr { host: "127.0.0.1" port: 57762 } } I0219 21:02:59.513877 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: 3278d9fd9fa94c2ca65a21e36b338e58 I0219 21:02:59.514022 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(3278d9fd9fa94c2ca65a21e36b338e58) I0219 21:02:59.514138 18449 raft_consensus.cc:983] T 3278d9fd9fa94c2ca65a21e36b338e58 P 504935b256704386aff5580d38efd8da [FOLLOWER]: Raft consensus shutting down. I0219 21:02:59.514333 18449 raft_consensus_state.cc:365] T 3278d9fd9fa94c2ca65a21e36b338e58 P 504935b256704386aff5580d38efd8da [FOLLOWER]: Trying to abort 0 pending transactions. I0219 21:02:59.514493 18449 raft_consensus.cc:998] T 3278d9fd9fa94c2ca65a21e36b338e58 P 504935b256704386aff5580d38efd8da [FOLLOWER]: Raft consensus Shutdown! I0219 21:02:59.515952 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(36bdb5905c524c81b7b9050353dabda4) I0219 21:02:59.516054 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(36bdb5905c524c81b7b9050353dabda4) I0219 21:02:59.516137 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(36bdb5905c524c81b7b9050353dabda4) I0219 21:02:59.516942 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(37ade4af36924cf1a3f53ac08ca30507) I0219 21:02:59.517084 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(37ade4af36924cf1a3f53ac08ca30507) I0219 21:02:59.517215 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(37ade4af36924cf1a3f53ac08ca30507) I0219 21:02:59.518208 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(3278d9fd9fa94c2ca65a21e36b338e58) I0219 21:02:59.518357 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(3278d9fd9fa94c2ca65a21e36b338e58) I0219 21:02:59.518530 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(3278d9fd9fa94c2ca65a21e36b338e58) I0219 21:02:59.519413 18449 tablet_server.cc:123] TabletServer shut down complete. Bye! I0219 21:02:59.519506 18449 tablet_server.cc:114] TabletServer shutting down... I0219 21:02:59.519621 18449 tablet_server.cc:123] TabletServer shut down complete. Bye! I0219 21:02:59.526892 18449 master.cc:130] Master@127.0.0.1:37391 shutting down... I0219 21:02:59.539866 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: 00000000000000000000000000000000 I0219 21:02:59.541906 18449 master.cc:133] Master@127.0.0.1:37391 shutdown complete. [ OK ] RemoteKsckTest.TestTabletServersOk (2117 ms) [ RUN ] RemoteKsckTest.TestTableConsistency I0219 21:02:59.573992 18449 test_util.cc:117] Using random seed: 1424408579 I0219 21:02:59.601863 18449 fs_manager.cc:193] Generated new instance metadata in path /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestTableConsistency.1424408574588976-18449/minicluster-data/master-0-root/instance: uuid: "bf695c6bf23342528700b945916882a4" format_stamp: "Formatted at 2015-02-20 05:02:59 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:02:59.617518 18449 fs_manager.cc:131] Opened local filesystem: /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestTableConsistency.1424408574588976-18449/minicluster-data/master-0-root uuid: "bf695c6bf23342528700b945916882a4" format_stamp: "Formatted at 2015-02-20 05:02:59 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:02:59.648072 18449 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:59226 I0219 21:02:59.648617 18449 webserver.cc:108] Starting webserver on 0.0.0.0:0 I0219 21:02:59.648733 18449 webserver.cc:117] Document root disabled I0219 21:02:59.649507 18449 webserver.cc:197] Webserver started. Bound to: http://0.0.0.0:52644/ I0219 21:02:59.673554 20047 tablet_bootstrap.cc:290] Tablet 00000000000000000000000000000000: Bootstrap starting. I0219 21:02:59.677551 20047 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 00000000000000000000000000000000 creating new one. I0219 21:02:59.714498 20047 tablet_bootstrap.cc:290] Tablet 00000000000000000000000000000000: No bootstrap required, opened a new log I0219 21:02:59.758831 20050 change_config_transaction.cc:129] T 00000000000000000000000000000000 P bf695c6bf23342528700b945916882a4: Configuration changed Changed from: opid_index: -1 local: true peers { permanent_uuid: "bf695c6bf23342528700b945916882a4" role: LEADER } Changed to: opid_index: 1 local: true peers { permanent_uuid: "bf695c6bf23342528700b945916882a4" role: LEADER } I0219 21:02:59.759268 20047 sys_catalog.cc:268] T 00000000000000000000000000000000 P bf695c6bf23342528700b945916882a4 [sys.catalog]: configured and running, proceeding with master startup. I0219 21:02:59.759274 20050 sys_catalog.cc:202] T 00000000000000000000000000000000 P bf695c6bf23342528700b945916882a4 [sys.catalog]: SysCatalogTable state changed. New quorum config:opid_index: 1 local: true peers { permanent_uuid: "bf695c6bf23342528700b945916882a4" role: LEADER } I0219 21:02:59.761219 20050 sys_catalog.cc:205] T 00000000000000000000000000000000 P bf695c6bf23342528700b945916882a4 [sys.catalog]: This master's current role is: LEADER, previous role was: FOLLOWER I0219 21:02:59.763442 20064 catalog_manager.cc:397] Loading tables and tablets metadata into memory... I0219 21:02:59.826340 18449 fs_manager.cc:193] Generated new instance metadata in path /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestTableConsistency.1424408574588976-18449/minicluster-data/ts-0-root/instance: uuid: "24762863e7904854bc0111677b169201" format_stamp: "Formatted at 2015-02-20 05:02:59 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:02:59.849529 18449 fs_manager.cc:131] Opened local filesystem: /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestTableConsistency.1424408574588976-18449/minicluster-data/ts-0-root uuid: "24762863e7904854bc0111677b169201" format_stamp: "Formatted at 2015-02-20 05:02:59 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:02:59.876107 18449 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:60547 I0219 21:02:59.876710 18449 webserver.cc:108] Starting webserver on 0.0.0.0:0 I0219 21:02:59.876826 18449 webserver.cc:117] Document root disabled I0219 21:02:59.877646 18449 webserver.cc:197] Webserver started. Bound to: http://0.0.0.0:34431/ I0219 21:02:59.878207 18449 maintenance_manager.cc:111] MaintenanceManager: targeting memory size of 23.515860 GB I0219 21:02:59.886924 20120 heartbeater.cc:219] Connected to a leader master server at 127.0.0.1:59226 I0219 21:02:59.887066 20120 heartbeater.cc:289] Registering TS with master... I0219 21:02:59.887213 20120 heartbeater.cc:295] Sending a full tablet report to master... I0219 21:02:59.888082 20022 ts_manager.cc:66] Registered new tablet server { permanent_uuid: "24762863e7904854bc0111677b169201" instance_seqno: 1424408579875301 } with Master I0219 21:02:59.917155 18449 fs_manager.cc:193] Generated new instance metadata in path /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestTableConsistency.1424408574588976-18449/minicluster-data/ts-1-root/instance: uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" format_stamp: "Formatted at 2015-02-20 05:02:59 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:02:59.954041 18449 fs_manager.cc:131] Opened local filesystem: /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestTableConsistency.1424408574588976-18449/minicluster-data/ts-1-root uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" format_stamp: "Formatted at 2015-02-20 05:02:59 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:03:00.008872 18449 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:35823 I0219 21:03:00.009419 18449 webserver.cc:108] Starting webserver on 0.0.0.0:0 I0219 21:03:00.009531 18449 webserver.cc:117] Document root disabled I0219 21:03:00.010870 18449 webserver.cc:197] Webserver started. Bound to: http://0.0.0.0:54779/ I0219 21:03:00.012059 18449 maintenance_manager.cc:111] MaintenanceManager: targeting memory size of 23.515860 GB I0219 21:03:00.017751 20169 heartbeater.cc:219] Connected to a leader master server at 127.0.0.1:59226 I0219 21:03:00.017922 20169 heartbeater.cc:289] Registering TS with master... I0219 21:03:00.018103 20169 heartbeater.cc:295] Sending a full tablet report to master... I0219 21:03:00.019322 20025 ts_manager.cc:66] Registered new tablet server { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" instance_seqno: 1424408580007333 } with Master I0219 21:03:00.052701 18449 fs_manager.cc:193] Generated new instance metadata in path /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestTableConsistency.1424408574588976-18449/minicluster-data/ts-2-root/instance: uuid: "7b2410347ccc495b9ab91368eb08dcad" format_stamp: "Formatted at 2015-02-20 05:03:00 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:03:00.082680 18449 fs_manager.cc:131] Opened local filesystem: /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestTableConsistency.1424408574588976-18449/minicluster-data/ts-2-root uuid: "7b2410347ccc495b9ab91368eb08dcad" format_stamp: "Formatted at 2015-02-20 05:03:00 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:03:00.128952 18449 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:43493 I0219 21:03:00.129324 18449 webserver.cc:108] Starting webserver on 0.0.0.0:0 I0219 21:03:00.129401 18449 webserver.cc:117] Document root disabled I0219 21:03:00.130468 18449 webserver.cc:197] Webserver started. Bound to: http://0.0.0.0:36282/ I0219 21:03:00.131597 18449 maintenance_manager.cc:111] MaintenanceManager: targeting memory size of 23.515860 GB I0219 21:03:00.136648 20215 heartbeater.cc:219] Connected to a leader master server at 127.0.0.1:59226 I0219 21:03:00.136863 20215 heartbeater.cc:289] Registering TS with master... I0219 21:03:00.137099 20215 heartbeater.cc:295] Sending a full tablet report to master... I0219 21:03:00.138234 20025 ts_manager.cc:66] Registered new tablet server { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" instance_seqno: 1424408580127682 } with Master I0219 21:03:00.138808 18449 mini_cluster.cc:276] 3 TS(s) registered with Master after 0.00585524s I0219 21:03:00.150691 20032 catalog_manager.cc:562] CreateTable from {real_user=jenkins, eff_user=} at 127.0.0.1:34192: name: "ksck-test-table" schema { columns { name: "key" type: UINT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION } columns { name: "int_val" type: UINT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION } } pre_split_keys: "\000\000\000\000" pre_split_keys: "\000\000\000\001" num_replicas: 3 I0219 21:03:00.181020 20189 tablet_service.cc:389] Processing CreateTablet for tablet 8779f0797f3a4873b734f2da3cdf40b7 (table=ksck-test-table [id=465601cc46d84188851289da1a3681a3]), range=["", "\x00\x00\x00\x00"] I0219 21:03:00.181504 20190 tablet_service.cc:389] Processing CreateTablet for tablet 160232a9df364ed6aa770e351dbde036 (table=ksck-test-table [id=465601cc46d84188851289da1a3681a3]), range=["\x00\x00\x00\x01", ""] I0219 21:03:00.182366 20191 tablet_service.cc:389] Processing CreateTablet for tablet 51808f4979294e5b90477b8324ff8bfa (table=ksck-test-table [id=465601cc46d84188851289da1a3681a3]), range=["\x00\x00\x00\x00", "\x00\x00\x00\x01"] I0219 21:03:00.193116 20099 tablet_service.cc:389] Processing CreateTablet for tablet 8779f0797f3a4873b734f2da3cdf40b7 (table=ksck-test-table [id=465601cc46d84188851289da1a3681a3]), range=["", "\x00\x00\x00\x00"] I0219 21:03:00.193286 20100 tablet_service.cc:389] Processing CreateTablet for tablet 51808f4979294e5b90477b8324ff8bfa (table=ksck-test-table [id=465601cc46d84188851289da1a3681a3]), range=["\x00\x00\x00\x00", "\x00\x00\x00\x01"] I0219 21:03:00.193470 20146 tablet_service.cc:389] Processing CreateTablet for tablet 8779f0797f3a4873b734f2da3cdf40b7 (table=ksck-test-table [id=465601cc46d84188851289da1a3681a3]), range=["", "\x00\x00\x00\x00"] I0219 21:03:00.193714 20147 tablet_service.cc:389] Processing CreateTablet for tablet 160232a9df364ed6aa770e351dbde036 (table=ksck-test-table [id=465601cc46d84188851289da1a3681a3]), range=["\x00\x00\x00\x01", ""] I0219 21:03:00.194044 20098 tablet_service.cc:389] Processing CreateTablet for tablet 160232a9df364ed6aa770e351dbde036 (table=ksck-test-table [id=465601cc46d84188851289da1a3681a3]), range=["\x00\x00\x00\x01", ""] I0219 21:03:00.195133 20148 tablet_service.cc:389] Processing CreateTablet for tablet 51808f4979294e5b90477b8324ff8bfa (table=ksck-test-table [id=465601cc46d84188851289da1a3681a3]), range=["\x00\x00\x00\x00", "\x00\x00\x00\x01"] I0219 21:03:00.260031 20191 ts_tablet_manager.cc:449] Registered tablet 51808f4979294e5b90477b8324ff8bfa I0219 21:03:00.294311 20296 ts_tablet_manager.cc:314] Bootstrapping tablet: 51808f4979294e5b90477b8324ff8bfa I0219 21:03:00.357206 20296 tablet_bootstrap.cc:290] Tablet 51808f4979294e5b90477b8324ff8bfa: Bootstrap starting. I0219 21:03:00.366107 20296 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 51808f4979294e5b90477b8324ff8bfa creating new one. I0219 21:03:00.530920 20189 ts_tablet_manager.cc:449] Registered tablet 8779f0797f3a4873b734f2da3cdf40b7 I0219 21:03:00.569402 20296 tablet_bootstrap.cc:290] Tablet 51808f4979294e5b90477b8324ff8bfa: No bootstrap required, opened a new log I0219 21:03:00.571391 20296 ts_tablet_manager.cc:319] Time spent tablet 51808f4979294e5b90477b8324ff8bfa bootstrap: real 0.277s user 0.016s sys 0.013s I0219 21:03:00.582393 20296 raft_consensus.cc:194] T 51808f4979294e5b90477b8324ff8bfa P 7b2410347ccc495b9ab91368eb08dcad [CANDIDATE]: Replica starting. Triggering 0 pending transactions. I0219 21:03:00.633579 20408 ts_tablet_manager.cc:314] Bootstrapping tablet: 8779f0797f3a4873b734f2da3cdf40b7 I0219 21:03:00.664688 20099 ts_tablet_manager.cc:449] Registered tablet 8779f0797f3a4873b734f2da3cdf40b7 I0219 21:03:00.668587 20408 tablet_bootstrap.cc:290] Tablet 8779f0797f3a4873b734f2da3cdf40b7: Bootstrap starting. I0219 21:03:00.729640 20408 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 8779f0797f3a4873b734f2da3cdf40b7 creating new one. I0219 21:03:00.731060 20458 ts_tablet_manager.cc:314] Bootstrapping tablet: 8779f0797f3a4873b734f2da3cdf40b7 I0219 21:03:00.773618 20458 tablet_bootstrap.cc:290] Tablet 8779f0797f3a4873b734f2da3cdf40b7: Bootstrap starting. I0219 21:03:00.788894 20458 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 8779f0797f3a4873b734f2da3cdf40b7 creating new one. I0219 21:03:00.808789 20147 ts_tablet_manager.cc:449] Registered tablet 160232a9df364ed6aa770e351dbde036 I0219 21:03:00.817106 20408 tablet_bootstrap.cc:290] Tablet 8779f0797f3a4873b734f2da3cdf40b7: No bootstrap required, opened a new log I0219 21:03:00.819511 20408 ts_tablet_manager.cc:319] Time spent tablet 8779f0797f3a4873b734f2da3cdf40b7 bootstrap: real 0.186s user 0.014s sys 0.010s I0219 21:03:00.839953 20508 ts_tablet_manager.cc:314] Bootstrapping tablet: 160232a9df364ed6aa770e351dbde036 I0219 21:03:00.844363 20408 raft_consensus.cc:194] T 8779f0797f3a4873b734f2da3cdf40b7 P 7b2410347ccc495b9ab91368eb08dcad [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0219 21:03:00.844801 20408 raft_consensus.cc:399] T 8779f0797f3a4873b734f2da3cdf40b7 P 7b2410347ccc495b9ab91368eb08dcad [FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b2410347ccc495b9ab91368eb08dcad, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:03:00.847370 20408 consensus_queue.cc:127] T 8779f0797f3a4873b734f2da3cdf40b7 P 7b2410347ccc495b9ab91368eb08dcad [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0219 21:03:00.851361 20148 ts_tablet_manager.cc:449] Registered tablet 51808f4979294e5b90477b8324ff8bfa I0219 21:03:00.853871 20408 ts_tablet_manager.cc:339] Time spent starting tablet 8779f0797f3a4873b734f2da3cdf40b7: real 0.034s user 0.008s sys 0.002s I0219 21:03:00.872191 20508 tablet_bootstrap.cc:290] Tablet 160232a9df364ed6aa770e351dbde036: Bootstrap starting. I0219 21:03:00.875088 20458 tablet_bootstrap.cc:290] Tablet 8779f0797f3a4873b734f2da3cdf40b7: No bootstrap required, opened a new log I0219 21:03:00.879184 20458 ts_tablet_manager.cc:319] Time spent tablet 8779f0797f3a4873b734f2da3cdf40b7 bootstrap: real 0.148s user 0.014s sys 0.010s I0219 21:03:00.888578 20508 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 160232a9df364ed6aa770e351dbde036 creating new one. I0219 21:03:00.899883 20458 raft_consensus.cc:194] T 8779f0797f3a4873b734f2da3cdf40b7 P 24762863e7904854bc0111677b169201 [CANDIDATE]: Replica starting. Triggering 0 pending transactions. I0219 21:03:00.935272 20510 ts_tablet_manager.cc:314] Bootstrapping tablet: 51808f4979294e5b90477b8324ff8bfa I0219 21:03:00.968139 20510 tablet_bootstrap.cc:290] Tablet 51808f4979294e5b90477b8324ff8bfa: Bootstrap starting. I0219 21:03:00.986871 20510 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 51808f4979294e5b90477b8324ff8bfa creating new one. I0219 21:03:00.990454 20508 tablet_bootstrap.cc:290] Tablet 160232a9df364ed6aa770e351dbde036: No bootstrap required, opened a new log I0219 21:03:00.994400 20508 ts_tablet_manager.cc:319] Time spent tablet 160232a9df364ed6aa770e351dbde036 bootstrap: real 0.154s user 0.013s sys 0.012s I0219 21:03:01.001696 20296 raft_consensus.cc:361] T 51808f4979294e5b90477b8324ff8bfa P 7b2410347ccc495b9ab91368eb08dcad [LEADER]: Becoming Leader. State: Replica: 7b2410347ccc495b9ab91368eb08dcad, State: 1, Role: LEADER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:03:01.002413 20296 consensus_queue.cc:119] T 51808f4979294e5b90477b8324ff8bfa P 7b2410347ccc495b9ab91368eb08dcad [LEADER]: queue going to LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 1, Majority size: 2, State: 1, Mode: LEADER I0219 21:03:01.008663 20508 raft_consensus.cc:194] T 160232a9df364ed6aa770e351dbde036 P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [CANDIDATE]: Replica starting. Triggering 0 pending transactions. I0219 21:03:01.016744 20190 ts_tablet_manager.cc:449] Registered tablet 160232a9df364ed6aa770e351dbde036 I0219 21:03:01.017307 20408 ts_tablet_manager.cc:314] Bootstrapping tablet: 160232a9df364ed6aa770e351dbde036 I0219 21:03:01.053982 20098 ts_tablet_manager.cc:449] Registered tablet 160232a9df364ed6aa770e351dbde036 I0219 21:03:01.055706 20510 tablet_bootstrap.cc:290] Tablet 51808f4979294e5b90477b8324ff8bfa: No bootstrap required, opened a new log I0219 21:03:01.058646 20510 ts_tablet_manager.cc:319] Time spent tablet 51808f4979294e5b90477b8324ff8bfa bootstrap: real 0.123s user 0.014s sys 0.017s I0219 21:03:01.069594 20408 tablet_bootstrap.cc:290] Tablet 160232a9df364ed6aa770e351dbde036: Bootstrap starting. I0219 21:03:01.098258 20510 raft_consensus.cc:194] T 51808f4979294e5b90477b8324ff8bfa P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0219 21:03:01.100623 20510 raft_consensus.cc:399] T 51808f4979294e5b90477b8324ff8bfa P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f1cbdf7d0649d9ac8ffdaaa4e75f15, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:03:01.101163 20510 consensus_queue.cc:127] T 51808f4979294e5b90477b8324ff8bfa P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0219 21:03:01.106289 20510 ts_tablet_manager.cc:339] Time spent starting tablet 51808f4979294e5b90477b8324ff8bfa: real 0.047s user 0.003s sys 0.007s I0219 21:03:01.114701 20408 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 160232a9df364ed6aa770e351dbde036 creating new one. I0219 21:03:01.122151 20568 ts_tablet_manager.cc:314] Bootstrapping tablet: 160232a9df364ed6aa770e351dbde036 I0219 21:03:01.122870 20296 ts_tablet_manager.cc:339] Time spent starting tablet 51808f4979294e5b90477b8324ff8bfa: real 0.551s user 0.044s sys 0.023s W0219 21:03:01.123090 20296 ts_tablet_manager.cc:373] Tablet startup for 51808f4979294e5b90477b8324ff8bfa took 551ms W0219 21:03:01.125710 20575 raft_consensus_state.cc:477] T 51808f4979294e5b90477b8324ff8bfa P 7b2410347ccc495b9ab91368eb08dcad [LEADER]: Can't advance the committed index across term boundaries yet. Last committed operation was: term: 0 index: 0 New majority replicated is: term: 0 index: 0. Current term is: 1 W0219 21:03:01.123363 20296 ts_tablet_manager.cc:375] Trace: 0219 21:03:00.181108 (+ 0us) service_pool.cc:91] Inserting onto call queue 0219 21:03:00.182090 (+ 982us) service_pool.cc:152] Handling call 0219 21:03:00.183235 (+ 1145us) ts_tablet_manager.cc:203] Acquired tablet manager lock 0219 21:03:00.184393 (+ 1158us) ts_tablet_manager.cc:227] Creating new master block... 0219 21:03:00.184710 (+ 317us) tablet_metadata.cc:390] Writing metadata block 0219 21:03:00.196189 (+ 11479us) tablet_metadata.cc:334] Metadata flushed 0219 21:03:00.196413 (+ 224us) ts_tablet_manager.cc:240] Persisting new master block... 0219 21:03:00.294413 (+ 98000us) ts_tablet_manager.cc:315] Bootstrapping tablet 0219 21:03:00.295575 (+ 1162us) inbound_call.cc:90] Queueing success response 0219 21:03:00.462103 (+166528us) log.cc:726] Preallocating 67108864 byte segment in /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestTableConsistency.1424408574588976-18449/minicluster-data/ts-2-root/wals/51808f4979294e5b90477b8324ff8bfa/.tmp.newsegmentqGVkQH 0219 21:03:00.571642 (+109539us) ts_tablet_manager.cc:340] Initializing tablet peer 0219 21:03:00.571702 (+ 60us) tablet_peer.cc:109] Creating consensus instance 0219 21:03:00.581053 (+ 9351us) tablet_peer.cc:134] Starting instrumentation 0219 21:03:00.581254 (+ 201us) tablet_peer.cc:138] TabletPeer::Init() finished 0219 21:03:00.581350 (+ 96us) ts_tablet_manager.cc:354] Starting tablet peer 0219 21:03:00.581430 (+ 80us) tablet_peer.cc:145] Starting consensus 0219 21:03:01.078117 (+496687us) log.cc:352] Serialized 404 byte log entry Related trace: 0219 21:03:01.122405 (+ 0us) change_config_transaction.cc:69] PREPARE CHANGE CONFIG: Starting 0219 21:03:01.122602 (+ 197us) change_config_transaction.h:51] Acquiring the config sem. I0219 21:03:01.134987 20568 tablet_bootstrap.cc:290] Tablet 160232a9df364ed6aa770e351dbde036: Bootstrap starting. I0219 21:03:01.147871 20100 ts_tablet_manager.cc:449] Registered tablet 51808f4979294e5b90477b8324ff8bfa I0219 21:03:01.159323 20568 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 160232a9df364ed6aa770e351dbde036 creating new one. I0219 21:03:01.162605 20146 ts_tablet_manager.cc:449] Registered tablet 8779f0797f3a4873b734f2da3cdf40b7 I0219 21:03:01.163137 20510 ts_tablet_manager.cc:314] Bootstrapping tablet: 8779f0797f3a4873b734f2da3cdf40b7 I0219 21:03:01.181491 20581 ts_tablet_manager.cc:314] Bootstrapping tablet: 51808f4979294e5b90477b8324ff8bfa I0219 21:03:01.187026 20510 tablet_bootstrap.cc:290] Tablet 8779f0797f3a4873b734f2da3cdf40b7: Bootstrap starting. I0219 21:03:01.193898 20408 tablet_bootstrap.cc:290] Tablet 160232a9df364ed6aa770e351dbde036: No bootstrap required, opened a new log I0219 21:03:01.196774 20408 ts_tablet_manager.cc:319] Time spent tablet 160232a9df364ed6aa770e351dbde036 bootstrap: real 0.179s user 0.012s sys 0.014s I0219 21:03:01.199357 20458 raft_consensus.cc:361] T 8779f0797f3a4873b734f2da3cdf40b7 P 24762863e7904854bc0111677b169201 [LEADER]: Becoming Leader. State: Replica: 24762863e7904854bc0111677b169201, State: 1, Role: LEADER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:03:01.199764 20458 consensus_queue.cc:119] T 8779f0797f3a4873b734f2da3cdf40b7 P 24762863e7904854bc0111677b169201 [LEADER]: queue going to LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 1, Majority size: 2, State: 1, Mode: LEADER I0219 21:03:01.203234 20568 tablet_bootstrap.cc:290] Tablet 160232a9df364ed6aa770e351dbde036: No bootstrap required, opened a new log I0219 21:03:01.204577 20510 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 8779f0797f3a4873b734f2da3cdf40b7 creating new one. I0219 21:03:01.206261 20568 ts_tablet_manager.cc:319] Time spent tablet 160232a9df364ed6aa770e351dbde036 bootstrap: real 0.084s user 0.013s sys 0.009s I0219 21:03:01.207331 20581 tablet_bootstrap.cc:290] Tablet 51808f4979294e5b90477b8324ff8bfa: Bootstrap starting. I0219 21:03:01.213382 20581 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 51808f4979294e5b90477b8324ff8bfa creating new one. I0219 21:03:01.222651 20408 raft_consensus.cc:194] T 160232a9df364ed6aa770e351dbde036 P 7b2410347ccc495b9ab91368eb08dcad [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0219 21:03:01.222918 20408 raft_consensus.cc:399] T 160232a9df364ed6aa770e351dbde036 P 7b2410347ccc495b9ab91368eb08dcad [FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b2410347ccc495b9ab91368eb08dcad, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:03:01.223778 20408 consensus_queue.cc:127] T 160232a9df364ed6aa770e351dbde036 P 7b2410347ccc495b9ab91368eb08dcad [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0219 21:03:01.227988 20568 raft_consensus.cc:194] T 160232a9df364ed6aa770e351dbde036 P 24762863e7904854bc0111677b169201 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0219 21:03:01.228411 20568 raft_consensus.cc:399] T 160232a9df364ed6aa770e351dbde036 P 24762863e7904854bc0111677b169201 [FOLLOWER]: Becoming Follower/Learner. State: Replica: 24762863e7904854bc0111677b169201, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:03:01.229372 20408 ts_tablet_manager.cc:339] Time spent starting tablet 160232a9df364ed6aa770e351dbde036: real 0.031s user 0.009s sys 0.001s I0219 21:03:01.229346 20568 consensus_queue.cc:127] T 160232a9df364ed6aa770e351dbde036 P 24762863e7904854bc0111677b169201 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0219 21:03:01.230236 20568 ts_tablet_manager.cc:339] Time spent starting tablet 160232a9df364ed6aa770e351dbde036: real 0.024s user 0.007s sys 0.003s I0219 21:03:01.235220 20508 raft_consensus.cc:361] T 160232a9df364ed6aa770e351dbde036 P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [LEADER]: Becoming Leader. State: Replica: b1f1cbdf7d0649d9ac8ffdaaa4e75f15, State: 1, Role: LEADER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:03:01.235852 20508 consensus_queue.cc:119] T 160232a9df364ed6aa770e351dbde036 P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [LEADER]: queue going to LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 1, Majority size: 2, State: 1, Mode: LEADER I0219 21:03:01.237994 20458 ts_tablet_manager.cc:339] Time spent starting tablet 8779f0797f3a4873b734f2da3cdf40b7: real 0.359s user 0.037s sys 0.015s I0219 21:03:01.240942 20510 tablet_bootstrap.cc:290] Tablet 8779f0797f3a4873b734f2da3cdf40b7: No bootstrap required, opened a new log W0219 21:03:01.241580 20590 raft_consensus_state.cc:477] T 8779f0797f3a4873b734f2da3cdf40b7 P 24762863e7904854bc0111677b169201 [LEADER]: Can't advance the committed index across term boundaries yet. Last committed operation was: term: 0 index: 0 New majority replicated is: term: 0 index: 0. Current term is: 1 I0219 21:03:01.243376 20581 tablet_bootstrap.cc:290] Tablet 51808f4979294e5b90477b8324ff8bfa: No bootstrap required, opened a new log I0219 21:03:01.245633 20581 ts_tablet_manager.cc:319] Time spent tablet 51808f4979294e5b90477b8324ff8bfa bootstrap: real 0.064s user 0.014s sys 0.010s I0219 21:03:01.247464 20510 ts_tablet_manager.cc:319] Time spent tablet 8779f0797f3a4873b734f2da3cdf40b7 bootstrap: real 0.084s user 0.016s sys 0.007s I0219 21:03:01.253437 18449 ksck_remote-test.cc:140] Consistency check attempt 1... W0219 21:03:01.254021 20595 raft_consensus_state.cc:477] T 160232a9df364ed6aa770e351dbde036 P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [LEADER]: Can't advance the committed index across term boundaries yet. Last committed operation was: term: 0 index: 0 New majority replicated is: term: 0 index: 0. Current term is: 1 I0219 21:03:01.254359 20508 ts_tablet_manager.cc:339] Time spent starting tablet 160232a9df364ed6aa770e351dbde036: real 0.260s user 0.037s sys 0.021s I0219 21:03:01.258072 20581 raft_consensus.cc:194] T 51808f4979294e5b90477b8324ff8bfa P 24762863e7904854bc0111677b169201 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0219 21:03:01.258278 20581 raft_consensus.cc:399] T 51808f4979294e5b90477b8324ff8bfa P 24762863e7904854bc0111677b169201 [FOLLOWER]: Becoming Follower/Learner. State: Replica: 24762863e7904854bc0111677b169201, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:03:01.258604 20581 consensus_queue.cc:127] T 51808f4979294e5b90477b8324ff8bfa P 24762863e7904854bc0111677b169201 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0219 21:03:01.259342 20581 ts_tablet_manager.cc:339] Time spent starting tablet 51808f4979294e5b90477b8324ff8bfa: real 0.014s user 0.006s sys 0.001s I0219 21:03:01.260298 20510 raft_consensus.cc:194] T 8779f0797f3a4873b734f2da3cdf40b7 P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0219 21:03:01.260504 20510 raft_consensus.cc:399] T 8779f0797f3a4873b734f2da3cdf40b7 P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f1cbdf7d0649d9ac8ffdaaa4e75f15, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:03:01.260886 20510 consensus_queue.cc:127] T 8779f0797f3a4873b734f2da3cdf40b7 P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0219 21:03:01.261845 20510 ts_tablet_manager.cc:339] Time spent starting tablet 8779f0797f3a4873b734f2da3cdf40b7: real 0.014s user 0.004s sys 0.004s I0219 21:03:01.551378 20108 raft_consensus.cc:1328] T 51808f4979294e5b90477b8324ff8bfa P 24762863e7904854bc0111677b169201 [FOLLOWER]: Advancing to term 1 I0219 21:03:01.556222 20108 raft_consensus.cc:634] T 51808f4979294e5b90477b8324ff8bfa P 24762863e7904854bc0111677b169201 [FOLLOWER]: Refusing update from remote peer 7b2410347ccc495b9ab91368eb08dcad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. I0219 21:03:01.557260 20176 consensus_queue.cc:428] T 51808f4979294e5b90477b8324ff8bfa P 7b2410347ccc495b9ab91368eb08dcad [LEADER]: Connected to new peer: Peer: 24762863e7904854bc0111677b169201, New: false, Last received: 0.0, Last sent , Last known committed idx: 0 Last exchange result: ERROR I0219 21:03:01.568189 20575 raft_consensus_state.cc:470] T 51808f4979294e5b90477b8324ff8bfa P 7b2410347ccc495b9ab91368eb08dcad [LEADER]: Advanced the committed_index across terms. Last committed operation was: term: 0 index: 0 New committed index is: term: 1 index: 1 I0219 21:03:01.568956 20394 change_config_transaction.cc:129] T 51808f4979294e5b90477b8324ff8bfa P 7b2410347ccc495b9ab91368eb08dcad: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35823 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: LEADER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35823 } } I0219 21:03:01.577702 20025 catalog_manager.cc:1283] Tablet: 51808f4979294e5b90477b8324ff8bfa reported quorum change. New quorum: opid_index: 1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: LEADER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35823 } } I0219 21:03:01.612835 20156 raft_consensus.cc:1328] T 51808f4979294e5b90477b8324ff8bfa P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [FOLLOWER]: Advancing to term 1 I0219 21:03:01.617872 20156 raft_consensus.cc:634] T 51808f4979294e5b90477b8324ff8bfa P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [FOLLOWER]: Refusing update from remote peer 7b2410347ccc495b9ab91368eb08dcad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. I0219 21:03:01.618755 20175 consensus_queue.cc:428] T 51808f4979294e5b90477b8324ff8bfa P 7b2410347ccc495b9ab91368eb08dcad [LEADER]: Connected to new peer: Peer: b1f1cbdf7d0649d9ac8ffdaaa4e75f15, New: false, Last received: 0.0, Last sent , Last known committed idx: 0 Last exchange result: ERROR I0219 21:03:01.631119 20551 change_config_transaction.cc:129] T 51808f4979294e5b90477b8324ff8bfa P b1f1cbdf7d0649d9ac8ffdaaa4e75f15: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35823 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: LEADER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35823 } } I0219 21:03:01.734603 20199 raft_consensus.cc:1328] T 8779f0797f3a4873b734f2da3cdf40b7 P 7b2410347ccc495b9ab91368eb08dcad [FOLLOWER]: Advancing to term 1 I0219 21:03:01.740231 20159 raft_consensus.cc:1328] T 8779f0797f3a4873b734f2da3cdf40b7 P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [FOLLOWER]: Advancing to term 1 I0219 21:03:01.741227 20199 raft_consensus.cc:634] T 8779f0797f3a4873b734f2da3cdf40b7 P 7b2410347ccc495b9ab91368eb08dcad [FOLLOWER]: Refusing update from remote peer 24762863e7904854bc0111677b169201: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. I0219 21:03:01.742138 20082 consensus_queue.cc:428] T 8779f0797f3a4873b734f2da3cdf40b7 P 24762863e7904854bc0111677b169201 [LEADER]: Connected to new peer: Peer: 7b2410347ccc495b9ab91368eb08dcad, New: false, Last received: 0.0, Last sent , Last known committed idx: 0 Last exchange result: ERROR I0219 21:03:01.754658 20202 raft_consensus.cc:1328] T 160232a9df364ed6aa770e351dbde036 P 7b2410347ccc495b9ab91368eb08dcad [FOLLOWER]: Advancing to term 1 I0219 21:03:01.768302 20110 raft_consensus.cc:1328] T 160232a9df364ed6aa770e351dbde036 P 24762863e7904854bc0111677b169201 [FOLLOWER]: Advancing to term 1 I0219 21:03:01.772759 20202 raft_consensus.cc:634] T 160232a9df364ed6aa770e351dbde036 P 7b2410347ccc495b9ab91368eb08dcad [FOLLOWER]: Refusing update from remote peer b1f1cbdf7d0649d9ac8ffdaaa4e75f15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. I0219 21:03:01.773624 20129 consensus_queue.cc:428] T 160232a9df364ed6aa770e351dbde036 P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [LEADER]: Connected to new peer: Peer: 7b2410347ccc495b9ab91368eb08dcad, New: false, Last received: 0.0, Last sent , Last known committed idx: 0 Last exchange result: ERROR I0219 21:03:01.811962 20645 raft_consensus_state.cc:470] T 160232a9df364ed6aa770e351dbde036 P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [LEADER]: Advanced the committed_index across terms. Last committed operation was: term: 0 index: 0 New committed index is: term: 1 index: 1 I0219 21:03:01.812551 20529 change_config_transaction.cc:129] T 160232a9df364ed6aa770e351dbde036 P b1f1cbdf7d0649d9ac8ffdaaa4e75f15: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 35823 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: LEADER last_known_addr { host: "127.0.0.1" port: 35823 } } I0219 21:03:01.845633 20021 catalog_manager.cc:1283] Tablet: 160232a9df364ed6aa770e351dbde036 reported quorum change. New quorum: opid_index: 1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: LEADER last_known_addr { host: "127.0.0.1" port: 35823 } } I0219 21:03:01.910200 20110 raft_consensus.cc:634] T 160232a9df364ed6aa770e351dbde036 P 24762863e7904854bc0111677b169201 [FOLLOWER]: Refusing update from remote peer b1f1cbdf7d0649d9ac8ffdaaa4e75f15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. I0219 21:03:01.911949 20132 consensus_queue.cc:428] T 160232a9df364ed6aa770e351dbde036 P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [LEADER]: Connected to new peer: Peer: 24762863e7904854bc0111677b169201, New: false, Last received: 0.0, Last sent , Last known committed idx: 0 Last exchange result: ERROR I0219 21:03:01.930559 20159 raft_consensus.cc:634] T 8779f0797f3a4873b734f2da3cdf40b7 P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [FOLLOWER]: Refusing update from remote peer 24762863e7904854bc0111677b169201: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. I0219 21:03:01.931728 20084 consensus_queue.cc:428] T 8779f0797f3a4873b734f2da3cdf40b7 P 24762863e7904854bc0111677b169201 [LEADER]: Connected to new peer: Peer: b1f1cbdf7d0649d9ac8ffdaaa4e75f15, New: false, Last received: 0.0, Last sent , Last known committed idx: 0 Last exchange result: ERROR I0219 21:03:01.952536 20584 change_config_transaction.cc:129] T 160232a9df364ed6aa770e351dbde036 P 24762863e7904854bc0111677b169201: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 35823 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: LEADER last_known_addr { host: "127.0.0.1" port: 35823 } } I0219 21:03:01.964740 20640 raft_consensus_state.cc:470] T 8779f0797f3a4873b734f2da3cdf40b7 P 24762863e7904854bc0111677b169201 [LEADER]: Advanced the committed_index across terms. Last committed operation was: term: 0 index: 0 New committed index is: term: 1 index: 1 I0219 21:03:01.964983 20509 change_config_transaction.cc:129] T 8779f0797f3a4873b734f2da3cdf40b7 P 24762863e7904854bc0111677b169201: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35823 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: LEADER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35823 } } I0219 21:03:01.983383 20021 catalog_manager.cc:1283] Tablet: 8779f0797f3a4873b734f2da3cdf40b7 reported quorum change. New quorum: opid_index: 1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: LEADER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35823 } } INFO: Table ksck-test-table is HEALTHY INFO: The metadata for 1 tables is HEALTHY I0219 21:03:02.019327 18449 tablet_server.cc:114] TabletServer shutting down... I0219 21:03:02.056571 18449 ts_tablet_manager.cc:394] Shutting down tablet manager... I0219 21:03:02.056721 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: 8779f0797f3a4873b734f2da3cdf40b7 I0219 21:03:02.056852 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(8779f0797f3a4873b734f2da3cdf40b7) I0219 21:03:02.056951 18449 raft_consensus.cc:983] T 8779f0797f3a4873b734f2da3cdf40b7 P 24762863e7904854bc0111677b169201 [LEADER]: Raft consensus shutting down. I0219 21:03:02.057310 18449 consensus_peers.cc:211] T 8779f0797f3a4873b734f2da3cdf40b7 P 24762863e7904854bc0111677b169201: Closing peer: 7b2410347ccc495b9ab91368eb08dcad I0219 21:03:02.058265 18449 consensus_peers.cc:211] T 8779f0797f3a4873b734f2da3cdf40b7 P 24762863e7904854bc0111677b169201: Closing peer: b1f1cbdf7d0649d9ac8ffdaaa4e75f15 I0219 21:03:02.058662 18449 raft_consensus_state.cc:365] T 8779f0797f3a4873b734f2da3cdf40b7 P 24762863e7904854bc0111677b169201 [LEADER]: Trying to abort 0 pending transactions. I0219 21:03:02.058771 20083 messenger.cc:193] Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer I0219 21:03:02.058967 18449 raft_consensus.cc:998] T 8779f0797f3a4873b734f2da3cdf40b7 P 24762863e7904854bc0111677b169201 [LEADER]: Raft consensus Shutdown! W0219 21:03:02.059875 20176 consensus_peers.cc:189] T 51808f4979294e5b90477b8324ff8bfa P 7b2410347ccc495b9ab91368eb08dcad: Couldn't send request to peer 24762863e7904854bc0111677b169201 for tablet 51808f4979294e5b90477b8324ff8bfa Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. Retrying in the next heartbeat period. Already tried 1 times. I0219 21:03:02.062247 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: 51808f4979294e5b90477b8324ff8bfa I0219 21:03:02.062373 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(51808f4979294e5b90477b8324ff8bfa) I0219 21:03:02.062475 18449 raft_consensus.cc:983] T 51808f4979294e5b90477b8324ff8bfa P 24762863e7904854bc0111677b169201 [FOLLOWER]: Raft consensus shutting down. I0219 21:03:02.062613 18449 raft_consensus_state.cc:365] T 51808f4979294e5b90477b8324ff8bfa P 24762863e7904854bc0111677b169201 [FOLLOWER]: Trying to abort 1 pending transactions. I0219 21:03:02.062712 18449 raft_consensus_state.cc:370] T 51808f4979294e5b90477b8324ff8bfa P 24762863e7904854bc0111677b169201 [FOLLOWER]: Aborting transaction as it isn't in flight: id { term: 1 index: 1 } op_type: CHANGE_CONFIG_OP change_config_request { tablet_id: "51808f4979294e5b90477b8324ff8bfa" old_config { opid_index: -1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35823 } } } new_config { local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: LEADER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35823 } } } } I0219 21:03:02.063333 20687 change_config_transaction.cc:129] T 51808f4979294e5b90477b8324ff8bfa P 24762863e7904854bc0111677b169201: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35823 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: LEADER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35823 } } I0219 21:03:02.064285 18449 raft_consensus.cc:998] T 51808f4979294e5b90477b8324ff8bfa P 24762863e7904854bc0111677b169201 [FOLLOWER]: Raft consensus Shutdown! I0219 21:03:02.065088 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: 160232a9df364ed6aa770e351dbde036 I0219 21:03:02.065198 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(160232a9df364ed6aa770e351dbde036) I0219 21:03:02.065306 18449 raft_consensus.cc:983] T 160232a9df364ed6aa770e351dbde036 P 24762863e7904854bc0111677b169201 [FOLLOWER]: Raft consensus shutting down. I0219 21:03:02.065565 18449 raft_consensus_state.cc:365] T 160232a9df364ed6aa770e351dbde036 P 24762863e7904854bc0111677b169201 [FOLLOWER]: Trying to abort 0 pending transactions. I0219 21:03:02.065670 18449 raft_consensus.cc:998] T 160232a9df364ed6aa770e351dbde036 P 24762863e7904854bc0111677b169201 [FOLLOWER]: Raft consensus Shutdown! I0219 21:03:02.069923 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(8779f0797f3a4873b734f2da3cdf40b7) I0219 21:03:02.070094 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(8779f0797f3a4873b734f2da3cdf40b7) I0219 21:03:02.070247 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(8779f0797f3a4873b734f2da3cdf40b7) I0219 21:03:02.071738 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(51808f4979294e5b90477b8324ff8bfa) I0219 21:03:02.071885 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(51808f4979294e5b90477b8324ff8bfa) I0219 21:03:02.072233 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(51808f4979294e5b90477b8324ff8bfa) I0219 21:03:02.073576 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(160232a9df364ed6aa770e351dbde036) I0219 21:03:02.073729 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(160232a9df364ed6aa770e351dbde036) I0219 21:03:02.073876 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(160232a9df364ed6aa770e351dbde036) I0219 21:03:02.075287 18449 tablet_server.cc:123] TabletServer shut down complete. Bye! I0219 21:03:02.075364 18449 tablet_server.cc:114] TabletServer shutting down... I0219 21:03:02.075479 18449 tablet_server.cc:123] TabletServer shut down complete. Bye! I0219 21:03:02.080994 18449 tablet_server.cc:114] TabletServer shutting down... I0219 21:03:02.101351 18449 ts_tablet_manager.cc:394] Shutting down tablet manager... I0219 21:03:02.101563 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: 8779f0797f3a4873b734f2da3cdf40b7 I0219 21:03:02.102430 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(8779f0797f3a4873b734f2da3cdf40b7) I0219 21:03:02.102583 18449 raft_consensus.cc:983] T 8779f0797f3a4873b734f2da3cdf40b7 P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [FOLLOWER]: Raft consensus shutting down. I0219 21:03:02.102790 18449 raft_consensus_state.cc:365] T 8779f0797f3a4873b734f2da3cdf40b7 P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [FOLLOWER]: Trying to abort 1 pending transactions. I0219 21:03:02.102933 18449 raft_consensus_state.cc:370] T 8779f0797f3a4873b734f2da3cdf40b7 P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [FOLLOWER]: Aborting transaction as it isn't in flight: id { term: 1 index: 1 } op_type: CHANGE_CONFIG_OP change_config_request { tablet_id: "8779f0797f3a4873b734f2da3cdf40b7" old_config { opid_index: -1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35823 } } } new_config { local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: LEADER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35823 } } } } I0219 21:03:02.103850 20607 change_config_transaction.cc:129] T 8779f0797f3a4873b734f2da3cdf40b7 P b1f1cbdf7d0649d9ac8ffdaaa4e75f15: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35823 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: LEADER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35823 } } I0219 21:03:02.104399 18449 raft_consensus.cc:998] T 8779f0797f3a4873b734f2da3cdf40b7 P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [FOLLOWER]: Raft consensus Shutdown! I0219 21:03:02.106622 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: 51808f4979294e5b90477b8324ff8bfa I0219 21:03:02.106806 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(51808f4979294e5b90477b8324ff8bfa) I0219 21:03:02.106969 18449 raft_consensus.cc:983] T 51808f4979294e5b90477b8324ff8bfa P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [FOLLOWER]: Raft consensus shutting down. I0219 21:03:02.107189 18449 raft_consensus_state.cc:365] T 51808f4979294e5b90477b8324ff8bfa P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [FOLLOWER]: Trying to abort 0 pending transactions. I0219 21:03:02.107357 18449 raft_consensus.cc:998] T 51808f4979294e5b90477b8324ff8bfa P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [FOLLOWER]: Raft consensus Shutdown! I0219 21:03:02.109431 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: 160232a9df364ed6aa770e351dbde036 I0219 21:03:02.109611 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(160232a9df364ed6aa770e351dbde036) I0219 21:03:02.109755 18449 raft_consensus.cc:983] T 160232a9df364ed6aa770e351dbde036 P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [LEADER]: Raft consensus shutting down. I0219 21:03:02.110792 18449 consensus_peers.cc:211] T 160232a9df364ed6aa770e351dbde036 P b1f1cbdf7d0649d9ac8ffdaaa4e75f15: Closing peer: 24762863e7904854bc0111677b169201 I0219 21:03:02.112195 18449 consensus_peers.cc:211] T 160232a9df364ed6aa770e351dbde036 P b1f1cbdf7d0649d9ac8ffdaaa4e75f15: Closing peer: 7b2410347ccc495b9ab91368eb08dcad I0219 21:03:02.113332 18449 raft_consensus_state.cc:365] T 160232a9df364ed6aa770e351dbde036 P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [LEADER]: Trying to abort 0 pending transactions. I0219 21:03:02.113507 18449 raft_consensus.cc:998] T 160232a9df364ed6aa770e351dbde036 P b1f1cbdf7d0649d9ac8ffdaaa4e75f15 [LEADER]: Raft consensus Shutdown! I0219 21:03:02.116883 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(8779f0797f3a4873b734f2da3cdf40b7) I0219 21:03:02.117063 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(8779f0797f3a4873b734f2da3cdf40b7) I0219 21:03:02.117632 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(8779f0797f3a4873b734f2da3cdf40b7) I0219 21:03:02.120254 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(51808f4979294e5b90477b8324ff8bfa) I0219 21:03:02.120365 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(51808f4979294e5b90477b8324ff8bfa) I0219 21:03:02.120463 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(51808f4979294e5b90477b8324ff8bfa) I0219 21:03:02.121083 20129 messenger.cc:193] Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer W0219 21:03:02.121698 20175 consensus_peers.cc:189] T 51808f4979294e5b90477b8324ff8bfa P 7b2410347ccc495b9ab91368eb08dcad: Couldn't send request to peer b1f1cbdf7d0649d9ac8ffdaaa4e75f15 for tablet 51808f4979294e5b90477b8324ff8bfa Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. Retrying in the next heartbeat period. Already tried 1 times. I0219 21:03:02.122112 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(160232a9df364ed6aa770e351dbde036) I0219 21:03:02.122216 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(160232a9df364ed6aa770e351dbde036) I0219 21:03:02.122305 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(160232a9df364ed6aa770e351dbde036) I0219 21:03:02.123900 18449 tablet_server.cc:123] TabletServer shut down complete. Bye! I0219 21:03:02.123977 18449 tablet_server.cc:114] TabletServer shutting down... I0219 21:03:02.124090 18449 tablet_server.cc:123] TabletServer shut down complete. Bye! I0219 21:03:02.130020 18449 tablet_server.cc:114] TabletServer shutting down... I0219 21:03:02.152884 18449 ts_tablet_manager.cc:394] Shutting down tablet manager... I0219 21:03:02.153091 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: 8779f0797f3a4873b734f2da3cdf40b7 I0219 21:03:02.153306 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(8779f0797f3a4873b734f2da3cdf40b7) I0219 21:03:02.153457 18449 raft_consensus.cc:983] T 8779f0797f3a4873b734f2da3cdf40b7 P 7b2410347ccc495b9ab91368eb08dcad [FOLLOWER]: Raft consensus shutting down. I0219 21:03:02.153704 18449 raft_consensus_state.cc:365] T 8779f0797f3a4873b734f2da3cdf40b7 P 7b2410347ccc495b9ab91368eb08dcad [FOLLOWER]: Trying to abort 1 pending transactions. I0219 21:03:02.153919 18449 raft_consensus_state.cc:370] T 8779f0797f3a4873b734f2da3cdf40b7 P 7b2410347ccc495b9ab91368eb08dcad [FOLLOWER]: Aborting transaction as it isn't in flight: id { term: 1 index: 1 } op_type: CHANGE_CONFIG_OP change_config_request { tablet_id: "8779f0797f3a4873b734f2da3cdf40b7" old_config { opid_index: -1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35823 } } } new_config { local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: LEADER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35823 } } } } I0219 21:03:02.155061 18449 raft_consensus.cc:998] T 8779f0797f3a4873b734f2da3cdf40b7 P 7b2410347ccc495b9ab91368eb08dcad [FOLLOWER]: Raft consensus Shutdown! I0219 21:03:02.155339 18449 transaction_tracker.cc:126] Dumping currently running transactions: I0219 21:03:02.155465 18449 transaction_tracker.cc:128] ChangeConfigTransaction [type=REPLICA, state=ChangeConfigTransactionState [opid=term: 1 index: 1, timestamp=2, request=tablet_id: "8779f0797f3a4873b734f2da3cdf40b7" old_config { opid_index: -1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35823 } } } new_config { local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: LEADER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35823 } } }]] I0219 21:03:02.156482 18449 transaction_tracker.cc:126] Dumping currently running transactions: I0219 21:03:02.156147 20725 change_config_transaction.cc:129] T 8779f0797f3a4873b734f2da3cdf40b7 P 7b2410347ccc495b9ab91368eb08dcad: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35823 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: LEADER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35823 } } I0219 21:03:02.156601 18449 transaction_tracker.cc:128] ChangeConfigTransaction [type=REPLICA, state=ChangeConfigTransactionState [opid=term: 1 index: 1, timestamp=2, request=tablet_id: "8779f0797f3a4873b734f2da3cdf40b7" old_config { opid_index: -1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35823 } } } new_config { local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: LEADER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 35823 } } }]] I0219 21:03:02.159158 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: 160232a9df364ed6aa770e351dbde036 I0219 21:03:02.159343 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(160232a9df364ed6aa770e351dbde036) I0219 21:03:02.159492 18449 raft_consensus.cc:983] T 160232a9df364ed6aa770e351dbde036 P 7b2410347ccc495b9ab91368eb08dcad [FOLLOWER]: Raft consensus shutting down. I0219 21:03:02.159744 18449 raft_consensus_state.cc:365] T 160232a9df364ed6aa770e351dbde036 P 7b2410347ccc495b9ab91368eb08dcad [FOLLOWER]: Trying to abort 1 pending transactions. I0219 21:03:02.159955 18449 raft_consensus_state.cc:370] T 160232a9df364ed6aa770e351dbde036 P 7b2410347ccc495b9ab91368eb08dcad [FOLLOWER]: Aborting transaction as it isn't in flight: id { term: 1 index: 1 } op_type: CHANGE_CONFIG_OP change_config_request { tablet_id: "160232a9df364ed6aa770e351dbde036" old_config { opid_index: -1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 35823 } } } new_config { local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: LEADER last_known_addr { host: "127.0.0.1" port: 35823 } } } } I0219 21:03:02.160609 18449 raft_consensus.cc:998] T 160232a9df364ed6aa770e351dbde036 P 7b2410347ccc495b9ab91368eb08dcad [FOLLOWER]: Raft consensus Shutdown! I0219 21:03:02.160866 18449 transaction_tracker.cc:126] Dumping currently running transactions: I0219 21:03:02.161003 18449 transaction_tracker.cc:128] ChangeConfigTransaction [type=REPLICA, state=ChangeConfigTransactionState [opid=term: 1 index: 1, timestamp=3, request=tablet_id: "160232a9df364ed6aa770e351dbde036" old_config { opid_index: -1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 35823 } } } new_config { local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: LEADER last_known_addr { host: "127.0.0.1" port: 35823 } } }]] I0219 21:03:02.161614 20725 change_config_transaction.cc:129] T 160232a9df364ed6aa770e351dbde036 P 7b2410347ccc495b9ab91368eb08dcad: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 35823 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "7b2410347ccc495b9ab91368eb08dcad" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 43493 } } peers { permanent_uuid: "24762863e7904854bc0111677b169201" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 60547 } } peers { permanent_uuid: "b1f1cbdf7d0649d9ac8ffdaaa4e75f15" role: LEADER last_known_addr { host: "127.0.0.1" port: 35823 } } I0219 21:03:02.162014 18449 transaction_tracker.cc:126] Dumping currently running transactions: I0219 21:03:02.162369 18449 transaction_tracker.cc:128] ChangeConfigTransaction [type=REPLICA, state=ChangeConfigTransactionState [opid=term: 1 index: 1, timestamp=3, request=(none)]] I0219 21:03:02.164850 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: 51808f4979294e5b90477b8324ff8bfa I0219 21:03:02.165019 18449 maintenance_manager.cc:170] Unregistered op CompactRowSetsOp(51808f4979294e5b90477b8324ff8bfa) I0219 21:03:02.165160 18449 raft_consensus.cc:983] T 51808f4979294e5b90477b8324ff8bfa P 7b2410347ccc495b9ab91368eb08dcad [LEADER]: Raft consensus shutting down. I0219 21:03:02.165770 18449 consensus_peers.cc:211] T 51808f4979294e5b90477b8324ff8bfa P 7b2410347ccc495b9ab91368eb08dcad: Closing peer: 24762863e7904854bc0111677b169201 I0219 21:03:02.166450 18449 consensus_peers.cc:211] T 51808f4979294e5b90477b8324ff8bfa P 7b2410347ccc495b9ab91368eb08dcad: Closing peer: b1f1cbdf7d0649d9ac8ffdaaa4e75f15 I0219 21:03:02.167379 18449 raft_consensus_state.cc:365] T 51808f4979294e5b90477b8324ff8bfa P 7b2410347ccc495b9ab91368eb08dcad [LEADER]: Trying to abort 0 pending transactions. I0219 21:03:02.167527 18449 raft_consensus.cc:998] T 51808f4979294e5b90477b8324ff8bfa P 7b2410347ccc495b9ab91368eb08dcad [LEADER]: Raft consensus Shutdown! I0219 21:03:02.169128 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(8779f0797f3a4873b734f2da3cdf40b7) I0219 21:03:02.169306 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(8779f0797f3a4873b734f2da3cdf40b7) I0219 21:03:02.169479 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(8779f0797f3a4873b734f2da3cdf40b7) I0219 21:03:02.170866 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(160232a9df364ed6aa770e351dbde036) I0219 21:03:02.171025 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(160232a9df364ed6aa770e351dbde036) I0219 21:03:02.171176 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(160232a9df364ed6aa770e351dbde036) I0219 21:03:02.172448 18449 maintenance_manager.cc:170] Unregistered op FlushMRSOp(51808f4979294e5b90477b8324ff8bfa) I0219 21:03:02.172607 18449 maintenance_manager.cc:170] Unregistered op FlushDeltaMemStoresOp(51808f4979294e5b90477b8324ff8bfa) I0219 21:03:02.172754 18449 maintenance_manager.cc:170] Unregistered op LogGCOp(51808f4979294e5b90477b8324ff8bfa) I0219 21:03:02.174029 18449 tablet_server.cc:123] TabletServer shut down complete. Bye! I0219 21:03:02.174145 18449 tablet_server.cc:114] TabletServer shutting down... I0219 21:03:02.174324 18449 tablet_server.cc:123] TabletServer shut down complete. Bye! I0219 21:03:02.179325 18449 master.cc:130] Master@127.0.0.1:59226 shutting down... I0219 21:03:02.269893 18449 tablet_peer.cc:187] Initiating TabletPeer shutdown for tablet: 00000000000000000000000000000000 I0219 21:03:02.271487 18449 master.cc:133] Master@127.0.0.1:59226 shutdown complete. [ OK ] RemoteKsckTest.TestTableConsistency (2742 ms) [ RUN ] RemoteKsckTest.TestChecksum I0219 21:03:02.315848 18449 test_util.cc:117] Using random seed: 1424408582 I0219 21:03:02.335844 18449 fs_manager.cc:193] Generated new instance metadata in path /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestChecksum.1424408574588976-18449/minicluster-data/master-0-root/instance: uuid: "f4315c2267c14cda8b26dca69fbe0c13" format_stamp: "Formatted at 2015-02-20 05:03:02 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:03:02.349761 18449 fs_manager.cc:131] Opened local filesystem: /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestChecksum.1424408574588976-18449/minicluster-data/master-0-root uuid: "f4315c2267c14cda8b26dca69fbe0c13" format_stamp: "Formatted at 2015-02-20 05:03:02 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:03:02.365654 18449 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:49202 I0219 21:03:02.365964 18449 webserver.cc:108] Starting webserver on 0.0.0.0:0 I0219 21:03:02.366039 18449 webserver.cc:117] Document root disabled I0219 21:03:02.366572 18449 webserver.cc:197] Webserver started. Bound to: http://0.0.0.0:59010/ I0219 21:03:02.382320 20756 tablet_bootstrap.cc:290] Tablet 00000000000000000000000000000000: Bootstrap starting. I0219 21:03:02.384739 20756 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 00000000000000000000000000000000 creating new one. I0219 21:03:02.388191 20756 tablet_bootstrap.cc:290] Tablet 00000000000000000000000000000000: No bootstrap required, opened a new log I0219 21:03:02.403028 20758 change_config_transaction.cc:129] T 00000000000000000000000000000000 P f4315c2267c14cda8b26dca69fbe0c13: Configuration changed Changed from: opid_index: -1 local: true peers { permanent_uuid: "f4315c2267c14cda8b26dca69fbe0c13" role: LEADER } Changed to: opid_index: 1 local: true peers { permanent_uuid: "f4315c2267c14cda8b26dca69fbe0c13" role: LEADER } I0219 21:03:02.403324 20758 sys_catalog.cc:202] T 00000000000000000000000000000000 P f4315c2267c14cda8b26dca69fbe0c13 [sys.catalog]: SysCatalogTable state changed. New quorum config:opid_index: 1 local: true peers { permanent_uuid: "f4315c2267c14cda8b26dca69fbe0c13" role: LEADER } I0219 21:03:02.403493 20758 sys_catalog.cc:205] T 00000000000000000000000000000000 P f4315c2267c14cda8b26dca69fbe0c13 [sys.catalog]: This master's current role is: LEADER, previous role was: FOLLOWER I0219 21:03:02.403739 20756 sys_catalog.cc:268] T 00000000000000000000000000000000 P f4315c2267c14cda8b26dca69fbe0c13 [sys.catalog]: configured and running, proceeding with master startup. I0219 21:03:02.405179 20761 catalog_manager.cc:397] Loading tables and tablets metadata into memory... W0219 21:03:02.409266 20762 catalog_manager.cc:270] Catalog manager is not initialized! I0219 21:03:02.430002 18449 fs_manager.cc:193] Generated new instance metadata in path /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestChecksum.1424408574588976-18449/minicluster-data/ts-0-root/instance: uuid: "481dcea30ed549ddbfe1fee17518a067" format_stamp: "Formatted at 2015-02-20 05:03:02 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:03:02.445672 18449 fs_manager.cc:131] Opened local filesystem: /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestChecksum.1424408574588976-18449/minicluster-data/ts-0-root uuid: "481dcea30ed549ddbfe1fee17518a067" format_stamp: "Formatted at 2015-02-20 05:03:02 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:03:02.470041 18449 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:53021 I0219 21:03:02.470374 18449 webserver.cc:108] Starting webserver on 0.0.0.0:0 I0219 21:03:02.470460 18449 webserver.cc:117] Document root disabled I0219 21:03:02.471004 18449 webserver.cc:197] Webserver started. Bound to: http://0.0.0.0:49391/ I0219 21:03:02.471529 18449 maintenance_manager.cc:111] MaintenanceManager: targeting memory size of 23.515860 GB I0219 21:03:02.479312 20802 heartbeater.cc:219] Connected to a leader master server at 127.0.0.1:49202 I0219 21:03:02.479492 20802 heartbeater.cc:289] Registering TS with master... I0219 21:03:02.479703 20802 heartbeater.cc:295] Sending a full tablet report to master... I0219 21:03:02.480726 20735 ts_manager.cc:66] Registered new tablet server { permanent_uuid: "481dcea30ed549ddbfe1fee17518a067" instance_seqno: 1424408582469432 } with Master I0219 21:03:02.493062 18449 fs_manager.cc:193] Generated new instance metadata in path /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestChecksum.1424408574588976-18449/minicluster-data/ts-1-root/instance: uuid: "9931e8ff47354ae68705e0b49da46cd4" format_stamp: "Formatted at 2015-02-20 05:03:02 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:03:02.506032 18449 fs_manager.cc:131] Opened local filesystem: /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestChecksum.1424408574588976-18449/minicluster-data/ts-1-root uuid: "9931e8ff47354ae68705e0b49da46cd4" format_stamp: "Formatted at 2015-02-20 05:03:02 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:03:02.548367 18449 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:59474 I0219 21:03:02.548740 18449 webserver.cc:108] Starting webserver on 0.0.0.0:0 I0219 21:03:02.548816 18449 webserver.cc:117] Document root disabled I0219 21:03:02.549882 18449 webserver.cc:197] Webserver started. Bound to: http://0.0.0.0:41628/ I0219 21:03:02.550909 18449 maintenance_manager.cc:111] MaintenanceManager: targeting memory size of 23.515860 GB I0219 21:03:02.557669 20845 heartbeater.cc:219] Connected to a leader master server at 127.0.0.1:49202 I0219 21:03:02.557833 20845 heartbeater.cc:289] Registering TS with master... I0219 21:03:02.558008 20845 heartbeater.cc:295] Sending a full tablet report to master... I0219 21:03:02.559069 20743 ts_manager.cc:66] Registered new tablet server { permanent_uuid: "9931e8ff47354ae68705e0b49da46cd4" instance_seqno: 1424408582547325 } with Master I0219 21:03:02.580168 18449 fs_manager.cc:193] Generated new instance metadata in path /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestChecksum.1424408574588976-18449/minicluster-data/ts-2-root/instance: uuid: "7cf363f7a5b54e2bbfcb2f96b3d301ac" format_stamp: "Formatted at 2015-02-20 05:03:02 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:03:02.598858 18449 fs_manager.cc:131] Opened local filesystem: /data1/test-tmp/ksck_remote-test.RemoteKsckTest.TestChecksum.1424408574588976-18449/minicluster-data/ts-2-root uuid: "7cf363f7a5b54e2bbfcb2f96b3d301ac" format_stamp: "Formatted at 2015-02-20 05:03:02 on boost-static-burst-slave-1172.vpc.cloudera.com" I0219 21:03:02.643576 18449 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:36055 I0219 21:03:02.643899 18449 webserver.cc:108] Starting webserver on 0.0.0.0:0 I0219 21:03:02.643977 18449 webserver.cc:117] Document root disabled I0219 21:03:02.645185 18449 webserver.cc:197] Webserver started. Bound to: http://0.0.0.0:41826/ I0219 21:03:02.646230 18449 maintenance_manager.cc:111] MaintenanceManager: targeting memory size of 23.515860 GB I0219 21:03:02.651387 20896 heartbeater.cc:219] Connected to a leader master server at 127.0.0.1:49202 I0219 21:03:02.651540 20896 heartbeater.cc:289] Registering TS with master... I0219 21:03:02.651708 20896 heartbeater.cc:295] Sending a full tablet report to master... I0219 21:03:02.652576 20740 ts_manager.cc:66] Registered new tablet server { permanent_uuid: "7cf363f7a5b54e2bbfcb2f96b3d301ac" instance_seqno: 1424408582642039 } with Master I0219 21:03:02.653846 18449 mini_cluster.cc:276] 3 TS(s) registered with Master after 0.00624175s I0219 21:03:02.665527 20736 catalog_manager.cc:562] CreateTable from {real_user=jenkins, eff_user=} at 127.0.0.1:57773: name: "ksck-test-table" schema { columns { name: "key" type: UINT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION } columns { name: "int_val" type: UINT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION } } pre_split_keys: "\000\000\000\000" pre_split_keys: "\000\000\000\001" num_replicas: 3 I0219 21:03:02.692227 20781 tablet_service.cc:389] Processing CreateTablet for tablet bf75035296f84301beb059278718d049 (table=ksck-test-table [id=c8402a927e574099831cb335e2883b07]), range=["", "\x00\x00\x00\x00"] I0219 21:03:02.692286 20780 tablet_service.cc:389] Processing CreateTablet for tablet 03a4246412af4278bb19e817deba502d (table=ksck-test-table [id=c8402a927e574099831cb335e2883b07]), range=["\x00\x00\x00\x00", "\x00\x00\x00\x01"] I0219 21:03:02.692652 20782 tablet_service.cc:389] Processing CreateTablet for tablet 840865c8d37e4d64a8556256fab5be90 (table=ksck-test-table [id=c8402a927e574099831cb335e2883b07]), range=["\x00\x00\x00\x01", ""] I0219 21:03:02.696362 20874 tablet_service.cc:389] Processing CreateTablet for tablet 03a4246412af4278bb19e817deba502d (table=ksck-test-table [id=c8402a927e574099831cb335e2883b07]), range=["\x00\x00\x00\x00", "\x00\x00\x00\x01"] I0219 21:03:02.697363 20875 tablet_service.cc:389] Processing CreateTablet for tablet bf75035296f84301beb059278718d049 (table=ksck-test-table [id=c8402a927e574099831cb335e2883b07]), range=["", "\x00\x00\x00\x00"] I0219 21:03:02.698259 20823 tablet_service.cc:389] Processing CreateTablet for tablet 03a4246412af4278bb19e817deba502d (table=ksck-test-table [id=c8402a927e574099831cb335e2883b07]), range=["\x00\x00\x00\x00", "\x00\x00\x00\x01"] I0219 21:03:02.698338 20824 tablet_service.cc:389] Processing CreateTablet for tablet bf75035296f84301beb059278718d049 (table=ksck-test-table [id=c8402a927e574099831cb335e2883b07]), range=["", "\x00\x00\x00\x00"] I0219 21:03:02.698479 20876 tablet_service.cc:389] Processing CreateTablet for tablet 840865c8d37e4d64a8556256fab5be90 (table=ksck-test-table [id=c8402a927e574099831cb335e2883b07]), range=["\x00\x00\x00\x01", ""] I0219 21:03:02.700119 20825 tablet_service.cc:389] Processing CreateTablet for tablet 840865c8d37e4d64a8556256fab5be90 (table=ksck-test-table [id=c8402a927e574099831cb335e2883b07]), range=["\x00\x00\x00\x01", ""] I0219 21:03:02.820827 20781 ts_tablet_manager.cc:449] Registered tablet bf75035296f84301beb059278718d049 I0219 21:03:02.847563 20929 ts_tablet_manager.cc:314] Bootstrapping tablet: bf75035296f84301beb059278718d049 I0219 21:03:02.879310 20825 ts_tablet_manager.cc:449] Registered tablet 840865c8d37e4d64a8556256fab5be90 I0219 21:03:02.885473 20929 tablet_bootstrap.cc:290] Tablet bf75035296f84301beb059278718d049: Bootstrap starting. I0219 21:03:02.890991 20929 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: bf75035296f84301beb059278718d049 creating new one. I0219 21:03:02.922700 20932 ts_tablet_manager.cc:314] Bootstrapping tablet: 840865c8d37e4d64a8556256fab5be90 I0219 21:03:02.940970 20932 tablet_bootstrap.cc:290] Tablet 840865c8d37e4d64a8556256fab5be90: Bootstrap starting. I0219 21:03:02.967214 20932 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 840865c8d37e4d64a8556256fab5be90 creating new one. I0219 21:03:02.993939 20823 ts_tablet_manager.cc:449] Registered tablet 03a4246412af4278bb19e817deba502d I0219 21:03:02.995157 20929 tablet_bootstrap.cc:290] Tablet bf75035296f84301beb059278718d049: No bootstrap required, opened a new log I0219 21:03:02.997982 20929 ts_tablet_manager.cc:319] Time spent tablet bf75035296f84301beb059278718d049 bootstrap: real 0.150s user 0.015s sys 0.009s I0219 21:03:03.013895 20929 raft_consensus.cc:194] T bf75035296f84301beb059278718d049 P 481dcea30ed549ddbfe1fee17518a067 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0219 21:03:03.014142 20929 raft_consensus.cc:399] T bf75035296f84301beb059278718d049 P 481dcea30ed549ddbfe1fee17518a067 [FOLLOWER]: Becoming Follower/Learner. State: Replica: 481dcea30ed549ddbfe1fee17518a067, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:03:03.014948 20929 consensus_queue.cc:127] T bf75035296f84301beb059278718d049 P 481dcea30ed549ddbfe1fee17518a067 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0219 21:03:03.016587 20929 ts_tablet_manager.cc:339] Time spent starting tablet bf75035296f84301beb059278718d049: real 0.018s user 0.009s sys 0.000s I0219 21:03:03.024770 20938 ts_tablet_manager.cc:314] Bootstrapping tablet: 03a4246412af4278bb19e817deba502d I0219 21:03:03.048566 20938 tablet_bootstrap.cc:290] Tablet 03a4246412af4278bb19e817deba502d: Bootstrap starting. I0219 21:03:03.055447 20932 tablet_bootstrap.cc:290] Tablet 840865c8d37e4d64a8556256fab5be90: No bootstrap required, opened a new log I0219 21:03:03.057557 20938 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 03a4246412af4278bb19e817deba502d creating new one. I0219 21:03:03.058894 20932 ts_tablet_manager.cc:319] Time spent tablet 840865c8d37e4d64a8556256fab5be90 bootstrap: real 0.136s user 0.017s sys 0.004s I0219 21:03:03.071087 20932 raft_consensus.cc:194] T 840865c8d37e4d64a8556256fab5be90 P 9931e8ff47354ae68705e0b49da46cd4 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0219 21:03:03.071426 20932 raft_consensus.cc:399] T 840865c8d37e4d64a8556256fab5be90 P 9931e8ff47354ae68705e0b49da46cd4 [FOLLOWER]: Becoming Follower/Learner. State: Replica: 9931e8ff47354ae68705e0b49da46cd4, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:03:03.071982 20932 consensus_queue.cc:127] T 840865c8d37e4d64a8556256fab5be90 P 9931e8ff47354ae68705e0b49da46cd4 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0219 21:03:03.075690 20932 ts_tablet_manager.cc:339] Time spent starting tablet 840865c8d37e4d64a8556256fab5be90: real 0.017s user 0.009s sys 0.000s I0219 21:03:03.143661 20938 tablet_bootstrap.cc:290] Tablet 03a4246412af4278bb19e817deba502d: No bootstrap required, opened a new log I0219 21:03:03.147033 20938 ts_tablet_manager.cc:319] Time spent tablet 03a4246412af4278bb19e817deba502d bootstrap: real 0.122s user 0.009s sys 0.013s I0219 21:03:03.159304 20780 ts_tablet_manager.cc:449] Registered tablet 03a4246412af4278bb19e817deba502d I0219 21:03:03.159806 20929 ts_tablet_manager.cc:314] Bootstrapping tablet: 03a4246412af4278bb19e817deba502d I0219 21:03:03.173995 20929 tablet_bootstrap.cc:290] Tablet 03a4246412af4278bb19e817deba502d: Bootstrap starting. I0219 21:03:03.178463 20929 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 03a4246412af4278bb19e817deba502d creating new one. I0219 21:03:03.183869 20938 raft_consensus.cc:194] T 03a4246412af4278bb19e817deba502d P 9931e8ff47354ae68705e0b49da46cd4 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0219 21:03:03.185900 20938 raft_consensus.cc:399] T 03a4246412af4278bb19e817deba502d P 9931e8ff47354ae68705e0b49da46cd4 [FOLLOWER]: Becoming Follower/Learner. State: Replica: 9931e8ff47354ae68705e0b49da46cd4, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:03:03.186975 20938 consensus_queue.cc:127] T 03a4246412af4278bb19e817deba502d P 9931e8ff47354ae68705e0b49da46cd4 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0219 21:03:03.190907 20938 ts_tablet_manager.cc:339] Time spent starting tablet 03a4246412af4278bb19e817deba502d: real 0.044s user 0.008s sys 0.005s I0219 21:03:03.252495 20875 ts_tablet_manager.cc:449] Registered tablet bf75035296f84301beb059278718d049 I0219 21:03:03.260630 18449 ksck_remote-test.cc:151] Generating row writes... I0219 21:03:03.272454 20824 ts_tablet_manager.cc:449] Registered tablet bf75035296f84301beb059278718d049 I0219 21:03:03.273315 20932 ts_tablet_manager.cc:314] Bootstrapping tablet: bf75035296f84301beb059278718d049 I0219 21:03:03.288890 20932 tablet_bootstrap.cc:290] Tablet bf75035296f84301beb059278718d049: Bootstrap starting. I0219 21:03:03.289391 20953 ts_tablet_manager.cc:314] Bootstrapping tablet: bf75035296f84301beb059278718d049 I0219 21:03:03.292191 20782 ts_tablet_manager.cc:449] Registered tablet 840865c8d37e4d64a8556256fab5be90 I0219 21:03:03.293557 20929 tablet_bootstrap.cc:290] Tablet 03a4246412af4278bb19e817deba502d: No bootstrap required, opened a new log I0219 21:03:03.295467 20874 ts_tablet_manager.cc:449] Registered tablet 03a4246412af4278bb19e817deba502d I0219 21:03:03.298416 20929 ts_tablet_manager.cc:319] Time spent tablet 03a4246412af4278bb19e817deba502d bootstrap: real 0.138s user 0.012s sys 0.007s I0219 21:03:03.300551 20932 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: bf75035296f84301beb059278718d049 creating new one. I0219 21:03:03.301304 20876 ts_tablet_manager.cc:449] Registered tablet 840865c8d37e4d64a8556256fab5be90 I0219 21:03:03.305527 20955 ts_tablet_manager.cc:314] Bootstrapping tablet: 840865c8d37e4d64a8556256fab5be90 I0219 21:03:03.308344 20929 raft_consensus.cc:194] T 03a4246412af4278bb19e817deba502d P 481dcea30ed549ddbfe1fee17518a067 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0219 21:03:03.312160 20953 tablet_bootstrap.cc:290] Tablet bf75035296f84301beb059278718d049: Bootstrap starting. I0219 21:03:03.312322 20929 raft_consensus.cc:399] T 03a4246412af4278bb19e817deba502d P 481dcea30ed549ddbfe1fee17518a067 [FOLLOWER]: Becoming Follower/Learner. State: Replica: 481dcea30ed549ddbfe1fee17518a067, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:03:03.319793 20953 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: bf75035296f84301beb059278718d049 creating new one. I0219 21:03:03.318917 20929 consensus_queue.cc:127] T 03a4246412af4278bb19e817deba502d P 481dcea30ed549ddbfe1fee17518a067 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0219 21:03:03.327924 20929 ts_tablet_manager.cc:339] Time spent starting tablet 03a4246412af4278bb19e817deba502d: real 0.029s user 0.009s sys 0.003s I0219 21:03:03.343829 20956 ts_tablet_manager.cc:314] Bootstrapping tablet: 03a4246412af4278bb19e817deba502d I0219 21:03:03.344298 20960 ts_tablet_manager.cc:314] Bootstrapping tablet: 840865c8d37e4d64a8556256fab5be90 I0219 21:03:03.361871 20955 tablet_bootstrap.cc:290] Tablet 840865c8d37e4d64a8556256fab5be90: Bootstrap starting. I0219 21:03:03.365205 20955 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 840865c8d37e4d64a8556256fab5be90 creating new one. I0219 21:03:03.374404 20956 tablet_bootstrap.cc:290] Tablet 03a4246412af4278bb19e817deba502d: Bootstrap starting. I0219 21:03:03.376853 20953 tablet_bootstrap.cc:290] Tablet bf75035296f84301beb059278718d049: No bootstrap required, opened a new log I0219 21:03:03.379278 20932 tablet_bootstrap.cc:290] Tablet bf75035296f84301beb059278718d049: No bootstrap required, opened a new log I0219 21:03:03.382344 20932 ts_tablet_manager.cc:319] Time spent tablet bf75035296f84301beb059278718d049 bootstrap: real 0.109s user 0.017s sys 0.009s I0219 21:03:03.381535 20953 ts_tablet_manager.cc:319] Time spent tablet bf75035296f84301beb059278718d049 bootstrap: real 0.092s user 0.010s sys 0.012s I0219 21:03:03.389129 20960 tablet_bootstrap.cc:290] Tablet 840865c8d37e4d64a8556256fab5be90: Bootstrap starting. I0219 21:03:03.392254 20960 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 840865c8d37e4d64a8556256fab5be90 creating new one. I0219 21:03:03.396786 20956 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 03a4246412af4278bb19e817deba502d creating new one. I0219 21:03:03.406508 20932 raft_consensus.cc:194] T bf75035296f84301beb059278718d049 P 9931e8ff47354ae68705e0b49da46cd4 [CANDIDATE]: Replica starting. Triggering 0 pending transactions. I0219 21:03:03.441154 20953 raft_consensus.cc:194] T bf75035296f84301beb059278718d049 P 7cf363f7a5b54e2bbfcb2f96b3d301ac [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0219 21:03:03.441562 20953 raft_consensus.cc:399] T bf75035296f84301beb059278718d049 P 7cf363f7a5b54e2bbfcb2f96b3d301ac [FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cf363f7a5b54e2bbfcb2f96b3d301ac, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:03:03.445236 20953 consensus_queue.cc:127] T bf75035296f84301beb059278718d049 P 7cf363f7a5b54e2bbfcb2f96b3d301ac [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0219 21:03:03.447423 20953 ts_tablet_manager.cc:339] Time spent starting tablet bf75035296f84301beb059278718d049: real 0.061s user 0.009s sys 0.007s I0219 21:03:03.458063 20932 raft_consensus.cc:361] T bf75035296f84301beb059278718d049 P 9931e8ff47354ae68705e0b49da46cd4 [LEADER]: Becoming Leader. State: Replica: 9931e8ff47354ae68705e0b49da46cd4, State: 1, Role: LEADER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:03:03.459033 20932 consensus_queue.cc:119] T bf75035296f84301beb059278718d049 P 9931e8ff47354ae68705e0b49da46cd4 [LEADER]: queue going to LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 1, Majority size: 2, State: 1, Mode: LEADER I0219 21:03:03.475693 20955 tablet_bootstrap.cc:290] Tablet 840865c8d37e4d64a8556256fab5be90: No bootstrap required, opened a new log I0219 21:03:03.477946 20955 ts_tablet_manager.cc:319] Time spent tablet 840865c8d37e4d64a8556256fab5be90 bootstrap: real 0.172s user 0.015s sys 0.018s I0219 21:03:03.487314 20955 raft_consensus.cc:194] T 840865c8d37e4d64a8556256fab5be90 P 481dcea30ed549ddbfe1fee17518a067 [CANDIDATE]: Replica starting. Triggering 0 pending transactions. I0219 21:03:03.504151 20955 raft_consensus.cc:361] T 840865c8d37e4d64a8556256fab5be90 P 481dcea30ed549ddbfe1fee17518a067 [LEADER]: Becoming Leader. State: Replica: 481dcea30ed549ddbfe1fee17518a067, State: 1, Role: LEADER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:03:03.504928 20955 consensus_queue.cc:119] T 840865c8d37e4d64a8556256fab5be90 P 481dcea30ed549ddbfe1fee17518a067 [LEADER]: queue going to LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 1, Majority size: 2, State: 1, Mode: LEADER I0219 21:03:03.516268 20960 tablet_bootstrap.cc:290] Tablet 840865c8d37e4d64a8556256fab5be90: No bootstrap required, opened a new log I0219 21:03:03.518493 20960 ts_tablet_manager.cc:319] Time spent tablet 840865c8d37e4d64a8556256fab5be90 bootstrap: real 0.173s user 0.014s sys 0.008s I0219 21:03:03.534183 20956 tablet_bootstrap.cc:290] Tablet 03a4246412af4278bb19e817deba502d: No bootstrap required, opened a new log I0219 21:03:03.534450 20960 raft_consensus.cc:194] T 840865c8d37e4d64a8556256fab5be90 P 7cf363f7a5b54e2bbfcb2f96b3d301ac [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0219 21:03:03.537621 20956 ts_tablet_manager.cc:319] Time spent tablet 03a4246412af4278bb19e817deba502d bootstrap: real 0.193s user 0.016s sys 0.010s I0219 21:03:03.535115 20960 raft_consensus.cc:399] T 840865c8d37e4d64a8556256fab5be90 P 7cf363f7a5b54e2bbfcb2f96b3d301ac [FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cf363f7a5b54e2bbfcb2f96b3d301ac, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:03:03.539132 20960 consensus_queue.cc:127] T 840865c8d37e4d64a8556256fab5be90 P 7cf363f7a5b54e2bbfcb2f96b3d301ac [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0219 21:03:03.544056 20960 ts_tablet_manager.cc:339] Time spent starting tablet 840865c8d37e4d64a8556256fab5be90: real 0.025s user 0.008s sys 0.002s W0219 21:03:03.550920 21001 raft_consensus_state.cc:477] T bf75035296f84301beb059278718d049 P 9931e8ff47354ae68705e0b49da46cd4 [LEADER]: Can't advance the committed index across term boundaries yet. Last committed operation was: term: 0 index: 0 New majority replicated is: term: 0 index: 0. Current term is: 1 I0219 21:03:03.553351 20932 ts_tablet_manager.cc:339] Time spent starting tablet bf75035296f84301beb059278718d049: real 0.171s user 0.016s sys 0.007s I0219 21:03:03.564662 20956 raft_consensus.cc:194] T 03a4246412af4278bb19e817deba502d P 7cf363f7a5b54e2bbfcb2f96b3d301ac [CANDIDATE]: Replica starting. Triggering 0 pending transactions. I0219 21:03:03.580029 20955 ts_tablet_manager.cc:339] Time spent starting tablet 840865c8d37e4d64a8556256fab5be90: real 0.102s user 0.015s sys 0.008s I0219 21:03:03.582037 20956 raft_consensus.cc:361] T 03a4246412af4278bb19e817deba502d P 7cf363f7a5b54e2bbfcb2f96b3d301ac [LEADER]: Becoming Leader. State: Replica: 7cf363f7a5b54e2bbfcb2f96b3d301ac, State: 1, Role: LEADER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0219 21:03:03.582602 20956 consensus_queue.cc:119] T 03a4246412af4278bb19e817deba502d P 7cf363f7a5b54e2bbfcb2f96b3d301ac [LEADER]: queue going to LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 1, Majority size: 2, State: 1, Mode: LEADER W0219 21:03:03.593744 21003 raft_consensus_state.cc:477] T 840865c8d37e4d64a8556256fab5be90 P 481dcea30ed549ddbfe1fee17518a067 [LEADER]: Can't advance the committed index across term boundaries yet. Last committed operation was: term: 0 index: 0 New majority replicated is: term: 0 index: 0. Current term is: 1 W0219 21:03:03.692926 20900 meta_cache.cc:475] Leader Master timed out, re-trying... W0219 21:03:03.695015 20900 meta_cache.cc:475] Leader Master timed out, re-trying... W0219 21:03:03.773782 20899 meta_cache.cc:475] Leader Master timed out, re-trying... W0219 21:03:03.773789 20901 meta_cache.cc:475] Leader Master timed out, re-trying... W0219 21:03:03.774875 20902 meta_cache.cc:475] Leader Master timed out, re-trying... I0219 21:03:03.775436 20956 ts_tablet_manager.cc:339] Time spent starting tablet 03a4246412af4278bb19e817deba502d: real 0.237s user 0.015s sys 0.009s W0219 21:03:03.775785 21008 raft_consensus_state.cc:477] T 03a4246412af4278bb19e817deba502d P 7cf363f7a5b54e2bbfcb2f96b3d301ac [LEADER]: Can't advance the committed index across term boundaries yet. Last committed operation was: term: 0 index: 0 New majority replicated is: term: 0 index: 0. Current term is: 1 I0219 21:03:04.018426 20790 raft_consensus.cc:1328] T bf75035296f84301beb059278718d049 P 481dcea30ed549ddbfe1fee17518a067 [FOLLOWER]: Advancing to term 1 I0219 21:03:04.024274 20790 raft_consensus.cc:634] T bf75035296f84301beb059278718d049 P 481dcea30ed549ddbfe1fee17518a067 [FOLLOWER]: Refusing update from remote peer 9931e8ff47354ae68705e0b49da46cd4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. I0219 21:03:04.024833 20809 consensus_queue.cc:428] T bf75035296f84301beb059278718d049 P 9931e8ff47354ae68705e0b49da46cd4 [LEADER]: Connected to new peer: Peer: 481dcea30ed549ddbfe1fee17518a067, New: false, Last received: 0.0, Last sent , Last known committed idx: 0 Last exchange result: ERROR I0219 21:03:04.037271 21001 raft_consensus_state.cc:470] T bf75035296f84301beb059278718d049 P 9931e8ff47354ae68705e0b49da46cd4 [LEADER]: Advanced the committed_index across terms. Last committed operation was: term: 0 index: 0 New committed index is: term: 1 index: 1 I0219 21:03:04.038763 20966 change_config_transaction.cc:129] T bf75035296f84301beb059278718d049 P 9931e8ff47354ae68705e0b49da46cd4: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "481dcea30ed549ddbfe1fee17518a067" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 53021 } } peers { permanent_uuid: "7cf363f7a5b54e2bbfcb2f96b3d301ac" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 36055 } } peers { permanent_uuid: "9931e8ff47354ae68705e0b49da46cd4" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 59474 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "481dcea30ed549ddbfe1fee17518a067" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 53021 } } peers { permanent_uuid: "7cf363f7a5b54e2bbfcb2f96b3d301ac" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 36055 } } peers { permanent_uuid: "9931e8ff47354ae68705e0b49da46cd4" role: LEADER last_known_addr { host: "127.0.0.1" port: 59474 } } I0219 21:03:04.041717 20884 raft_consensus.cc:1328] T bf75035296f84301beb059278718d049 P 7cf363f7a5b54e2bbfcb2f96b3d301ac [FOLLOWER]: Advancing to term 1 I0219 21:03:04.045830 20741 catalog_manager.cc:1283] Tablet: bf75035296f84301beb059278718d049 reported quorum change. New quorum: opid_index: 1 local: false peers { permanent_uuid: "481dcea30ed549ddbfe1fee17518a067" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 53021 } } peers { permanent_uuid: "7cf363f7a5b54e2bbfcb2f96b3d301ac" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 36055 } } peers { permanent_uuid: "9931e8ff47354ae68705e0b49da46cd4" role: LEADER last_known_addr { host: "127.0.0.1" port: 59474 } } I0219 21:03:04.049123 20884 raft_consensus.cc:634] T bf75035296f84301beb059278718d049 P 7cf363f7a5b54e2bbfcb2f96b3d301ac [FOLLOWER]: Refusing update from remote peer 9931e8ff47354ae68705e0b49da46cd4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. I0219 21:03:04.049993 20810 consensus_queue.cc:428] T bf75035296f84301beb059278718d049 P 9931e8ff47354ae68705e0b49da46cd4 [LEADER]: Connected to new peer: Peer: 7cf363f7a5b54e2bbfcb2f96b3d301ac, New: false, Last received: 0.0, Last sent , Last known committed idx: 0 Last exchange result: ERROR I0219 21:03:04.052642 20884 raft_consensus.cc:1328] T 840865c8d37e4d64a8556256fab5be90 P 7cf363f7a5b54e2bbfcb2f96b3d301ac [FOLLOWER]: Advancing to term 1 I0219 21:03:04.058403 20884 raft_consensus.cc:634] T 840865c8d37e4d64a8556256fab5be90 P 7cf363f7a5b54e2bbfcb2f96b3d301ac [FOLLOWER]: Refusing update from remote peer 481dcea30ed549ddbfe1fee17518a067: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. I0219 21:03:04.059212 20767 consensus_queue.cc:428] T 840865c8d37e4d64a8556256fab5be90 P 481dcea30ed549ddbfe1fee17518a067 [LEADER]: Connected to new peer: Peer: 7cf363f7a5b54e2bbfcb2f96b3d301ac, New: false, Last received: 0.0, Last sent , Last known committed idx: 0 Last exchange result: ERROR I0219 21:03:04.068606 20967 change_config_transaction.cc:129] T bf75035296f84301beb059278718d049 P 7cf363f7a5b54e2bbfcb2f96b3d301ac: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "481dcea30ed549ddbfe1fee17518a067" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 53021 } } peers { permanent_uuid: "7cf363f7a5b54e2bbfcb2f96b3d301ac" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 36055 } } peers { permanent_uuid: "9931e8ff47354ae68705e0b49da46cd4" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 59474 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "481dcea30ed549ddbfe1fee17518a067" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 53021 } } peers { permanent_uuid: "7cf363f7a5b54e2bbfcb2f96b3d301ac" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 36055 } } peers { permanent_uuid: "9931e8ff47354ae68705e0b49da46cd4" role: LEADER last_known_addr { host: "127.0.0.1" port: 59474 } } I0219 21:03:04.069511 20833 raft_consensus.cc:1328] T 840865c8d37e4d64a8556256fab5be90 P 9931e8ff47354ae68705e0b49da46cd4 [FOLLOWER]: Advancing to term 1 I0219 21:03:04.071280 21003 raft_consensus_state.cc:470] T 840865c8d37e4d64a8556256fab5be90 P 481dcea30ed549ddbfe1fee17518a067 [LEADER]: Advanced the committed_index across terms. Last committed operation was: term: 0 index: 0 New committed index is: term: 1 index: 1 I0219 21:03:04.072037 20977 change_config_transaction.cc:129] T 840865c8d37e4d64a8556256fab5be90 P 481dcea30ed549ddbfe1fee17518a067: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "481dcea30ed549ddbfe1fee17518a067" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 53021 } } peers { permanent_uuid: "7cf363f7a5b54e2bbfcb2f96b3d301ac" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 36055 } } peers { permanent_uuid: "9931e8ff47354ae68705e0b49da46cd4" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 59474 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "481dcea30ed549ddbfe1fee17518a067" role: LEADER last_known_addr { host: "127.0.0.1" port: 53021 } } peers { permanent_uuid: "7cf363f7a5b54e2bbfcb2f96b3d301ac" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 36055 } } peers { permanent_uuid: "9931e8ff47354ae68705e0b49da46cd4" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 59474 } } I0219 21:03:04.077509 20833 raft_consensus.cc:634] T 840865c8d37e4d64a8556256fab5be90 P 9931e8ff47354ae68705e0b49da46cd4 [FOLLOWER]: Refusing update from remote peer 481dcea30ed549ddbfe1fee17518a067: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. I0219 21:03:04.078156 20767 consensus_queue.cc:428] T 840865c8d37e4d64a8556256fab5be90 P 481dcea30ed549ddbfe1fee17518a067 [LEADER]: Connected to new peer: Peer: 9931e8ff47354ae68705e0b49da46cd4, New: false, Last received: 0.0, Last sent , Last known committed idx: 0 Last exchange result: ERROR I0219 21:03:04.084879 20743 catalog_manager.cc:1283] Tablet: 840865c8d37e4d64a8556256fab5be90 reported quorum change. New quorum: opid_index: 1 local: false peers { permanent_uuid: "481dcea30ed549ddbfe1fee17518a067" role: LEADER last_known_addr { host: "127.0.0.1" port: 53021 } } peers { permanent_uuid: "7cf363f7a5b54e2bbfcb2f96b3d301ac" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 36055 } } peers { permanent_uuid: "9931e8ff47354ae68705e0b49da46cd4" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 59474 } } I0219 21:03:04.090970 20939 change_config_transaction.cc:129] T 840865c8d37e4d64a8556256fab5be90 P 9931e8ff47354ae68705e0b49da46cd4: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "481dcea30ed549ddbfe1fee17518a067" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 53021 } } peers { permanent_uuid: "7cf363f7a5b54e2bbfcb2f96b3d301ac" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 36055 } } peers { permanent_uuid: "9931e8ff47354ae68705e0b49da46cd4" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 59474 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "481dcea30ed549ddbfe1fee17518a067" role: LEADER last_known_addr { host: "127.0.0.1" port: 53021 } } peers { permanent_uuid: "7cf363f7a5b54e2bbfcb2f96b3d301ac" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 36055 } } peers { permanent_uuid: "9931e8ff47354ae68705e0b49da46cd4" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 59474 } } I0219 21:03:04.098842 20792 raft_consensus.cc:1328] T 03a4246412af4278bb19e817deba502d P 481dcea30ed549ddbfe1fee17518a067 [FOLLOWER]: Advancing to term 1 I0219 21:03:04.106760 20792 raft_consensus.cc:634] T 03a4246412af4278bb19e817deba502d P 481dcea30ed549ddbfe1fee17518a067 [FOLLOWER]: Refusing update from remote peer 7cf363f7a5b54e2bbfcb2f96b3d301ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. I0219 21:03:04.107058 20835 raft_consensus.cc:1328] T 03a4246412af4278bb19e817deba502d P 9931e8ff47354ae68705e0b49da46cd4 [FOLLOWER]: Advancing to term 1 I0219 21:03:04.107800 20860 consensus_queue.cc:428] T 03a4246412af4278bb19e817deba502d P 7cf363f7a5b54e2bbfcb2f96b3d301ac [LEADER]: Connected to new peer: Peer: 481dcea30ed549ddbfe1fee17518a067, New: false, Last received: 0.0, Last sent , Last known committed idx: 0 Last exchange result: ERROR I0219 21:03:04.113543 20835 raft_consensus.cc:634] T 03a4246412af4278bb19e817deba502d P 9931e8ff47354ae68705e0b49da46cd4 [FOLLOWER]: Refusing update from remote peer 7cf363f7a5b54e2bbfcb2f96b3d301ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. I0219 21:03:04.114892 20861 consensus_queue.cc:428] T 03a4246412af4278bb19e817deba502d P 7cf363f7a5b54e2bbfcb2f96b3d301ac [LEADER]: Connected to new peer: Peer: 9931e8ff47354ae68705e0b49da46cd4, New: false, Last received: 0.0, Last sent , Last known committed idx: 0 Last exchange result: ERROR I0219 21:03:04.118299 21008 raft_consensus_state.cc:470] T 03a4246412af4278bb19e817deba502d P 7cf363f7a5b54e2bbfcb2f96b3d301ac [LEADER]: Advanced the committed_index across terms. Last committed operation was: term: 0 index: 0 New committed index is: term: 1 index: 1 I0219 21:03:04.119426 20999 change_config_transaction.cc:129] T 03a4246412af4278bb19e817deba502d P 7cf363f7a5b54e2bbfcb2f96b3d301ac: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "481dcea30ed549ddbfe1fee17518a067" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 53021 } } peers { permanent_uuid: "7cf363f7a5b54e2bbfcb2f96b3d301ac" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 36055 } } peers { permanent_uuid: "9931e8ff47354ae68705e0b49da46cd4" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 59474 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "481dcea30ed549ddbfe1fee17518a067" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 53021 } } peers { permanent_uuid: "7cf363f7a5b54e2bbfcb2f96b3d301ac" role: LEADER last_known_addr { host: "127.0.0.1" port: 36055 } } peers { permanent_uuid: "9931e8ff47354ae68705e0b49da46cd4" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 59474 } } I0219 21:03:04.125205 20742 catalog_manager.cc:1283] Tablet: 03a4246412af4278bb19e817deba502d reported quorum change. New quorum: opid_index: 1 local: false peers { permanent_uuid: "481dcea30ed549ddbfe1fee17518a067" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 53021 } } peers { permanent_uuid: "7cf363f7a5b54e2bbfcb2f96b3d301ac" role: LEADER last_known_addr { host: "127.0.0.1" port: 36055 } } peers { permanent_uuid: "9931e8ff47354ae68705e0b49da46cd4" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 59474 } } I0219 21:03:04.532840 20934 change_config_transaction.cc:129] T bf75035296f84301beb059278718d049 P 481dcea30ed549ddbfe1fee17518a067: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "481dcea30ed549ddbfe1fee17518a067" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 53021 } } peers { permanent_uuid: "7cf363f7a5b54e2bbfcb2f96b3d301ac" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 36055 } } peers { permanent_uuid: "9931e8ff47354ae68705e0b49da46cd4" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 59474 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "481dcea30ed549ddbfe1fee17518a067" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 53021 } } peers { permanent_uuid: "7cf363f7a5b54e2bbfcb2f96b3d301ac" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 36055 } } peers { permanent_uuid: "9931e8ff47354ae68705e0b49da46cd4" role: LEADER last_known_addr { host: "127.0.0.1" port: 59474 } } I0219 21:03:04.569401 20993 change_config_transaction.cc:129] T 840865c8d37e4d64a8556256fab5be90 P 7cf363f7a5b54e2bbfcb2f96b3d301ac: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "481dcea30ed549ddbfe1fee17518a067" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 53021 } } peers { permanent_uuid: "7cf363f7a5b54e2bbfcb2f96b3d301ac" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 36055 } } peers { permanent_uuid: "9931e8ff47354ae68705e0b49da46cd4" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 59474 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "481dcea30ed549ddbfe1fee17518a067" role: LEADER last_known_addr { host: "127.0.0.1" port: 53021 } } peers { permanent_uuid: "7cf363f7a5b54e2bbfcb2f96b3d301ac" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 36055 } } peers { permanent_uuid: "9931e8ff47354ae68705e0b49da46cd4" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 59474 } } I0219 21:03:04.617660 20954 change_config_transaction.cc:129] T 03a4246412af4278bb19e817deba502d P 481dcea30ed549ddbfe1fee17518a067: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "481dcea30ed549ddbfe1fee17518a067" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 53021 } } peers { permanent_uuid: "7cf363f7a5b54e2bbfcb2f96b3d301ac" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 36055 } } peers { permanent_uuid: "9931e8ff47354ae68705e0b49da46cd4" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 59474 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "481dcea30ed549ddbfe1fee17518a067" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 53021 } } peers { permanent_uuid: "7cf363f7a5b54e2bbfcb2f96b3d301ac" role: LEADER last_known_addr { host: "127.0.0.1" port: 36055 } } peers { permanent_uuid: "9931e8ff47354ae68705e0b49da46cd4" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 59474 } } I0219 21:03:04.626835 20944 change_config_transaction.cc:129] T 03a4246412af4278bb19e817deba502d P 9931e8ff47354ae68705e0b49da46cd4: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "481dcea30ed549ddbfe1fee17518a067" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 53021 } } peers { permanent_uuid: "7cf363f7a5b54e2bbfcb2f96b3d301ac" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 36055 } } peers { permanent_uuid: "9931e8ff47354ae68705e0b49da46cd4" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 59474 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "481dcea30ed549ddbfe1fee17518a067" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 53021 } } peers { permanent_uuid: "7cf363f7a5b54e2bbfcb2f96b3d301ac" role: LEADER last_known_addr { host: "127.0.0.1" port: 36055 } } peers { permanent_uuid: "9931e8ff47354ae68705e0b49da46cd4" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 59474 } } ************************ BEGIN STACKS ************************** [New LWP 27044] [New LWP 27043] [New LWP 27042] [New LWP 27036] [New LWP 21006] [New LWP 21005] [New LWP 21002] [New LWP 20999] [New LWP 20998] [New LWP 20995] [New LWP 20993] [New LWP 20992] [New LWP 20977] [New LWP 20967] [New LWP 20966] [New LWP 20954] [New LWP 20944] [New LWP 20939] [New LWP 20934] [New LWP 20902] [New LWP 20901] [New LWP 20900] [New LWP 20899] [New LWP 20897] [New LWP 20896] [New LWP 20895] [New LWP 20894] [New LWP 20893] [New LWP 20892] [New LWP 20891] [New LWP 20890] [New LWP 20889] [New LWP 20888] [New LWP 20887] [New LWP 20886] [New LWP 20885] [New LWP 20884] [New LWP 20883] [New LWP 20882] [New LWP 20881] [New LWP 20880] [New LWP 20879] [New LWP 20878] [New LWP 20877] [New LWP 20876] [New LWP 20875] [New LWP 20874] [New LWP 20873] [New LWP 20872] [New LWP 20871] [New LWP 20870] [New LWP 20869] [New LWP 20868] [New LWP 20867] [New LWP 20866] [New LWP 20865] [New LWP 20864] [New LWP 20863] [New LWP 20862] [New LWP 20861] [New LWP 20860] [New LWP 20859] [New LWP 20858] [New LWP 20852] [New LWP 20846] [New LWP 20845] [New LWP 20844] [New LWP 20843] [New LWP 20842] [New LWP 20841] [New LWP 20840] [New LWP 20839] [New LWP 20838] [New LWP 20837] [New LWP 20836] [New LWP 20835] [New LWP 20834] [New LWP 20833] [New LWP 20832] [New LWP 20831] [New LWP 20830] [New LWP 20829] [New LWP 20828] [New LWP 20827] [New LWP 20826] [New LWP 20825] [New LWP 20824] [New LWP 20823] [New LWP 20822] [New LWP 20821] [New LWP 20820] [New LWP 20819] [New LWP 20818] [New LWP 20817] [New LWP 20816] [New LWP 20815] [New LWP 20814] [New LWP 20813] [New LWP 20812] [New LWP 20811] [New LWP 20810] [New LWP 20809] [New LWP 20808] [New LWP 20807] [New LWP 20806] [New LWP 20803] [New LWP 20802] [New LWP 20801] [New LWP 20800] [New LWP 20799] [New LWP 20798] [New LWP 20797] [New LWP 20796] [New LWP 20795] [New LWP 20794] [New LWP 20793] [New LWP 20792] [New LWP 20791] [New LWP 20790] [New LWP 20789] [New LWP 20788] [New LWP 20787] [New LWP 20786] [New LWP 20785] [New LWP 20784] [New LWP 20783] [New LWP 20782] [New LWP 20781] [New LWP 20780] [New LWP 20779] [New LWP 20778] [New LWP 20777] [New LWP 20776] [New LWP 20775] [New LWP 20774] [New LWP 20773] [New LWP 20772] [New LWP 20771] [New LWP 20770] [New LWP 20769] [New LWP 20768] [New LWP 20767] [New LWP 20766] [New LWP 20765] [New LWP 20764] [New LWP 20763] [New LWP 20762] [New LWP 20758] [New LWP 20755] [New LWP 20754] [New LWP 20753] [New LWP 20752] [New LWP 20751] [New LWP 20750] [New LWP 20749] [New LWP 20748] [New LWP 20747] [New LWP 20746] [New LWP 20745] [New LWP 20744] [New LWP 20743] [New LWP 20742] [New LWP 20741] [New LWP 20740] [New LWP 20739] [New LWP 20738] [New LWP 20737] [New LWP 20736] [New LWP 20735] [New LWP 20734] [New LWP 20733] [New LWP 20732] [New LWP 20731] [New LWP 20730] [New LWP 18790] [New LWP 18511] [New LWP 18502] [Thread debugging using libthread_db enabled] 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 178 Thread 0x7ff35ec3c700 (LWP 18502) 0x00007ff36031ebcd in nanosleep () from /lib64/libc.so.6 177 Thread 0x7ff36acc2cc0 (LWP 18511) 0x00007ff360daa19a in timer_helper_thread () from /lib64/librt.so.1 176 Thread 0x7ff35a1aecc0 (LWP 18790) 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 175 Thread 0x7ff34ea7bcc0 (LWP 20730) 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 174 Thread 0x7ff350de7cc0 (LWP 20731) 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 173 Thread 0x7ff34e8dacc0 (LWP 20732) 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 172 Thread 0x7ff350aaecc0 (LWP 20733) 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 171 Thread 0x7ff35088dcc0 (LWP 20734) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 170 Thread 0x7ff35249acc0 (LWP 20735) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 169 Thread 0x7ff34e09ccc0 (LWP 20736) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 168 Thread 0x7ff34e127cc0 (LWP 20737) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 167 Thread 0x7ff34ca8acc0 (LWP 20738) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 166 Thread 0x7ff352525cc0 (LWP 20739) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 165 Thread 0x7ff34e23dcc0 (LWP 20740) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 164 Thread 0x7ff34cffecc0 (LWP 20741) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 163 Thread 0x7ff350998cc0 (LWP 20742) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 162 Thread 0x7ff3525b0cc0 (LWP 20743) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 161 Thread 0x7ff35263bcc0 (LWP 20744) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 160 Thread 0x7ff34cf73cc0 (LWP 20745) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 159 Thread 0x7ff34c451cc0 (LWP 20746) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 158 Thread 0x7ff34c19acc0 (LWP 20747) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 157 Thread 0x7ff3506f7cc0 (LWP 20748) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 156 Thread 0x7ff35c2dbcc0 (LWP 20749) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 155 Thread 0x7ff35c5e2cc0 (LWP 20750) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 154 Thread 0x7ff350095cc0 (LWP 20751) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 153 Thread 0x7ff34c7d3cc0 (LWP 20752) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 152 Thread 0x7ff34cbb1cc0 (LWP 20753) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 151 Thread 0x7ff3521a1cc0 (LWP 20754) 0x00007ff36035cc7f in accept4 () from /lib64/libc.so.6 150 Thread 0x7ff350182cc0 (LWP 20755) 0x00007ff360351293 in poll () from /lib64/libc.so.6 149 Thread 0x7ff34c2b0cc0 (LWP 20758) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 148 Thread 0x7ff34c225cc0 (LWP 20762) 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 147 Thread 0x7ff34c85ecc0 (LWP 20763) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 146 Thread 0x7ff35a856cc0 (LWP 20764) 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 145 Thread 0x7ff35222ccc0 (LWP 20765) 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 144 Thread 0x7ff35c21dcc0 (LWP 20766) 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 143 Thread 0x7ff350fbecc0 (LWP 20767) 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 142 Thread 0x7ff34c3c6cc0 (LWP 20768) 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 141 Thread 0x7ff34c974cc0 (LWP 20769) 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 140 Thread 0x7ff34c8e9cc0 (LWP 20770) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 139 Thread 0x7ff35c0e5cc0 (LWP 20771) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 138 Thread 0x7ff35a7bacc0 (LWP 20772) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 137 Thread 0x7ff35c66dcc0 (LWP 20773) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 136 Thread 0x7ff35c377cc0 (LWP 20774) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 135 Thread 0x7ff3567dccc0 (LWP 20775) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 134 Thread 0x7ff356608cc0 (LWP 20776) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 133 Thread 0x7ff3566a4cc0 (LWP 20777) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 132 Thread 0x7ff356740cc0 (LWP 20778) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 131 Thread 0x7ff350c90cc0 (LWP 20779) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 130 Thread 0x7ff35656ccc0 (LWP 20780) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 129 Thread 0x7ff352b95cc0 (LWP 20781) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 128 Thread 0x7ff34cd52cc0 (LWP 20782) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 127 Thread 0x7ff350b39cc0 (LWP 20783) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 126 Thread 0x7ff350ea8cc0 (LWP 20784) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 125 Thread 0x7ff35054ecc0 (LWP 20785) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 124 Thread 0x7ff3522f3cc0 (LWP 20786) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 123 Thread 0x7ff356925cc0 (LWP 20787) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 122 Thread 0x7ff34e84fcc0 (LWP 20788) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 121 Thread 0x7ff352c20cc0 (LWP 20789) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 120 Thread 0x7ff352cabcc0 (LWP 20790) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 119 Thread 0x7ff3540e1cc0 (LWP 20791) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 118 Thread 0x7ff35417dcc0 (LWP 20792) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 117 Thread 0x7ff354219cc0 (LWP 20793) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 116 Thread 0x7ff3542b5cc0 (LWP 20794) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 115 Thread 0x7ff354351cc0 (LWP 20795) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 114 Thread 0x7ff3543edcc0 (LWP 20796) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 113 Thread 0x7ff354489cc0 (LWP 20797) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 112 Thread 0x7ff35649ecc0 (LWP 20798) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 111 Thread 0x7ff354b0acc0 (LWP 20799) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 110 Thread 0x7ff354b95cc0 (LWP 20800) 0x00007ff36035cc7f in accept4 () from /lib64/libc.so.6 109 Thread 0x7ff354c20cc0 (LWP 20801) 0x00007ff360351293 in poll () from /lib64/libc.so.6 108 Thread 0x7ff354cabcc0 (LWP 20802) 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 107 Thread 0x7ff354ffecc0 (LWP 20803) 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 106 Thread 0x7ff35aaddcc0 (LWP 20806) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 105 Thread 0x7ff35aa41cc0 (LWP 20807) 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 104 Thread 0x7ff35a9a5cc0 (LWP 20808) 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 103 Thread 0x7ff35a909cc0 (LWP 20809) 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 102 Thread 0x7ff35a72fcc0 (LWP 20810) 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 101 Thread 0x7ff35a6a4cc0 (LWP 20811) 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 100 Thread 0x7ff35a619cc0 (LWP 20812) 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 99 Thread 0x7ff35a53acc0 (LWP 20813) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 98 Thread 0x7ff35a49ecc0 (LWP 20814) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 97 Thread 0x7ff35a371cc0 (LWP 20815) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 96 Thread 0x7ff35a2d5cc0 (LWP 20816) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 95 Thread 0x7ff35a24acc0 (LWP 20817) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 94 Thread 0x7ff35a112cc0 (LWP 20818) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 93 Thread 0x7ff358ffecc0 (LWP 20819) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 92 Thread 0x7ff358f52cc0 (LWP 20820) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 91 Thread 0x7ff358ec7cc0 (LWP 20821) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 90 Thread 0x7ff358df9cc0 (LWP 20822) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 89 Thread 0x7ff358d6ecc0 (LWP 20823) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 88 Thread 0x7ff358ce3cc0 (LWP 20824) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 87 Thread 0x7ff358c58cc0 (LWP 20825) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 86 Thread 0x7ff358bcdcc0 (LWP 20826) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 85 Thread 0x7ff358b42cc0 (LWP 20827) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 84 Thread 0x7ff358ab7cc0 (LWP 20828) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 83 Thread 0x7ff358983cc0 (LWP 20829) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 82 Thread 0x7ff3588f8cc0 (LWP 20830) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 81 Thread 0x7ff358829cc0 (LWP 20831) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 80 Thread 0x7ff35879ecc0 (LWP 20832) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 79 Thread 0x7ff358713cc0 (LWP 20833) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 78 Thread 0x7ff358688cc0 (LWP 20834) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 77 Thread 0x7ff3585fdcc0 (LWP 20835) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 76 Thread 0x7ff358572cc0 (LWP 20836) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 75 Thread 0x7ff3584e7cc0 (LWP 20837) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 74 Thread 0x7ff35845ccc0 (LWP 20838) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 73 Thread 0x7ff3583d1cc0 (LWP 20839) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 72 Thread 0x7ff358346cc0 (LWP 20840) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 71 Thread 0x7ff3582aacc0 (LWP 20841) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 70 Thread 0x7ff35820ecc0 (LWP 20842) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 69 Thread 0x7ff358172cc0 (LWP 20843) 0x00007ff36035cc7f in accept4 () from /lib64/libc.so.6 68 Thread 0x7ff3580d6cc0 (LWP 20844) 0x00007ff360351293 in poll () from /lib64/libc.so.6 67 Thread 0x7ff356ffecc0 (LWP 20845) 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 66 Thread 0x7ff356f62cc0 (LWP 20846) 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 65 Thread 0x7ff356e4ccc0 (LWP 20852) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 64 Thread 0x7ff356dc1cc0 (LWP 20858) 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 63 Thread 0x7ff356d25cc0 (LWP 20859) 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 62 Thread 0x7ff356c89cc0 (LWP 20860) 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 61 Thread 0x7ff356bedcc0 (LWP 20861) 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 60 Thread 0x7ff356b51cc0 (LWP 20862) 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 59 Thread 0x7ff356ab5cc0 (LWP 20863) 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 58 Thread 0x7ff3569f6cc0 (LWP 20864) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 57 Thread 0x7ff35689acc0 (LWP 20865) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 56 Thread 0x7ff3563cdcc0 (LWP 20866) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 55 Thread 0x7ff356342cc0 (LWP 20867) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 54 Thread 0x7ff356234cc0 (LWP 20868) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 53 Thread 0x7ff356198cc0 (LWP 20869) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 52 Thread 0x7ff3560fccc0 (LWP 20870) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 51 Thread 0x7ff354f73cc0 (LWP 20871) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 50 Thread 0x7ff354ee8cc0 (LWP 20872) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 49 Thread 0x7ff354e5dcc0 (LWP 20873) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 48 Thread 0x7ff354dd2cc0 (LWP 20874) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 47 Thread 0x7ff354d47cc0 (LWP 20875) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 46 Thread 0x7ff354a7fcc0 (LWP 20876) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 45 Thread 0x7ff3549f4cc0 (LWP 20877) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 44 Thread 0x7ff354969cc0 (LWP 20878) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 43 Thread 0x7ff3548decc0 (LWP 20879) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 42 Thread 0x7ff354853cc0 (LWP 20880) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 41 Thread 0x7ff3547c8cc0 (LWP 20881) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 40 Thread 0x7ff35473dcc0 (LWP 20882) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 39 Thread 0x7ff3546b2cc0 (LWP 20883) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 38 Thread 0x7ff354627cc0 (LWP 20884) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 37 Thread 0x7ff35459ccc0 (LWP 20885) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 36 Thread 0x7ff352ffecc0 (LWP 20886) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 35 Thread 0x7ff352f73cc0 (LWP 20887) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 34 Thread 0x7ff352ee8cc0 (LWP 20888) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 33 Thread 0x7ff352e5dcc0 (LWP 20889) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 32 Thread 0x7ff352dd2cc0 (LWP 20890) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 31 Thread 0x7ff352d47cc0 (LWP 20891) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 30 Thread 0x7ff352b0acc0 (LWP 20892) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 29 Thread 0x7ff352a7fcc0 (LWP 20893) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 28 Thread 0x7ff3529f4cc0 (LWP 20894) 0x00007ff36035cc7f in accept4 () from /lib64/libc.so.6 27 Thread 0x7ff352969cc0 (LWP 20895) 0x00007ff360351293 in poll () from /lib64/libc.so.6 26 Thread 0x7ff3528decc0 (LWP 20896) 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 25 Thread 0x7ff352853cc0 (LWP 20897) 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 24 Thread 0x7ff35273dcc0 (LWP 20899) 0x00007ff3661d8d2d in nanosleep () from /lib64/libpthread.so.0 23 Thread 0x7ff35240fcc0 (LWP 20900) 0x00007ff3661d8d2d in nanosleep () from /lib64/libpthread.so.0 22 Thread 0x7ff352384cc0 (LWP 20901) 0x00007ff3661d8d2d in nanosleep () from /lib64/libpthread.so.0 21 Thread 0x7ff350f33cc0 (LWP 20902) 0x00007ff3661d8d2d in nanosleep () from /lib64/libpthread.so.0 20 Thread 0x7ff34c10fcc0 (LWP 20934) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 19 Thread 0x7ff350438cc0 (LWP 20939) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 18 Thread 0x7ff3502a1cc0 (LWP 20944) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 17 Thread 0x7ff350a23cc0 (LWP 20954) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 16 Thread 0x7ff34ed89cc0 (LWP 20966) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 15 Thread 0x7ff350bc5cc0 (LWP 20967) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 14 Thread 0x7ff34ebe8cc0 (LWP 20977) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 13 Thread 0x7ff34e9f0cc0 (LWP 20992) 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 12 Thread 0x7ff34e965cc0 (LWP 20993) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 11 Thread 0x7ff3504c3cc0 (LWP 20995) 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 10 Thread 0x7ff34e7c4cc0 (LWP 20998) 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 9 Thread 0x7ff34e739cc0 (LWP 20999) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 8 Thread 0x7ff34e623cc0 (LWP 21002) 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 7 Thread 0x7ff34e48dcc0 (LWP 21005) 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 6 Thread 0x7ff34e402cc0 (LWP 21006) 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 5 Thread 0x7ff34e377cc0 (LWP 27036) 0x00007ff3661d909d in waitpid () from /lib64/libpthread.so.0 4 Thread 0x7ff352116cc0 (LWP 27042) 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 3 Thread 0x7ff34e6aecc0 (LWP 27043) 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 2 Thread 0x7ff34e518cc0 (LWP 27044) 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 * 1 Thread 0x7ff36ade1cc0 (LWP 18449) 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 Thread 178 (Thread 0x7ff35ec3c700 (LWP 18502)): #0 0x00007ff36031ebcd in nanosleep () from /lib64/libc.so.6 #1 0x00007ff36031ea40 in sleep () from /lib64/libc.so.6 #2 0x00007ff36ae49489 in __interceptor_sleep () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:239 #3 0x00007ff36ae9ab13 in BackgroundThread () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_rtl.cc:138 #4 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #5 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 177 (Thread 0x7ff36acc2cc0 (LWP 18511)): #0 0x00007ff360daa19a in timer_helper_thread () from /lib64/librt.so.1 #1 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #2 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #3 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 176 (Thread 0x7ff35a1aecc0 (LWP 18790)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d300001dfb0, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 #3 0x00007ff36a9cd11c in kudu::CountDownLatch::WaitFor (this=, delta=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:75 #4 0x00007ff3621b3513 in kudu::KernelStackWatchdog::RunThread (this=0x7d300001df40) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/kernel_stack_watchdog.cc:58 #5 0x00007ff3621b5bee in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #6 0x00007ff3621b5b5b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #7 0x00007ff3621b5b04 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380001bf50) at /usr/include/boost/bind/bind_template.hpp:20 #8 0x00007ff3621b590a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 175 (Thread 0x7ff34ea7bcc0 (LWP 20730)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d6400263900, timeout=) at ev_epoll.c:153 #3 0x00007ff362b0b5da in ev_run (loop=0x7d6400263900, flags=) at ev.c:3360 #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d480003a6c8, flags=5376) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d480003a6c0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800003050) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 174 (Thread 0x7ff350de7cc0 (LWP 20731)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d6400263e00, timeout=) at ev_epoll.c:153 #3 0x00007ff362b0b5da in ev_run (loop=0x7d6400263e00, flags=) at ev.c:3360 #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d480001f548, flags=4608) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d480001f540) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800003130) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 173 (Thread 0x7ff34e8dacc0 (LWP 20732)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d6400264800, timeout=) at ev_epoll.c:153 #3 0x00007ff362b0b5da in ev_run (loop=0x7d6400264800, flags=) at ev.c:3360 #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d480003a848, flags=3840) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d480003a840) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800003210) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 172 (Thread 0x7ff350aaecc0 (LWP 20733)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d6400264d00, timeout=) at ev_epoll.c:153 #3 0x00007ff362b0b5da in ev_run (loop=0x7d6400264d00, flags=) at ev.c:3360 #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d48000088c8, flags=0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d48000088c0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000032f0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 171 (Thread 0x7ff35088dcc0 (LWP 20734)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48000229f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229b0, out=0x7ff350823ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229fc, out=0x7ff350823c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000033d0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 170 (Thread 0x7ff35249acc0 (LWP 20735)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48000229f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229b0, out=0x7ff352430ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229fc, out=0x7ff352430c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000034b0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 169 (Thread 0x7ff34e09ccc0 (LWP 20736)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48000229f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229b0, out=0x7ff34e032ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229fc, out=0x7ff34e032c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800003590) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 168 (Thread 0x7ff34e127cc0 (LWP 20737)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48000229f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229b0, out=0x7ff34e0bdae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229fc, out=0x7ff34e0bdc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800003670) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 167 (Thread 0x7ff34ca8acc0 (LWP 20738)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48000229f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229b0, out=0x7ff34ca20ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229fc, out=0x7ff34ca20c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800004550) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 166 (Thread 0x7ff352525cc0 (LWP 20739)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48000229f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229b0, out=0x7ff3524bbae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229fc, out=0x7ff3524bbc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800004390) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 165 (Thread 0x7ff34e23dcc0 (LWP 20740)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48000229f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229b0, out=0x7ff34e1d3ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229fc, out=0x7ff34e1d3c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800003e50) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 164 (Thread 0x7ff34cffecc0 (LWP 20741)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48000229f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229b0, out=0x7ff34cf94ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229fc, out=0x7ff34cf94c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000040f0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 163 (Thread 0x7ff350998cc0 (LWP 20742)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48000229f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229b0, out=0x7ff35092eae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229fc, out=0x7ff35092ec20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800004010) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 162 (Thread 0x7ff3525b0cc0 (LWP 20743)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48000229f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229b0, out=0x7ff352546ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229fc, out=0x7ff352546c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800003f30) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 161 (Thread 0x7ff35263bcc0 (LWP 20744)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480003ae78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae30, out=0x7ff3525d1ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae7c, out=0x7ff3525d1c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000041d0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 160 (Thread 0x7ff34cf73cc0 (LWP 20745)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480003ae78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae30, out=0x7ff34cf09ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae7c, out=0x7ff34cf09c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800004710) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 159 (Thread 0x7ff34c451cc0 (LWP 20746)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480003ae78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae30, out=0x7ff34c3e7ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae7c, out=0x7ff34c3e7c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000d310) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 158 (Thread 0x7ff34c19acc0 (LWP 20747)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480003ae78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae30, out=0x7ff34c130ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae7c, out=0x7ff34c130c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000d3f0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 157 (Thread 0x7ff3506f7cc0 (LWP 20748)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480003ae78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae30, out=0x7ff35068dae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae7c, out=0x7ff35068dc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000d4d0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 156 (Thread 0x7ff35c2dbcc0 (LWP 20749)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480003ae78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae30, out=0x7ff35c271ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae7c, out=0x7ff35c271c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000d5b0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 155 (Thread 0x7ff35c5e2cc0 (LWP 20750)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480003ae78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae30, out=0x7ff35c578ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae7c, out=0x7ff35c578c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000d690) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 154 (Thread 0x7ff350095cc0 (LWP 20751)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480003ae78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae30, out=0x7ff35002bae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae7c, out=0x7ff35002bc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000d770) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 153 (Thread 0x7ff34c7d3cc0 (LWP 20752)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480003ae78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae30, out=0x7ff34c769ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae7c, out=0x7ff34c769c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800084d90) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 152 (Thread 0x7ff34cbb1cc0 (LWP 20753)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480003ae78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae30, out=0x7ff34cb47ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae7c, out=0x7ff34cb47c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800084bd0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 151 (Thread 0x7ff3521a1cc0 (LWP 20754)): #0 0x00007ff36035cc7f in accept4 () from /lib64/libc.so.6 #1 0x00007ff36ae64f06 in __interceptor_accept4 () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:1335 #2 0x00007ff3621eb169 in kudu::Socket::Accept (this=0x7d140007d378, new_conn=0x7ff352137c20, remote=0x7ff352137c10, flags=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/net/socket.cc:257 #3 0x00007ff3631d8963 in kudu::rpc::AcceptorPool::RunThread (this=0x7d140007d370) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/acceptor_pool.cc:96 #4 0x00007ff3631dc2ae in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #5 0x00007ff3631dc21b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #6 0x00007ff3631dc1a4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800004fd0) at /usr/include/boost/bind/bind_template.hpp:20 #7 0x00007ff3631dbf4a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 150 (Thread 0x7ff350182cc0 (LWP 20755)): #0 0x00007ff360351293 in poll () from /lib64/libc.so.6 #1 0x00007ff36ae69c8d in __interceptor_poll () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:1992 #2 0x00007ff36786237e in master_thread () from /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/build/fastdebug/libserver_process.so #3 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #4 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #5 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 149 (Thread 0x7ff34c2b0cc0 (LWP 20758)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d60000685e8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff368439687 in kudu::BlockingQueue::BlockingDrainTo (this=0x7d60000685a0, out=0x7ff34c246c10) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:108 #4 0x00007ff368431107 in kudu::log::Log::AppendThread::RunThread (this=0x7d10000831c0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/consensus/log.cc:99 #5 0x00007ff36844527e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #6 0x00007ff3684451eb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #7 0x00007ff368445194 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800003bb0) at /usr/include/boost/bind/bind_template.hpp:20 #8 0x00007ff368444f9a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 148 (Thread 0x7ff34c225cc0 (LWP 20762)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 #2 0x00007ff3693f80c8 in boost::condition_variable::timed_wait (this=0x7d1c0008e790, m=..., wait_until=) at /usr/include/boost/thread/pthread/condition_variable.hpp:27 #3 0x00007ff3693c5054 in kudu::master::CatalogManagerBgTasks::Wait (this=, msec=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/master/catalog_manager.cc:222 #4 0x00007ff3693b32a8 in kudu::master::CatalogManagerBgTasks::Run (this=0x7d1c0008e760) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/master/catalog_manager.cc:301 #5 0x00007ff3693e791e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #6 0x00007ff3693e788b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #7 0x00007ff3693e7814 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800003d70) at /usr/include/boost/bind/bind_template.hpp:20 #8 0x00007ff3693e75ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 147 (Thread 0x7ff34c85ecc0 (LWP 20763)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d44000ba898) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff3622142a6 in kudu::ThreadPool::DispatchThread (this=0x7d44000ba7c0, permanent=true) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/threadpool.cc:240 #4 0x00007ff362215ce6 in boost::_mfi::mf1::operator() (this=, p=, a1=true) at /usr/include/boost/bind/mem_fn_template.hpp:162 #5 0x00007ff362215c4c in boost::_bi::list2, boost::_bi::value >::operator(), boost::_bi::list0> (this=0x7d08000637d0, f=, a=...) at /usr/include/boost/bind/bind.hpp:306 #6 0x00007ff362215bd4 in boost::_bi::bind_t, boost::_bi::list2, boost::_bi::value > >::operator() (this=0x7d08000637c0) at /usr/include/boost/bind/bind_template.hpp:20 #7 0x00007ff3622159d2 in boost::detail::function::void_function_obj_invoker0, boost::_bi::list2, boost::_bi::value > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 146 (Thread 0x7ff35a856cc0 (LWP 20764)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d64000ee700, timeout=) at ev_epoll.c:153 #3 0x00007ff362b0b5da in ev_run (loop=0x7d64000ee700, flags=) at ev.c:3360 #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d4800021ac8, flags=768) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d4800021ac0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000cc10) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 145 (Thread 0x7ff35222ccc0 (LWP 20765)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d640021b600, timeout=) at ev_epoll.c:153 #3 0x00007ff362b0b5da in ev_run (loop=0x7d640021b600, flags=) at ev.c:3360 #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d480003b148, flags=1536) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d480003b140) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000ccf0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 144 (Thread 0x7ff35c21dcc0 (LWP 20766)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d6400265200, timeout=) at ev_epoll.c:153 #3 0x00007ff362b0b5da in ev_run (loop=0x7d6400265200, flags=) at ev.c:3360 #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d48000217c8, flags=2304) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d48000217c0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000cdd0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 143 (Thread 0x7ff350fbecc0 (LWP 20767)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d6400265700, timeout=) at ev_epoll.c:153 #3 0x00007ff362b0b5da in ev_run (loop=0x7d6400265700, flags=) at ev.c:3360 #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d480003b2c8, flags=3072) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d480003b2c0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000ceb0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 142 (Thread 0x7ff34c3c6cc0 (LWP 20768)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 #2 0x00007ff3693f80c8 in boost::condition_variable::timed_wait (this=0x7d4c00029788, m=..., wait_until=) at /usr/include/boost/thread/pthread/condition_variable.hpp:27 #3 0x00007ff36905f754 in kudu::tserver::ScannerManager::RunRemovalThread (this=0x7d4c00029740) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tserver/scanners.cc:72 #4 0x00007ff369065f5e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #5 0x00007ff369065ecb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #6 0x00007ff369065e74 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800006d90) at /usr/include/boost/bind/bind_template.hpp:20 #7 0x00007ff369065c7a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 141 (Thread 0x7ff34c974cc0 (LWP 20769)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d440001d5a0, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 #3 0x00007ff36a9cd11c in kudu::CountDownLatch::WaitFor (this=, delta=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:75 #4 0x00007ff369049196 in kudu::tserver::RemoteBootstrapServiceImpl::EndExpiredSessions (this=0x7d440001d4c0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tserver/remote_bootstrap_service.cc:333 #5 0x00007ff369051cbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #6 0x00007ff369051c2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #7 0x00007ff369051bd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800006930) at /usr/include/boost/bind/bind_template.hpp:20 #8 0x00007ff3690519da in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 140 (Thread 0x7ff34c8e9cc0 (LWP 20770)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000bbf8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbb0, out=0x7ff34c87fae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbfc, out=0x7ff34c87fc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800006af0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 139 (Thread 0x7ff35c0e5cc0 (LWP 20771)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000bbf8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbb0, out=0x7ff35c07bae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbfc, out=0x7ff35c07bc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000d230) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 138 (Thread 0x7ff35a7bacc0 (LWP 20772)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000bbf8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbb0, out=0x7ff35a750ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbfc, out=0x7ff35a750c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000c970) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 137 (Thread 0x7ff35c66dcc0 (LWP 20773)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000bbf8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbb0, out=0x7ff35c603ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbfc, out=0x7ff35c603c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000c890) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 136 (Thread 0x7ff35c377cc0 (LWP 20774)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000bbf8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbb0, out=0x7ff35c30dae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbfc, out=0x7ff35c30dc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800045d90) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 135 (Thread 0x7ff3567dccc0 (LWP 20775)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000bbf8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbb0, out=0x7ff356772ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbfc, out=0x7ff356772c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000042b0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 134 (Thread 0x7ff356608cc0 (LWP 20776)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000bbf8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbb0, out=0x7ff35659eae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbfc, out=0x7ff35659ec20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380008bd90) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 133 (Thread 0x7ff3566a4cc0 (LWP 20777)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000bbf8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbb0, out=0x7ff35663aae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbfc, out=0x7ff35663ac20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800004470) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 132 (Thread 0x7ff356740cc0 (LWP 20778)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000bbf8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbb0, out=0x7ff3566d6ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbfc, out=0x7ff3566d6c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800029070) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 131 (Thread 0x7ff350c90cc0 (LWP 20779)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000bbf8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbb0, out=0x7ff350c26ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbfc, out=0x7ff350c26c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380007dbd0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 130 (Thread 0x7ff35656ccc0 (LWP 20780)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000ba78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba30, out=0x7ff356502ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba7c, out=0x7ff356502c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800007030) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 129 (Thread 0x7ff352b95cc0 (LWP 20781)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000ba78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba30, out=0x7ff352b2bae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba7c, out=0x7ff352b2bc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800007110) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 128 (Thread 0x7ff34cd52cc0 (LWP 20782)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000ba78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba30, out=0x7ff34cce8ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba7c, out=0x7ff34cce8c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000071f0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 127 (Thread 0x7ff350b39cc0 (LWP 20783)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000ba78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba30, out=0x7ff350acfae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba7c, out=0x7ff350acfc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000072d0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 126 (Thread 0x7ff350ea8cc0 (LWP 20784)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000ba78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba30, out=0x7ff350e3eae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba7c, out=0x7ff350e3ec20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000073b0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 125 (Thread 0x7ff35054ecc0 (LWP 20785)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000ba78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba30, out=0x7ff3504e4ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba7c, out=0x7ff3504e4c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800007490) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 124 (Thread 0x7ff3522f3cc0 (LWP 20786)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000ba78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba30, out=0x7ff352289ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba7c, out=0x7ff352289c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800007570) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 123 (Thread 0x7ff356925cc0 (LWP 20787)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000ba78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba30, out=0x7ff3568bbae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba7c, out=0x7ff3568bbc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800007650) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 122 (Thread 0x7ff34e84fcc0 (LWP 20788)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000ba78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba30, out=0x7ff34e7e5ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba7c, out=0x7ff34e7e5c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800007730) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 121 (Thread 0x7ff352c20cc0 (LWP 20789)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000ba78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba30, out=0x7ff352bb6ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba7c, out=0x7ff352bb6c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800006850) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 120 (Thread 0x7ff352cabcc0 (LWP 20790)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800018df8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018db0, out=0x7ff352c41ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018dfc, out=0x7ff352c41c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800030bd0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 119 (Thread 0x7ff3540e1cc0 (LWP 20791)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800018df8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018db0, out=0x7ff354077ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018dfc, out=0x7ff354077c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800007810) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 118 (Thread 0x7ff35417dcc0 (LWP 20792)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800018df8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018db0, out=0x7ff354113ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018dfc, out=0x7ff354113c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800006070) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 117 (Thread 0x7ff354219cc0 (LWP 20793)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800018df8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018db0, out=0x7ff3541afae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018dfc, out=0x7ff3541afc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800006150) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 116 (Thread 0x7ff3542b5cc0 (LWP 20794)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800018df8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018db0, out=0x7ff35424bae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018dfc, out=0x7ff35424bc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800006230) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 115 (Thread 0x7ff354351cc0 (LWP 20795)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800018df8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018db0, out=0x7ff3542e7ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018dfc, out=0x7ff3542e7c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800006310) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 114 (Thread 0x7ff3543edcc0 (LWP 20796)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800018df8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018db0, out=0x7ff354383ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018dfc, out=0x7ff354383c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000063f0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 113 (Thread 0x7ff354489cc0 (LWP 20797)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800018df8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018db0, out=0x7ff35441fae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018dfc, out=0x7ff35441fc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000064d0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 112 (Thread 0x7ff35649ecc0 (LWP 20798)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800018df8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018db0, out=0x7ff356434ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018dfc, out=0x7ff356434c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000065b0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 111 (Thread 0x7ff354b0acc0 (LWP 20799)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800018df8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018db0, out=0x7ff354aa0ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018dfc, out=0x7ff354aa0c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800006690) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 110 (Thread 0x7ff354b95cc0 (LWP 20800)): #0 0x00007ff36035cc7f in accept4 () from /lib64/libc.so.6 #1 0x00007ff36ae64f06 in __interceptor_accept4 () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:1335 #2 0x00007ff3621eb169 in kudu::Socket::Accept (this=0x7d140008ddb8, new_conn=0x7ff354b2bc20, remote=0x7ff354b2bc10, flags=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/net/socket.cc:257 #3 0x00007ff3631d8963 in kudu::rpc::AcceptorPool::RunThread (this=0x7d140008ddb0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/acceptor_pool.cc:96 #4 0x00007ff3631dc2ae in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #5 0x00007ff3631dc21b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #6 0x00007ff3631dc1a4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000057b0) at /usr/include/boost/bind/bind_template.hpp:20 #7 0x00007ff3631dbf4a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 109 (Thread 0x7ff354c20cc0 (LWP 20801)): #0 0x00007ff360351293 in poll () from /lib64/libc.so.6 #1 0x00007ff36ae69c8d in __interceptor_poll () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:1992 #2 0x00007ff36786237e in master_thread () from /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/build/fastdebug/libserver_process.so #3 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #4 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #5 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 108 (Thread 0x7ff354cabcc0 (LWP 20802)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d4000057fb8, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 #3 0x00007ff36a9cd11c in kudu::CountDownLatch::WaitFor (this=, delta=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:75 #4 0x00007ff36902f5b0 in kudu::tserver::Heartbeater::Thread::RunThread (this=0x7d4000057f00) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tserver/heartbeater.cc:344 #5 0x00007ff36903235e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #6 0x00007ff3690322cb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #7 0x00007ff369032254 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800005890) at /usr/include/boost/bind/bind_template.hpp:20 #8 0x00007ff369031ffa in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 107 (Thread 0x7ff354ffecc0 (LWP 20803)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 #2 0x00007ff3693f80c8 in boost::condition_variable::timed_wait (this=0x7d4000077f88, m=..., wait_until=) at /usr/include/boost/thread/pthread/condition_variable.hpp:27 #3 0x00007ff368bf35d8 in kudu::MaintenanceManager::RunSchedulerThread (this=0x7d4000077f00) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tablet/maintenance_manager.cc:185 #4 0x00007ff368bf933e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #5 0x00007ff368bf92ab in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #6 0x00007ff368bf9254 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800005970) at /usr/include/boost/bind/bind_template.hpp:20 #7 0x00007ff368bf905a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 106 (Thread 0x7ff35aaddcc0 (LWP 20806)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d440009ee18) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff3622142a6 in kudu::ThreadPool::DispatchThread (this=0x7d440009ed40, permanent=true) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/threadpool.cc:240 #4 0x00007ff362215ce6 in boost::_mfi::mf1::operator() (this=, p=, a1=true) at /usr/include/boost/bind/mem_fn_template.hpp:162 #5 0x00007ff362215c4c in boost::_bi::list2, boost::_bi::value >::operator(), boost::_bi::list0> (this=0x7d0800056890, f=, a=...) at /usr/include/boost/bind/bind.hpp:306 #6 0x00007ff362215bd4 in boost::_bi::bind_t, boost::_bi::list2, boost::_bi::value > >::operator() (this=0x7d0800056880) at /usr/include/boost/bind/bind_template.hpp:20 #7 0x00007ff3622159d2 in boost::detail::function::void_function_obj_invoker0, boost::_bi::list2, boost::_bi::value > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 105 (Thread 0x7ff35aa41cc0 (LWP 20807)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d640029ae00, timeout=) at ev_epoll.c:153 #3 0x00007ff362b0b5da in ev_run (loop=0x7d640029ae00, flags=) at ev.c:3360 #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d4800004cc8, flags=6144) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d4800004cc0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800005c10) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 104 (Thread 0x7ff35a9a5cc0 (LWP 20808)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d640001e500, timeout=) at ev_epoll.c:153 #3 0x00007ff362b0b5da in ev_run (loop=0x7d640001e500, flags=) at ev.c:3360 #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d4800015048, flags=24576) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d4800015040) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800005cf0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 103 (Thread 0x7ff35a909cc0 (LWP 20809)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d640000ff00, timeout=) at ev_epoll.c:153 #3 0x00007ff362b0b5da in ev_run (loop=0x7d640000ff00, flags=) at ev.c:3360 #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d4800007b48, flags=25344) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d4800007b40) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800005dd0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 102 (Thread 0x7ff35a72fcc0 (LWP 20810)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d64002a0800, timeout=) at ev_epoll.c:153 #3 0x00007ff362b0b5da in ev_run (loop=0x7d64002a0800, flags=) at ev.c:3360 #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d480001e648, flags=26112) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d480001e640) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800005eb0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 101 (Thread 0x7ff35a6a4cc0 (LWP 20811)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 #2 0x00007ff3693f80c8 in boost::condition_variable::timed_wait (this=0x7d4c000295c8, m=..., wait_until=) at /usr/include/boost/thread/pthread/condition_variable.hpp:27 #3 0x00007ff36905f754 in kudu::tserver::ScannerManager::RunRemovalThread (this=0x7d4c00029580) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tserver/scanners.cc:72 #4 0x00007ff369065f5e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #5 0x00007ff369065ecb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #6 0x00007ff369065e74 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800005f90) at /usr/include/boost/bind/bind_template.hpp:20 #7 0x00007ff369065c7a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 100 (Thread 0x7ff35a619cc0 (LWP 20812)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d440009a6e0, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 #3 0x00007ff36a9cd11c in kudu::CountDownLatch::WaitFor (this=, delta=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:75 #4 0x00007ff369049196 in kudu::tserver::RemoteBootstrapServiceImpl::EndExpiredSessions (this=0x7d440009a600) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tserver/remote_bootstrap_service.cc:333 #5 0x00007ff369051cbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #6 0x00007ff369051c2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #7 0x00007ff369051bd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000c7b0) at /usr/include/boost/bind/bind_template.hpp:20 #8 0x00007ff3690519da in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 99 (Thread 0x7ff35a53acc0 (LWP 20813)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800047478) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800047430, out=0x7ff35a4d0ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480004747c, out=0x7ff35a4d0c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000056d0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 98 (Thread 0x7ff35a49ecc0 (LWP 20814)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800047478) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800047430, out=0x7ff35a434ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480004747c, out=0x7ff35a434c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000055f0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 97 (Thread 0x7ff35a371cc0 (LWP 20815)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800047478) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800047430, out=0x7ff35a307ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480004747c, out=0x7ff35a307c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800004d30) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 96 (Thread 0x7ff35a2d5cc0 (LWP 20816)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800047478) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800047430, out=0x7ff35a26bae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480004747c, out=0x7ff35a26bc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380001b690) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 95 (Thread 0x7ff35a24acc0 (LWP 20817)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800047478) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800047430, out=0x7ff35a1e0ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480004747c, out=0x7ff35a1e0c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000daf0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 94 (Thread 0x7ff35a112cc0 (LWP 20818)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800047478) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800047430, out=0x7ff35a0a8ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480004747c, out=0x7ff35a0a8c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000dcb0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 93 (Thread 0x7ff358ffecc0 (LWP 20819)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800047478) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800047430, out=0x7ff358f94ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480004747c, out=0x7ff358f94c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000d070) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 92 (Thread 0x7ff358f52cc0 (LWP 20820)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800047478) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800047430, out=0x7ff358ee8ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480004747c, out=0x7ff358ee8c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800030d90) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 91 (Thread 0x7ff358ec7cc0 (LWP 20821)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800047478) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800047430, out=0x7ff358e5dae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480004747c, out=0x7ff358e5dc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380007dd90) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 90 (Thread 0x7ff358df9cc0 (LWP 20822)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800047478) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800047430, out=0x7ff358d8fae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480004747c, out=0x7ff358d8fc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000094f0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 89 (Thread 0x7ff358d6ecc0 (LWP 20823)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001a3d78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d30, out=0x7ff358d04ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d7c, out=0x7ff358d04c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000095d0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 88 (Thread 0x7ff358ce3cc0 (LWP 20824)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001a3d78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d30, out=0x7ff358c79ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d7c, out=0x7ff358c79c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000096b0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 87 (Thread 0x7ff358c58cc0 (LWP 20825)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001a3d78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d30, out=0x7ff358beeae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d7c, out=0x7ff358beec20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800009790) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 86 (Thread 0x7ff358bcdcc0 (LWP 20826)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001a3d78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d30, out=0x7ff358b63ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d7c, out=0x7ff358b63c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800009870) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 85 (Thread 0x7ff358b42cc0 (LWP 20827)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001a3d78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d30, out=0x7ff358ad8ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d7c, out=0x7ff358ad8c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800009950) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 84 (Thread 0x7ff358ab7cc0 (LWP 20828)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001a3d78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d30, out=0x7ff358a4dae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d7c, out=0x7ff358a4dc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800009a30) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 83 (Thread 0x7ff358983cc0 (LWP 20829)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001a3d78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d30, out=0x7ff358919ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d7c, out=0x7ff358919c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800009b10) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 82 (Thread 0x7ff3588f8cc0 (LWP 20830)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001a3d78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d30, out=0x7ff35888eae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d7c, out=0x7ff35888ec20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800009bf0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 81 (Thread 0x7ff358829cc0 (LWP 20831)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001a3d78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d30, out=0x7ff3587bfae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d7c, out=0x7ff3587bfc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800008370) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 80 (Thread 0x7ff35879ecc0 (LWP 20832)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001a3d78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d30, out=0x7ff358734ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d7c, out=0x7ff358734c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800030af0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 79 (Thread 0x7ff358713cc0 (LWP 20833)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480014fef8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480014feb0, out=0x7ff3586a9ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480014fefc, out=0x7ff3586a9c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800008b50) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 78 (Thread 0x7ff358688cc0 (LWP 20834)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480014fef8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480014feb0, out=0x7ff35861eae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480014fefc, out=0x7ff35861ec20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800008c30) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 77 (Thread 0x7ff3585fdcc0 (LWP 20835)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480014fef8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480014feb0, out=0x7ff358593ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480014fefc, out=0x7ff358593c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800008d10) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 76 (Thread 0x7ff358572cc0 (LWP 20836)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480014fef8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480014feb0, out=0x7ff358508ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480014fefc, out=0x7ff358508c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800008df0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 75 (Thread 0x7ff3584e7cc0 (LWP 20837)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480014fef8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480014feb0, out=0x7ff35847dae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480014fefc, out=0x7ff35847dc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800008ed0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 74 (Thread 0x7ff35845ccc0 (LWP 20838)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480014fef8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480014feb0, out=0x7ff3583f2ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480014fefc, out=0x7ff3583f2c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800008fb0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 73 (Thread 0x7ff3583d1cc0 (LWP 20839)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480014fef8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480014feb0, out=0x7ff358367ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480014fefc, out=0x7ff358367c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800009090) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 72 (Thread 0x7ff358346cc0 (LWP 20840)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480014fef8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480014feb0, out=0x7ff3582dcae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480014fefc, out=0x7ff3582dcc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800009170) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 71 (Thread 0x7ff3582aacc0 (LWP 20841)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480014fef8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480014feb0, out=0x7ff358240ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480014fefc, out=0x7ff358240c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800009250) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 70 (Thread 0x7ff35820ecc0 (LWP 20842)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480014fef8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480014feb0, out=0x7ff3581a4ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480014fefc, out=0x7ff3581a4c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800009330) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 69 (Thread 0x7ff358172cc0 (LWP 20843)): #0 0x00007ff36035cc7f in accept4 () from /lib64/libc.so.6 #1 0x00007ff36ae64f06 in __interceptor_accept4 () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:1335 #2 0x00007ff3621eb169 in kudu::Socket::Accept (this=0x7d140002c388, new_conn=0x7ff358108c20, remote=0x7ff358108c10, flags=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/net/socket.cc:257 #3 0x00007ff3631d8963 in kudu::rpc::AcceptorPool::RunThread (this=0x7d140002c380) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/acceptor_pool.cc:96 #4 0x00007ff3631dc2ae in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #5 0x00007ff3631dc21b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #6 0x00007ff3631dc1a4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800008450) at /usr/include/boost/bind/bind_template.hpp:20 #7 0x00007ff3631dbf4a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 68 (Thread 0x7ff3580d6cc0 (LWP 20844)): #0 0x00007ff360351293 in poll () from /lib64/libc.so.6 #1 0x00007ff36ae69c8d in __interceptor_poll () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:1992 #2 0x00007ff36786237e in master_thread () from /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/build/fastdebug/libserver_process.so #3 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #4 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #5 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 67 (Thread 0x7ff356ffecc0 (LWP 20845)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d400002fab8, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 #3 0x00007ff36a9cd11c in kudu::CountDownLatch::WaitFor (this=, delta=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:75 #4 0x00007ff36902f5b0 in kudu::tserver::Heartbeater::Thread::RunThread (this=0x7d400002fa00) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tserver/heartbeater.cc:344 #5 0x00007ff36903235e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #6 0x00007ff3690322cb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #7 0x00007ff369032254 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800008530) at /usr/include/boost/bind/bind_template.hpp:20 #8 0x00007ff369031ffa in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 66 (Thread 0x7ff356f62cc0 (LWP 20846)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 #2 0x00007ff3693f80c8 in boost::condition_variable::timed_wait (this=0x7d4000057d88, m=..., wait_until=) at /usr/include/boost/thread/pthread/condition_variable.hpp:27 #3 0x00007ff368bf35d8 in kudu::MaintenanceManager::RunSchedulerThread (this=0x7d4000057d00) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tablet/maintenance_manager.cc:185 #4 0x00007ff368bf933e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #5 0x00007ff368bf92ab in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #6 0x00007ff368bf9254 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800008610) at /usr/include/boost/bind/bind_template.hpp:20 #7 0x00007ff368bf905a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 65 (Thread 0x7ff356e4ccc0 (LWP 20852)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d44000b9c18) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff3622142a6 in kudu::ThreadPool::DispatchThread (this=0x7d44000b9b40, permanent=true) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/threadpool.cc:240 #4 0x00007ff362215ce6 in boost::_mfi::mf1::operator() (this=, p=, a1=true) at /usr/include/boost/bind/mem_fn_template.hpp:162 #5 0x00007ff362215c4c in boost::_bi::list2, boost::_bi::value >::operator(), boost::_bi::list0> (this=0x7d080000b930, f=, a=...) at /usr/include/boost/bind/bind.hpp:306 #6 0x00007ff362215bd4 in boost::_bi::bind_t, boost::_bi::list2, boost::_bi::value > >::operator() (this=0x7d080000b920) at /usr/include/boost/bind/bind_template.hpp:20 #7 0x00007ff3622159d2 in boost::detail::function::void_function_obj_invoker0, boost::_bi::list2, boost::_bi::value > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 64 (Thread 0x7ff356dc1cc0 (LWP 20858)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d6400057800, timeout=) at ev_epoll.c:153 #3 0x00007ff362b0b5da in ev_run (loop=0x7d6400057800, flags=) at ev.c:3360 #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d480000a0c8, flags=26880) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d480000a0c0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000088b0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 63 (Thread 0x7ff356d25cc0 (LWP 20859)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d6400058c00, timeout=) at ev_epoll.c:153 #3 0x00007ff362b0b5da in ev_run (loop=0x7d6400058c00, flags=) at ev.c:3360 #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d480001e4c8, flags=6912) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d480001e4c0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800008990) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 62 (Thread 0x7ff356c89cc0 (LWP 20860)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d64002a0300, timeout=) at ev_epoll.c:153 #3 0x00007ff362b0b5da in ev_run (loop=0x7d64002a0300, flags=) at ev.c:3360 #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d4800203448, flags=7680) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d4800203440) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800008a70) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 61 (Thread 0x7ff356bedcc0 (LWP 20861)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d640029fe00, timeout=) at ev_epoll.c:153 #3 0x00007ff362b0b5da in ev_run (loop=0x7d640029fe00, flags=) at ev.c:3360 #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d48000154c8, flags=8448) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d48000154c0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800009cd0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 60 (Thread 0x7ff356b51cc0 (LWP 20862)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 #2 0x00007ff3693f80c8 in boost::condition_variable::timed_wait (this=0x7d4c0000cd08, m=..., wait_until=) at /usr/include/boost/thread/pthread/condition_variable.hpp:27 #3 0x00007ff36905f754 in kudu::tserver::ScannerManager::RunRemovalThread (this=0x7d4c0000ccc0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tserver/scanners.cc:72 #4 0x00007ff369065f5e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #5 0x00007ff369065ecb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #6 0x00007ff369065e74 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800008290) at /usr/include/boost/bind/bind_template.hpp:20 #7 0x00007ff369065c7a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 59 (Thread 0x7ff356ab5cc0 (LWP 20863)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d440009f0a0, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 #3 0x00007ff36a9cd11c in kudu::CountDownLatch::WaitFor (this=, delta=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:75 #4 0x00007ff369049196 in kudu::tserver::RemoteBootstrapServiceImpl::EndExpiredSessions (this=0x7d440009efc0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tserver/remote_bootstrap_service.cc:333 #5 0x00007ff369051cbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #6 0x00007ff369051c2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #7 0x00007ff369051bd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800009410) at /usr/include/boost/bind/bind_template.hpp:20 #8 0x00007ff3690519da in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 58 (Thread 0x7ff3569f6cc0 (LWP 20864)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480001b4f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4b0, out=0x7ff35698cae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4fc, out=0x7ff35698cc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000081b0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 57 (Thread 0x7ff35689acc0 (LWP 20865)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480001b4f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4b0, out=0x7ff356830ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4fc, out=0x7ff356830c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000080d0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 56 (Thread 0x7ff3563cdcc0 (LWP 20866)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480001b4f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4b0, out=0x7ff356363ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4fc, out=0x7ff356363c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000d850) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 55 (Thread 0x7ff356342cc0 (LWP 20867)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480001b4f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4b0, out=0x7ff3562d8ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4fc, out=0x7ff3562d8c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380001be70) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 54 (Thread 0x7ff356234cc0 (LWP 20868)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480001b4f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4b0, out=0x7ff3561caae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4fc, out=0x7ff3561cac20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800030690) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 53 (Thread 0x7ff356198cc0 (LWP 20869)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480001b4f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4b0, out=0x7ff35612eae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4fc, out=0x7ff35612ec20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800007f10) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 52 (Thread 0x7ff3560fccc0 (LWP 20870)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480001b4f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4b0, out=0x7ff356092ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4fc, out=0x7ff356092c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800084af0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 51 (Thread 0x7ff354f73cc0 (LWP 20871)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480001b4f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4b0, out=0x7ff354f09ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4fc, out=0x7ff354f09c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380005af50) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 50 (Thread 0x7ff354ee8cc0 (LWP 20872)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480001b4f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4b0, out=0x7ff354e7eae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4fc, out=0x7ff354e7ec20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000c5f0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 49 (Thread 0x7ff354e5dcc0 (LWP 20873)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480001b4f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4b0, out=0x7ff354df3ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4fc, out=0x7ff354df3c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000ba90) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 48 (Thread 0x7ff354dd2cc0 (LWP 20874)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001678f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678b0, out=0x7ff354d68ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678fc, out=0x7ff354d68c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000bb70) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 47 (Thread 0x7ff354d47cc0 (LWP 20875)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001678f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678b0, out=0x7ff354cddae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678fc, out=0x7ff354cddc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000bc50) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 46 (Thread 0x7ff354a7fcc0 (LWP 20876)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001678f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678b0, out=0x7ff354a15ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678fc, out=0x7ff354a15c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000bd30) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 45 (Thread 0x7ff3549f4cc0 (LWP 20877)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001678f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678b0, out=0x7ff35498aae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678fc, out=0x7ff35498ac20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000be10) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 44 (Thread 0x7ff354969cc0 (LWP 20878)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001678f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678b0, out=0x7ff3548ffae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678fc, out=0x7ff3548ffc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000bef0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 43 (Thread 0x7ff3548decc0 (LWP 20879)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001678f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678b0, out=0x7ff354874ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678fc, out=0x7ff354874c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000bfd0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 42 (Thread 0x7ff354853cc0 (LWP 20880)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001678f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678b0, out=0x7ff3547e9ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678fc, out=0x7ff3547e9c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000af30) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 41 (Thread 0x7ff3547c8cc0 (LWP 20881)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001678f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678b0, out=0x7ff35475eae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678fc, out=0x7ff35475ec20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000a830) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 40 (Thread 0x7ff35473dcc0 (LWP 20882)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001678f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678b0, out=0x7ff3546d3ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678fc, out=0x7ff3546d3c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000a910) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 39 (Thread 0x7ff3546b2cc0 (LWP 20883)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001678f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678b0, out=0x7ff354648ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678fc, out=0x7ff354648c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800030930) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 38 (Thread 0x7ff354627cc0 (LWP 20884)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480007b1f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1b0, out=0x7ff3545bdae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1fc, out=0x7ff3545bdc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000b0f0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 37 (Thread 0x7ff35459ccc0 (LWP 20885)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480007b1f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1b0, out=0x7ff354532ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1fc, out=0x7ff354532c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000b1d0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 36 (Thread 0x7ff352ffecc0 (LWP 20886)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480007b1f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1b0, out=0x7ff352f94ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1fc, out=0x7ff352f94c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000b2b0) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 35 (Thread 0x7ff352f73cc0 (LWP 20887)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480007b1f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1b0, out=0x7ff352f09ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1fc, out=0x7ff352f09c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000b390) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 34 (Thread 0x7ff352ee8cc0 (LWP 20888)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480007b1f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1b0, out=0x7ff352e7eae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1fc, out=0x7ff352e7ec20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000b470) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 33 (Thread 0x7ff352e5dcc0 (LWP 20889)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480007b1f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1b0, out=0x7ff352df3ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1fc, out=0x7ff352df3c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000b550) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 32 (Thread 0x7ff352dd2cc0 (LWP 20890)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480007b1f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1b0, out=0x7ff352d68ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1fc, out=0x7ff352d68c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000b630) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 31 (Thread 0x7ff352d47cc0 (LWP 20891)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480007b1f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1b0, out=0x7ff352cddae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1fc, out=0x7ff352cddc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000b710) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 30 (Thread 0x7ff352b0acc0 (LWP 20892)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480007b1f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1b0, out=0x7ff352aa0ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1fc, out=0x7ff352aa0c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000a590) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 29 (Thread 0x7ff352a7fcc0 (LWP 20893)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480007b1f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1b0, out=0x7ff352a15ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1fc, out=0x7ff352a15c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800061d90) at /usr/include/boost/bind/bind_template.hpp:20 #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 28 (Thread 0x7ff3529f4cc0 (LWP 20894)): #0 0x00007ff36035cc7f in accept4 () from /lib64/libc.so.6 #1 0x00007ff36ae64f06 in __interceptor_accept4 () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:1335 #2 0x00007ff3621eb169 in kudu::Socket::Accept (this=0x7d140000f418, new_conn=0x7ff35298ac20, remote=0x7ff35298ac10, flags=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/net/socket.cc:257 #3 0x00007ff3631d8963 in kudu::rpc::AcceptorPool::RunThread (this=0x7d140000f410) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/acceptor_pool.cc:96 #4 0x00007ff3631dc2ae in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #5 0x00007ff3631dc21b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #6 0x00007ff3631dc1a4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000a9f0) at /usr/include/boost/bind/bind_template.hpp:20 #7 0x00007ff3631dbf4a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 27 (Thread 0x7ff352969cc0 (LWP 20895)): #0 0x00007ff360351293 in poll () from /lib64/libc.so.6 #1 0x00007ff36ae69c8d in __interceptor_poll () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:1992 #2 0x00007ff36786237e in master_thread () from /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/build/fastdebug/libserver_process.so #3 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #4 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #5 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 26 (Thread 0x7ff3528decc0 (LWP 20896)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d400002fcb8, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 #3 0x00007ff36a9cd11c in kudu::CountDownLatch::WaitFor (this=, delta=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:75 #4 0x00007ff36902f5b0 in kudu::tserver::Heartbeater::Thread::RunThread (this=0x7d400002fc00) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tserver/heartbeater.cc:344 #5 0x00007ff36903235e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #6 0x00007ff3690322cb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #7 0x00007ff369032254 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000aad0) at /usr/include/boost/bind/bind_template.hpp:20 #8 0x00007ff369031ffa in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 25 (Thread 0x7ff352853cc0 (LWP 20897)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 #2 0x00007ff3693f80c8 in boost::condition_variable::timed_wait (this=0x7d400002fb88, m=..., wait_until=) at /usr/include/boost/thread/pthread/condition_variable.hpp:27 #3 0x00007ff368bf35d8 in kudu::MaintenanceManager::RunSchedulerThread (this=0x7d400002fb00) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tablet/maintenance_manager.cc:185 #4 0x00007ff368bf933e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #5 0x00007ff368bf92ab in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #6 0x00007ff368bf9254 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000abb0) at /usr/include/boost/bind/bind_template.hpp:20 #7 0x00007ff368bf905a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 24 (Thread 0x7ff35273dcc0 (LWP 20899)): #0 0x00007ff3661d8d2d in nanosleep () from /lib64/libpthread.so.0 #1 0x00007ff36ae49a1c in __interceptor_nanosleep () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:254 #2 0x00007ff3693e667b in boost::detail::yield (k=) at /usr/include/boost/smart_ptr/detail/yield_k.hpp:123 #3 0x00007ff3693e6569 in kudu::rw_semaphore::lock (this=0x7d2c0005d740) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/rw_semaphore.h:98 #4 0x00007ff365542ec1 in kudu::client::KuduClient::Data::SetMasterServerProxyAsync (this=0x7d2c0005d6a0, client=0x0, cb=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/client/client-internal.cc:674 #5 0x00007ff365557c8a in kudu::client::internal::LookupRpc::ResetMasterLeaderAndRetry (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/client/meta_cache.cc:432 #6 0x00007ff36555800d in kudu::client::internal::LookupRpc::SendRpcCb (this=0x7d4000004400, status=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/client/meta_cache.cc:476 #7 0x00007ff363214283 in kudu::rpc::RpcRetrier::DelayedRetryCb (this=, rpc=0x7d4000004400, status=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/rpc.cc:69 #8 0x00007ff363214cbf in boost::_mfi::mf2::operator() (this=, p=, a1=0x7d4000004400, a2=...) at /usr/include/boost/bind/mem_fn_template.hpp:274 #9 0x00007ff363214c10 in boost::_bi::list3, boost::_bi::value, boost::arg<1> >::operator(), boost::_bi::list1 > (this=0x7d08000c71f0, f=, a=...) at /usr/include/boost/bind/bind.hpp:385 #10 0x00007ff363214b49 in boost::_bi::bind_t, boost::_bi::list3, boost::_bi::value, boost::arg<1> > >::operator() (this=0x7d08000c71e0, a1=) at /usr/include/boost/bind/bind_template.hpp:47 #11 0x00007ff363214929 in boost::detail::function::void_function_obj_invoker1, boost::_bi::list3, boost::_bi::value, boost::arg<1> > >, void, kudu::Status const&>::invoke (function_obj_ptr=..., a0=...) at /usr/include/boost/function/function_template.hpp:153 #12 0x00007ff36320c5ba in boost::function1::operator() (this=, a0=...) at /usr/include/boost/function/function_template.hpp:1012 #13 0x00007ff363209dca in kudu::rpc::DelayedTask::TimerHandler (this=0x7d2000026480, watcher=, revents=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:468 #14 0x00007ff36320f73b in ev::base::method_thunk (loop=, w=0x7d20000264c8, revents=982122496) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:479 #15 0x00007ff362b072bd in ev_invoke_pending (loop=0x7d640003b600) at ev.c:2994 #16 0x00007ff362b0bad2 in ev_run (loop=0x7d640003b600, flags=) at ev.c:3394 #17 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d4800203bc8, flags=0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 #18 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d4800203bc0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 #19 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #20 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #21 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000ac90) at /usr/include/boost/bind/bind_template.hpp:20 #22 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #23 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #24 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #25 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #26 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #27 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 23 (Thread 0x7ff35240fcc0 (LWP 20900)): #0 0x00007ff3661d8d2d in nanosleep () from /lib64/libpthread.so.0 #1 0x00007ff36ae49a1c in __interceptor_nanosleep () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:254 #2 0x00007ff3693e667b in boost::detail::yield (k=) at /usr/include/boost/smart_ptr/detail/yield_k.hpp:123 #3 0x00007ff3693e6569 in kudu::rw_semaphore::lock (this=0x7d2c0005d740) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/rw_semaphore.h:98 #4 0x00007ff365542ec1 in kudu::client::KuduClient::Data::SetMasterServerProxyAsync (this=0x7d2c0005d6a0, client=0x0, cb=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/client/client-internal.cc:674 #5 0x00007ff365557c8a in kudu::client::internal::LookupRpc::ResetMasterLeaderAndRetry (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/client/meta_cache.cc:432 #6 0x00007ff36555800d in kudu::client::internal::LookupRpc::SendRpcCb (this=0x7d4000006300, status=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/client/meta_cache.cc:476 #7 0x00007ff363214283 in kudu::rpc::RpcRetrier::DelayedRetryCb (this=, rpc=0x7d4000006300, status=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/rpc.cc:69 #8 0x00007ff363214cbf in boost::_mfi::mf2::operator() (this=, p=, a1=0x7d4000006300, a2=...) at /usr/include/boost/bind/mem_fn_template.hpp:274 #9 0x00007ff363214c10 in boost::_bi::list3, boost::_bi::value, boost::arg<1> >::operator(), boost::_bi::list1 > (this=0x7d0800014f90, f=, a=...) at /usr/include/boost/bind/bind.hpp:385 #10 0x00007ff363214b49 in boost::_bi::bind_t, boost::_bi::list3, boost::_bi::value, boost::arg<1> > >::operator() (this=0x7d0800014f80, a1=) at /usr/include/boost/bind/bind_template.hpp:47 #11 0x00007ff363214929 in boost::detail::function::void_function_obj_invoker1, boost::_bi::list3, boost::_bi::value, boost::arg<1> > >, void, kudu::Status const&>::invoke (function_obj_ptr=..., a0=...) at /usr/include/boost/function/function_template.hpp:153 #12 0x00007ff36320c5ba in boost::function1::operator() (this=, a0=...) at /usr/include/boost/function/function_template.hpp:1012 #13 0x00007ff363209dca in kudu::rpc::DelayedTask::TimerHandler (this=0x7d2000007380, watcher=, revents=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:468 #14 0x00007ff36320f73b in ev::base::method_thunk (loop=, w=0x7d20000073c8, revents=1016840192) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:479 #15 0x00007ff362b072bd in ev_invoke_pending (loop=0x7d6400251c00) at ev.c:2994 #16 0x00007ff362b0bad2 in ev_run (loop=0x7d6400251c00, flags=) at ev.c:3394 #17 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d4800002ec8, flags=0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 #18 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d4800002ec0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 #19 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #20 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #21 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000ad70) at /usr/include/boost/bind/bind_template.hpp:20 #22 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #23 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #24 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #25 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #26 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #27 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 22 (Thread 0x7ff352384cc0 (LWP 20901)): #0 0x00007ff3661d8d2d in nanosleep () from /lib64/libpthread.so.0 #1 0x00007ff36ae49a1c in __interceptor_nanosleep () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:254 #2 0x00007ff3693e667b in boost::detail::yield (k=) at /usr/include/boost/smart_ptr/detail/yield_k.hpp:123 #3 0x00007ff3693e6569 in kudu::rw_semaphore::lock (this=0x7d2c0005d740) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/rw_semaphore.h:98 #4 0x00007ff365542ec1 in kudu::client::KuduClient::Data::SetMasterServerProxyAsync (this=0x7d2c0005d6a0, client=0x0, cb=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/client/client-internal.cc:674 #5 0x00007ff365557c8a in kudu::client::internal::LookupRpc::ResetMasterLeaderAndRetry (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/client/meta_cache.cc:432 #6 0x00007ff36555800d in kudu::client::internal::LookupRpc::SendRpcCb (this=0x7d4000004a00, status=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/client/meta_cache.cc:476 #7 0x00007ff363214283 in kudu::rpc::RpcRetrier::DelayedRetryCb (this=, rpc=0x7d4000004a00, status=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/rpc.cc:69 #8 0x00007ff363214cbf in boost::_mfi::mf2::operator() (this=, p=, a1=0x7d4000004a00, a2=...) at /usr/include/boost/bind/mem_fn_template.hpp:274 #9 0x00007ff363214c10 in boost::_bi::list3, boost::_bi::value, boost::arg<1> >::operator(), boost::_bi::list1 > (this=0x7d0800000c10, f=, a=...) at /usr/include/boost/bind/bind.hpp:385 #10 0x00007ff363214b49 in boost::_bi::bind_t, boost::_bi::list3, boost::_bi::value, boost::arg<1> > >::operator() (this=0x7d0800000c00, a1=) at /usr/include/boost/bind/bind_template.hpp:47 #11 0x00007ff363214929 in boost::detail::function::void_function_obj_invoker1, boost::_bi::list3, boost::_bi::value, boost::arg<1> > >, void, kudu::Status const&>::invoke (function_obj_ptr=..., a0=...) at /usr/include/boost/function/function_template.hpp:153 #12 0x00007ff36320c5ba in boost::function1::operator() (this=, a0=...) at /usr/include/boost/function/function_template.hpp:1012 #13 0x00007ff363209dca in kudu::rpc::DelayedTask::TimerHandler (this=0x7d2000009700, watcher=, revents=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:468 #14 0x00007ff36320f73b in ev::base::method_thunk (loop=, w=0x7d2000009748, revents=1051557888) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:479 #15 0x00007ff362b072bd in ev_invoke_pending (loop=0x7d64001f4500) at ev.c:2994 #16 0x00007ff362b0bad2 in ev_run (loop=0x7d64001f4500, flags=) at ev.c:3394 #17 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d480003a3c8, flags=0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 #18 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d480003a3c0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 #19 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #20 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #21 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000ae50) at /usr/include/boost/bind/bind_template.hpp:20 #22 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #23 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #24 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #25 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #26 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #27 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 21 (Thread 0x7ff350f33cc0 (LWP 20902)): #0 0x00007ff3661d8d2d in nanosleep () from /lib64/libpthread.so.0 #1 0x00007ff36ae49a1c in __interceptor_nanosleep () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:254 #2 0x00007ff3693e667b in boost::detail::yield (k=) at /usr/include/boost/smart_ptr/detail/yield_k.hpp:123 #3 0x00007ff3693e6569 in kudu::rw_semaphore::lock (this=0x7d2c0005d740) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/rw_semaphore.h:98 #4 0x00007ff365542ec1 in kudu::client::KuduClient::Data::SetMasterServerProxyAsync (this=0x7d2c0005d6a0, client=0x0, cb=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/client/client-internal.cc:674 #5 0x00007ff365557c8a in kudu::client::internal::LookupRpc::ResetMasterLeaderAndRetry (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/client/meta_cache.cc:432 #6 0x00007ff36555800d in kudu::client::internal::LookupRpc::SendRpcCb (this=0x7d4000006000, status=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/client/meta_cache.cc:476 #7 0x00007ff363214283 in kudu::rpc::RpcRetrier::DelayedRetryCb (this=, rpc=0x7d4000006000, status=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/rpc.cc:69 #8 0x00007ff363214cbf in boost::_mfi::mf2::operator() (this=, p=, a1=0x7d4000006000, a2=...) at /usr/include/boost/bind/mem_fn_template.hpp:274 #9 0x00007ff363214c10 in boost::_bi::list3, boost::_bi::value, boost::arg<1> >::operator(), boost::_bi::list1 > (this=0x7d080007a290, f=, a=...) at /usr/include/boost/bind/bind.hpp:385 #10 0x00007ff363214b49 in boost::_bi::bind_t, boost::_bi::list3, boost::_bi::value, boost::arg<1> > >::operator() (this=0x7d080007a280, a1=) at /usr/include/boost/bind/bind_template.hpp:47 #11 0x00007ff363214929 in boost::detail::function::void_function_obj_invoker1, boost::_bi::list3, boost::_bi::value, boost::arg<1> > >, void, kudu::Status const&>::invoke (function_obj_ptr=..., a0=...) at /usr/include/boost/function/function_template.hpp:153 #12 0x00007ff36320c5ba in boost::function1::operator() (this=, a0=...) at /usr/include/boost/function/function_template.hpp:1012 #13 0x00007ff363209dca in kudu::rpc::DelayedTask::TimerHandler (this=0x7d2000008200, watcher=, revents=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:468 #14 0x00007ff36320f73b in ev::base::method_thunk (loop=, w=0x7d2000008248, revents=1086275584) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:479 #15 0x00007ff362b072bd in ev_invoke_pending (loop=0x7d640019d700) at ev.c:2994 #16 0x00007ff362b0bad2 in ev_run (loop=0x7d640019d700, flags=) at ev.c:3394 #17 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d480003a248, flags=0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 #18 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d480003a240) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 #19 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #20 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #21 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000c0b0) at /usr/include/boost/bind/bind_template.hpp:20 #22 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #23 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #24 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #25 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #26 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #27 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 20 (Thread 0x7ff34c10fcc0 (LWP 20934)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d600009ade8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff368439687 in kudu::BlockingQueue::BlockingDrainTo (this=0x7d600009ada0, out=0x7ff34c0a5c10) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:108 #4 0x00007ff368431107 in kudu::log::Log::AppendThread::RunThread (this=0x7d1000155dc0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/consensus/log.cc:99 #5 0x00007ff36844527e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #6 0x00007ff3684451eb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #7 0x00007ff368445194 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800005190) at /usr/include/boost/bind/bind_template.hpp:20 #8 0x00007ff368444f9a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 19 (Thread 0x7ff350438cc0 (LWP 20939)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d600006a5e8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff368439687 in kudu::BlockingQueue::BlockingDrainTo (this=0x7d600006a5a0, out=0x7ff3503cec10) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:108 #4 0x00007ff368431107 in kudu::log::Log::AppendThread::RunThread (this=0x7d10000c6b40) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/consensus/log.cc:99 #5 0x00007ff36844527e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #6 0x00007ff3684451eb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #7 0x00007ff368445194 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000de70) at /usr/include/boost/bind/bind_template.hpp:20 #8 0x00007ff368444f9a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 18 (Thread 0x7ff3502a1cc0 (LWP 20944)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d600005ede8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff368439687 in kudu::BlockingQueue::BlockingDrainTo (this=0x7d600005eda0, out=0x7ff350237c10) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:108 #4 0x00007ff368431107 in kudu::log::Log::AppendThread::RunThread (this=0x7d100013fd00) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/consensus/log.cc:99 #5 0x00007ff36844527e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #6 0x00007ff3684451eb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #7 0x00007ff368445194 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380001b770) at /usr/include/boost/bind/bind_template.hpp:20 #8 0x00007ff368444f9a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 17 (Thread 0x7ff350a23cc0 (LWP 20954)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d60000ffde8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff368439687 in kudu::BlockingQueue::BlockingDrainTo (this=0x7d60000ffda0, out=0x7ff3509b9c10) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:108 #4 0x00007ff368431107 in kudu::log::Log::AppendThread::RunThread (this=0x7d100005a400) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/consensus/log.cc:99 #5 0x00007ff36844527e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #6 0x00007ff3684451eb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #7 0x00007ff368445194 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800014af0) at /usr/include/boost/bind/bind_template.hpp:20 #8 0x00007ff368444f9a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 16 (Thread 0x7ff34ed89cc0 (LWP 20966)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d600009c9e8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff368439687 in kudu::BlockingQueue::BlockingDrainTo (this=0x7d600009c9a0, out=0x7ff34ed1fc10) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:108 #4 0x00007ff368431107 in kudu::log::Log::AppendThread::RunThread (this=0x7d10000c6e00) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/consensus/log.cc:99 #5 0x00007ff36844527e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #6 0x00007ff3684451eb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #7 0x00007ff368445194 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800084a10) at /usr/include/boost/bind/bind_template.hpp:20 #8 0x00007ff368444f9a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 15 (Thread 0x7ff350bc5cc0 (LWP 20967)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d600001e9e8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff368439687 in kudu::BlockingQueue::BlockingDrainTo (this=0x7d600001e9a0, out=0x7ff350b5bc10) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:108 #4 0x00007ff368431107 in kudu::log::Log::AppendThread::RunThread (this=0x7d100014a4c0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/consensus/log.cc:99 #5 0x00007ff36844527e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #6 0x00007ff3684451eb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #7 0x00007ff368445194 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800030cb0) at /usr/include/boost/bind/bind_template.hpp:20 #8 0x00007ff368444f9a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 14 (Thread 0x7ff34ebe8cc0 (LWP 20977)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d600000fde8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff368439687 in kudu::BlockingQueue::BlockingDrainTo (this=0x7d600000fda0, out=0x7ff34eb7ec10) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:108 #4 0x00007ff368431107 in kudu::log::Log::AppendThread::RunThread (this=0x7d10000dc700) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/consensus/log.cc:99 #5 0x00007ff36844527e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #6 0x00007ff3684451eb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #7 0x00007ff368445194 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800005270) at /usr/include/boost/bind/bind_template.hpp:20 #8 0x00007ff368444f9a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 13 (Thread 0x7ff34e9f0cc0 (LWP 20992)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d30000fb768, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 #3 0x00007ff36a9cd11c in kudu::CountDownLatch::WaitFor (this=, delta=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:75 #4 0x00007ff3621f88cb in kudu::ResettableHeartbeaterThread::RunThread (this=0x7d30000fb700) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/resettable_heartbeater.cc:90 #5 0x00007ff3621f96ae in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #6 0x00007ff3621f961b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #7 0x00007ff3621f95c4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800029310) at /usr/include/boost/bind/bind_template.hpp:20 #8 0x00007ff3621f93ca in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 12 (Thread 0x7ff34e965cc0 (LWP 20993)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d600006b5e8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff368439687 in kudu::BlockingQueue::BlockingDrainTo (this=0x7d600006b5a0, out=0x7ff34e8fbc10) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:108 #4 0x00007ff368431107 in kudu::log::Log::AppendThread::RunThread (this=0x7d10000716c0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/consensus/log.cc:99 #5 0x00007ff36844527e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #6 0x00007ff3684451eb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #7 0x00007ff368445194 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000a3d0) at /usr/include/boost/bind/bind_template.hpp:20 #8 0x00007ff368444f9a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 11 (Thread 0x7ff3504c3cc0 (LWP 20995)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d30000fb6a8, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 #3 0x00007ff36a9cd11c in kudu::CountDownLatch::WaitFor (this=, delta=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:75 #4 0x00007ff3621f88cb in kudu::ResettableHeartbeaterThread::RunThread (this=0x7d30000fb640) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/resettable_heartbeater.cc:90 #5 0x00007ff3621f96ae in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #6 0x00007ff3621f961b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #7 0x00007ff3621f95c4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000293f0) at /usr/include/boost/bind/bind_template.hpp:20 #8 0x00007ff3621f93ca in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 10 (Thread 0x7ff34e7c4cc0 (LWP 20998)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d3000065ca8, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 #3 0x00007ff36a9cd11c in kudu::CountDownLatch::WaitFor (this=, delta=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:75 #4 0x00007ff3621f88cb in kudu::ResettableHeartbeaterThread::RunThread (this=0x7d3000065c40) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/resettable_heartbeater.cc:90 #5 0x00007ff3621f96ae in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #6 0x00007ff3621f961b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #7 0x00007ff3621f95c4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380008be70) at /usr/include/boost/bind/bind_template.hpp:20 #8 0x00007ff3621f93ca in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 9 (Thread 0x7ff34e739cc0 (LWP 20999)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d600005d1e8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff368439687 in kudu::BlockingQueue::BlockingDrainTo (this=0x7d600005d1a0, out=0x7ff34e6cfc10) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:108 #4 0x00007ff368431107 in kudu::log::Log::AppendThread::RunThread (this=0x7d10000a4f40) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/consensus/log.cc:99 #5 0x00007ff36844527e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #6 0x00007ff3684451eb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #7 0x00007ff368445194 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380003ef50) at /usr/include/boost/bind/bind_template.hpp:20 #8 0x00007ff368444f9a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 8 (Thread 0x7ff34e623cc0 (LWP 21002)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d3000065be8, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 #3 0x00007ff36a9cd11c in kudu::CountDownLatch::WaitFor (this=, delta=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:75 #4 0x00007ff3621f88cb in kudu::ResettableHeartbeaterThread::RunThread (this=0x7d3000065b80) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/resettable_heartbeater.cc:90 #5 0x00007ff3621f96ae in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #6 0x00007ff3621f961b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #7 0x00007ff3621f95c4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800084850) at /usr/include/boost/bind/bind_template.hpp:20 #8 0x00007ff3621f93ca in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 7 (Thread 0x7ff34e48dcc0 (LWP 21005)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d300006b168, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 #3 0x00007ff36a9cd11c in kudu::CountDownLatch::WaitFor (this=, delta=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:75 #4 0x00007ff3621f88cb in kudu::ResettableHeartbeaterThread::RunThread (this=0x7d300006b100) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/resettable_heartbeater.cc:90 #5 0x00007ff3621f96ae in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #6 0x00007ff3621f961b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #7 0x00007ff3621f95c4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000a670) at /usr/include/boost/bind/bind_template.hpp:20 #8 0x00007ff3621f93ca in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 6 (Thread 0x7ff34e402cc0 (LWP 21006)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d300006b0a8, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 #3 0x00007ff36a9cd11c in kudu::CountDownLatch::WaitFor (this=, delta=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:75 #4 0x00007ff3621f88cb in kudu::ResettableHeartbeaterThread::RunThread (this=0x7d300006b040) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/resettable_heartbeater.cc:90 #5 0x00007ff3621f96ae in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 #6 0x00007ff3621f961b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 #7 0x00007ff3621f95c4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000c190) at /usr/include/boost/bind/bind_template.hpp:20 #8 0x00007ff3621f93ca in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 5 (Thread 0x7ff34e377cc0 (LWP 27036)): #0 0x00007ff3661d909d in waitpid () from /lib64/libpthread.so.0 #1 0x00007ff36ae6250a in __interceptor_waitpid () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:969 #2 0x00007ff3621fe76c in kudu::Subprocess::DoWait (this=0x7ff34e30da80, ret=0x7ff34e30da3c, options=0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/subprocess.cc:285 #3 0x00007ff36a54d0dc in kudu::Subprocess::Wait (this=0x7ff34e30da3c, ret=0x0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/subprocess.h:58 #4 0x00007ff3621aae8c in kudu::PstackWatcher::RunStackDump (prog=, argv=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/pstack_watcher.cc:159 #5 0x00007ff3621aaacb in kudu::PstackWatcher::RunGdbStackDump (pid=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/pstack_watcher.cc:136 #6 0x00007ff3621aa604 in kudu::PstackWatcher::DumpStacks (pid=18449) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/pstack_watcher.cc:101 #7 0x00007ff3621aa161 in kudu::PstackWatcher::DumpStacks () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/pstack_watcher.cc:94 #8 0x00007ff36a306e80 in KillTestOnTimeout (sigval=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/test_main.cc:58 #9 0x00007ff360daa2ac in timer_sigev_thread () from /lib64/librt.so.1 #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 4 (Thread 0x7ff352116cc0 (LWP 27042)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d44001e4a98, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 #3 0x00007ff3622143b3 in kudu::ThreadPool::DispatchThread (this=0x7d44001e49c0, permanent=false) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/threadpool.cc:242 #4 0x00007ff362215ce6 in boost::_mfi::mf1::operator() (this=, p=, a1=false) at /usr/include/boost/bind/mem_fn_template.hpp:162 #5 0x00007ff362215c4c in boost::_bi::list2, boost::_bi::value >::operator(), boost::_bi::list0> (this=0x7d0800057e70, f=, a=...) at /usr/include/boost/bind/bind.hpp:306 #6 0x00007ff362215bd4 in boost::_bi::bind_t, boost::_bi::list2, boost::_bi::value > >::operator() (this=0x7d0800057e60) at /usr/include/boost/bind/bind_template.hpp:20 #7 0x00007ff3622159d2 in boost::detail::function::void_function_obj_invoker0, boost::_bi::list2, boost::_bi::value > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 3 (Thread 0x7ff34e6aecc0 (LWP 27043)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d4400163858, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 #3 0x00007ff3622143b3 in kudu::ThreadPool::DispatchThread (this=0x7d4400163780, permanent=false) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/threadpool.cc:242 #4 0x00007ff362215ce6 in boost::_mfi::mf1::operator() (this=, p=, a1=false) at /usr/include/boost/bind/mem_fn_template.hpp:162 #5 0x00007ff362215c4c in boost::_bi::list2, boost::_bi::value >::operator(), boost::_bi::list0> (this=0x7d0800022750, f=, a=...) at /usr/include/boost/bind/bind.hpp:306 #6 0x00007ff362215bd4 in boost::_bi::bind_t, boost::_bi::list2, boost::_bi::value > >::operator() (this=0x7d0800022740) at /usr/include/boost/bind/bind_template.hpp:20 #7 0x00007ff3622159d2 in boost::detail::function::void_function_obj_invoker0, boost::_bi::list2, boost::_bi::value > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 2 (Thread 0x7ff34e518cc0 (LWP 27044)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d4400109498, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 #3 0x00007ff3622143b3 in kudu::ThreadPool::DispatchThread (this=0x7d44001093c0, permanent=false) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/threadpool.cc:242 #4 0x00007ff362215ce6 in boost::_mfi::mf1::operator() (this=, p=, a1=false) at /usr/include/boost/bind/mem_fn_template.hpp:162 #5 0x00007ff362215c4c in boost::_bi::list2, boost::_bi::value >::operator(), boost::_bi::list0> (this=0x7d08000ab650, f=, a=...) at /usr/include/boost/bind/bind.hpp:306 #6 0x00007ff362215bd4 in boost::_bi::bind_t, boost::_bi::list2, boost::_bi::value > >::operator() (this=0x7d08000ab640) at /usr/include/boost/bind/bind_template.hpp:20 #7 0x00007ff3622159d2 in boost::detail::function::void_function_obj_invoker0, boost::_bi::list2, boost::_bi::value > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 Thread 1 (Thread 0x7ff36ade1cc0 (LWP 18449)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7fffc6ff9340) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 #3 0x00007ff36a553806 in kudu::CountDownLatch::Wait (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:59 #4 0x00007ff36a54c9ff in kudu::Synchronizer::Wait (this=0x7fffc6ff9308) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/async_util.h:39 #5 0x00007ff3655309a7 in kudu::client::KuduSession::Flush (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/client/client.cc:407 #6 0x00007ff36aeb4d30 in kudu::tools::RemoteKsckTest::GenerateRowWrites (this=, num_rows=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tools/ksck_remote-test.cc:109 #7 0x00007ff36aeb32ec in kudu::tools::RemoteKsckTest_TestChecksum_Test::TestBody (this=0x7d280000dc00) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tools/ksck_remote-test.cc:152 #8 0x00007ff360fec62d in HandleSehExceptionsInMethodIfSupported (object=0x7d280000dc00, method=&virtual testing::Test::TestBody(), location=0x7ff360ff7cf3 "the test body") at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/gmock-1.7.0/gtest/src/gtest.cc:2078 #9 testing::internal::HandleExceptionsInMethodIfSupported (object=0x7d280000dc00, method=&virtual testing::Test::TestBody(), location=0x7ff360ff7cf3 "the test body") at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/gmock-1.7.0/gtest/src/gtest.cc:2114 #10 0x00007ff360fddf21 in testing::Test::Run (this=0x7d280000dc00) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/gmock-1.7.0/gtest/src/gtest.cc:2151 #11 0x00007ff360fde007 in testing::TestInfo::Run (this=0x7d2c0000ac90) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/gmock-1.7.0/gtest/src/gtest.cc:2326 #12 0x00007ff360fde147 in testing::TestCase::Run (this=0x7d380000df20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/gmock-1.7.0/gtest/src/gtest.cc:2444 #13 0x00007ff360fe244f in testing::internal::UnitTestImpl::RunAllTests (this=0x7d500000fc00) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/gmock-1.7.0/gtest/src/gtest.cc:4315 #14 0x00007ff360fec1bd in HandleSehExceptionsInMethodIfSupported (object=0x7d500000fc00, method=(bool (testing::internal::UnitTestImpl::*)(testing::internal::UnitTestImpl *)) 0x7ff360fe2170 , location=0x7ff360ff8fe8 "auxiliary test code (environments or event listeners)") at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/gmock-1.7.0/gtest/src/gtest.cc:2078 #15 testing::internal::HandleExceptionsInMethodIfSupported (object=0x7d500000fc00, method=(bool (testing::internal::UnitTestImpl::*)(testing::internal::UnitTestImpl *)) 0x7ff360fe2170 , location=0x7ff360ff8fe8 "auxiliary test code (environments or event listeners)") at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/gmock-1.7.0/gtest/src/gtest.cc:2114 #16 0x00007ff360fdd5af in testing::UnitTest::Run (this=0x7ff36120bae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/gmock-1.7.0/gtest/src/gtest.cc:3929 #17 0x00007ff36a30732c in RUN_ALL_TESTS () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/gmock-1.7.0/gtest/include/gtest/gtest.h:2288 #18 0x00007ff36a306b72 in main (argc=1, argv=0x7fffc6ff9a38) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/test_main.cc:34 #19 0x00007ff360290cdd in __libc_start_main () from /lib64/libc.so.6 #20 0x00007ff36aeb28a9 in _start () Thread 178 (Thread 0x7ff35ec3c700 (LWP 18502)): #0 0x00007ff36031ebcd in nanosleep () from /lib64/libc.so.6 No symbol table info available. #1 0x00007ff36031ea40 in sleep () from /lib64/libc.so.6 No symbol table info available. #2 0x00007ff36ae49489 in __interceptor_sleep () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:239 No locals. #3 0x00007ff36ae9ab13 in BackgroundThread () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_rtl.cc:138 No locals. #4 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #5 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 177 (Thread 0x7ff36acc2cc0 (LWP 18511)): #0 0x00007ff360daa19a in timer_helper_thread () from /lib64/librt.so.1 No symbol table info available. #1 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #2 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #3 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 176 (Thread 0x7ff35a1aecc0 (LWP 18790)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 No locals. #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d300001dfb0, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 relative_time = { tv_sec = 0, tv_nsec = 200000000 } absolute_time = { tv_sec = 9076, tv_nsec = 812998565 } now = { tv_sec = 9076, tv_nsec = 612998565 } nsecs = _result = rv = #3 0x00007ff36a9cd11c in kudu::CountDownLatch::WaitFor (this=, delta=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:75 lock = { lock_ = 0x7d300001df80, owned_ = true } #4 0x00007ff3621b3513 in kudu::KernelStackWatchdog::RunThread (this=0x7d300001df40) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/kernel_stack_watchdog.cc:58 pids = std::tr1::unordered_map with 0 elements delta = { static kUninitialized = -9223372036854775808, nano_delta_ = 200000000 } #5 0x00007ff3621b5bee in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #6 0x00007ff3621b5b5b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #7 0x00007ff3621b5b04 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380001bf50) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #8 0x00007ff3621b590a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380001bf20, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "kernel-watcher-140683165494464" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380001bf20 } system_tid = loop_count = #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 175 (Thread 0x7ff34ea7bcc0 (LWP 20730)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 No locals. #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d6400263900, timeout=) at ev_epoll.c:153 i = eventcnt = #3 0x00007ff362b0b5da in ev_run (loop=0x7d6400263900, flags=) at ev.c:3360 waittime = sleeptime = prev_mn_now = 9076.7215600239997 __PRETTY_FUNCTION__ = "ev_run" #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d480003a6c8, flags=5376) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 No locals. #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d480003a6c0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800003050) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800003020, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc reactor-140682973396160" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800003020 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 174 (Thread 0x7ff350de7cc0 (LWP 20731)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 No locals. #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d6400263e00, timeout=) at ev_epoll.c:153 i = eventcnt = #3 0x00007ff362b0b5da in ev_run (loop=0x7d6400263e00, flags=) at ev.c:3360 waittime = sleeptime = prev_mn_now = 9076.7137075589999 __PRETTY_FUNCTION__ = "ev_run" #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d480001f548, flags=4608) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 No locals. #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d480001f540) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800003130) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800003100, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc reactor-140683010538688" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800003100 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 173 (Thread 0x7ff34e8dacc0 (LWP 20732)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 No locals. #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d6400264800, timeout=) at ev_epoll.c:153 i = eventcnt = #3 0x00007ff362b0b5da in ev_run (loop=0x7d6400264800, flags=) at ev.c:3360 waittime = sleeptime = prev_mn_now = 9076.714325813 __PRETTY_FUNCTION__ = "ev_run" #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d480003a848, flags=3840) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 No locals. #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d480003a840) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800003210) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d38000031e0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc reactor-140682971688128" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d38000031e0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 172 (Thread 0x7ff350aaecc0 (LWP 20733)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 No locals. #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d6400264d00, timeout=) at ev_epoll.c:153 i = eventcnt = #3 0x00007ff362b0b5da in ev_run (loop=0x7d6400264d00, flags=) at ev.c:3360 waittime = sleeptime = prev_mn_now = 9076.7135339809993 __PRETTY_FUNCTION__ = "ev_run" #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d48000088c8, flags=0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 No locals. #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d48000088c0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000032f0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d38000032c0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc reactor-140683007159488" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d38000032c0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 171 (Thread 0x7ff35088dcc0 (LWP 20734)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48000229f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229b0, out=0x7ff350823ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48000229c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229fc, out=0x7ff350823c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20734, counter_ = 2, asserter_ = 0x7d0400035720 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000033d0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d38000033a0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683004927168" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d38000033a0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 170 (Thread 0x7ff35249acc0 (LWP 20735)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48000229f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229b0, out=0x7ff352430ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48000229c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229fc, out=0x7ff352430c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20735, counter_ = 2, asserter_ = 0x7d040001cdf0 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000034b0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800003480, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683034340544" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800003480 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 169 (Thread 0x7ff34e09ccc0 (LWP 20736)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48000229f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229b0, out=0x7ff34e032ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48000229c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229fc, out=0x7ff34e032c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20736, counter_ = 2, asserter_ = 0x7d040004efa0 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800003590) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800003560, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140682963045568" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800003560 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 168 (Thread 0x7ff34e127cc0 (LWP 20737)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48000229f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229b0, out=0x7ff34e0bdae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48000229c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229fc, out=0x7ff34e0bdc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20737, counter_ = 2, asserter_ = 0x7d040002f360 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800003670) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800003640, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140682963614912" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800003640 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 167 (Thread 0x7ff34ca8acc0 (LWP 20738)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48000229f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229b0, out=0x7ff34ca20ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48000229c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229fc, out=0x7ff34ca20c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20738, counter_ = 2, asserter_ = 0x7d04000322c0 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800004550) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800004520, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140682939903168" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800004520 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 166 (Thread 0x7ff352525cc0 (LWP 20739)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48000229f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229b0, out=0x7ff3524bbae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48000229c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229fc, out=0x7ff3524bbc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20739, counter_ = 2, asserter_ = 0x7d040000a000 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800004390) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800004360, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683034909888" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800004360 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 165 (Thread 0x7ff34e23dcc0 (LWP 20740)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48000229f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229b0, out=0x7ff34e1d3ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48000229c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229fc, out=0x7ff34e1d3c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20740, counter_ = 2, asserter_ = 0x7d0400025dd0 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800003e50) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800003e20, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140682964753600" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800003e20 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 164 (Thread 0x7ff34cffecc0 (LWP 20741)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48000229f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229b0, out=0x7ff34cf94ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48000229c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229fc, out=0x7ff34cf94c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20741, counter_ = 2, asserter_ = 0x7d0400012ff0 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000040f0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d38000040c0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140682945621184" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d38000040c0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 163 (Thread 0x7ff350998cc0 (LWP 20742)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48000229f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229b0, out=0x7ff35092eae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48000229c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229fc, out=0x7ff35092ec20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20742, counter_ = 2, asserter_ = 0x7d0400009a20 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800004010) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800003fe0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683006020800" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800003fe0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 162 (Thread 0x7ff3525b0cc0 (LWP 20743)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48000229f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229b0, out=0x7ff352546ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48000229c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48000229fc, out=0x7ff352546c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20743, counter_ = 2, asserter_ = 0x7d0400009920 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800003f30) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800003f00, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683035479232" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800003f00 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 161 (Thread 0x7ff35263bcc0 (LWP 20744)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480003ae78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae30, out=0x7ff3525d1ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480003ae48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae7c, out=0x7ff3525d1c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d38000041b0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000041d0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d38000041a0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683036048576" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d38000041a0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 160 (Thread 0x7ff34cf73cc0 (LWP 20745)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480003ae78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae30, out=0x7ff34cf09ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480003ae48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae7c, out=0x7ff34cf09c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d38000046f0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800004710) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d38000046e0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140682945051840" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d38000046e0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 159 (Thread 0x7ff34c451cc0 (LWP 20746)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480003ae78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae30, out=0x7ff34c3e7ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480003ae48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae7c, out=0x7ff34c3e7c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380000d2f0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000d310) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000d2e0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140682933378240" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000d2e0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 158 (Thread 0x7ff34c19acc0 (LWP 20747)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480003ae78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae30, out=0x7ff34c130ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480003ae48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae7c, out=0x7ff34c130c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380000d3d0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000d3f0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000d3c0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140682930531520" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000d3c0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 157 (Thread 0x7ff3506f7cc0 (LWP 20748)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480003ae78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae30, out=0x7ff35068dae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480003ae48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae7c, out=0x7ff35068dc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380000d4b0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000d4d0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000d4a0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683003264192" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000d4a0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 156 (Thread 0x7ff35c2dbcc0 (LWP 20749)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480003ae78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae30, out=0x7ff35c271ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480003ae48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae7c, out=0x7ff35c271c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380000d590 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000d5b0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000d580, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683200281792" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000d580 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 155 (Thread 0x7ff35c5e2cc0 (LWP 20750)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480003ae78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae30, out=0x7ff35c578ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480003ae48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae7c, out=0x7ff35c578c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380000d670 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000d690) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000d660, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683203456192" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000d660 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 154 (Thread 0x7ff350095cc0 (LWP 20751)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480003ae78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae30, out=0x7ff35002bae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480003ae48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae7c, out=0x7ff35002bc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380000d750 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000d770) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000d740, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140682996571328" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000d740 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 153 (Thread 0x7ff34c7d3cc0 (LWP 20752)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480003ae78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae30, out=0x7ff34c769ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480003ae48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae7c, out=0x7ff34c769c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800084d70 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800084d90) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800084d60, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140682937056448" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800084d60 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 152 (Thread 0x7ff34cbb1cc0 (LWP 20753)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480003ae78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae30, out=0x7ff34cb47ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480003ae48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480003ae7c, out=0x7ff34cb47c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800084bb0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800084bd0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800084ba0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140682941111488" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800084ba0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 151 (Thread 0x7ff3521a1cc0 (LWP 20754)): #0 0x00007ff36035cc7f in accept4 () from /lib64/libc.so.6 No symbol table info available. #1 0x00007ff36ae64f06 in __interceptor_accept4 () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:1335 No locals. #2 0x00007ff3621eb169 in kudu::Socket::Accept (this=0x7d140007d378, new_conn=0x7ff352137c20, remote=0x7ff352137c10, flags=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/net/socket.cc:257 addr = { sin_family = 64083, sin_port = 25378, sin_addr = { s_addr = 32755 }, sin_zero = "\020|\023R\363\177\000" } olen = 16 _result = #3 0x00007ff3631d8963 in kudu::rpc::AcceptorPool::RunThread (this=0x7d140007d370) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/acceptor_pool.cc:96 new_sock = { static FLAG_NONBLOCKING = 1, fd_ = -1 } remote = { addr_ = { sin_family = 2, sin_port = 0, sin_addr = { s_addr = 0 }, sin_zero = "\000\000\000\000\000\000\000" } } s = { state_ = 0x0 } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #4 0x00007ff3631dc2ae in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #5 0x00007ff3631dc21b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #6 0x00007ff3631dc1a4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800004fd0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #7 0x00007ff3631dbf4a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800004fa0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "acceptor-140683031223488" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800004fa0 } system_tid = loop_count = #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 150 (Thread 0x7ff350182cc0 (LWP 20755)): #0 0x00007ff360351293 in poll () from /lib64/libc.so.6 No symbol table info available. #1 0x00007ff36ae69c8d in __interceptor_poll () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:1992 No locals. #2 0x00007ff36786237e in master_thread () from /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/build/fastdebug/libserver_process.so No symbol table info available. #3 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #4 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #5 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 149 (Thread 0x7ff34c2b0cc0 (LWP 20758)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d60000685e8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff368439687 in kudu::BlockingQueue::BlockingDrainTo (this=0x7d60000685a0, out=0x7ff34c246c10) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:108 l = { lock_ = 0x7d60000685b8, owned_ = true } #4 0x00007ff368431107 in kudu::log::Log::AppendThread::RunThread (this=0x7d10000831c0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/consensus/log.cc:99 entry_batches = std::vector of length 0, capacity 0 d = { deleter_ = 0x7d0400001450 } group_commit_latency_metric = { latency_hist_ = 0x7d0800086ae0, time_started_ = { static kNanosecondsPerSecond = 1000000000, static kNanosecondsPerMillisecond = 1000000, static kNanosecondsPerMicrosecond = 1000, static kMicrosecondsPerSecond = 1000000, nanos_ = 8183750479524 } } s = { state_ = 0x0 } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 queue = 0x7d60000685a0 #5 0x00007ff36844527e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #6 0x00007ff3684451eb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #7 0x00007ff368445194 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800003bb0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #8 0x00007ff368444f9a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800003b80, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "appender-140682931670208" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800003b80 } system_tid = loop_count = #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 148 (Thread 0x7ff34c225cc0 (LWP 20762)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 No locals. #2 0x00007ff3693f80c8 in boost::condition_variable::timed_wait (this=0x7d1c0008e790, m=..., wait_until=) at /usr/include/boost/thread/pthread/condition_variable.hpp:27 check_for_interruption = { thread_info = 0x0 } timeout = { tv_sec = 1424409478, tv_nsec = 371791000 } #3 0x00007ff3693c5054 in kudu::master::CatalogManagerBgTasks::Wait (this=, msec=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/master/catalog_manager.cc:222 wtime = { > >> = { , boost::detail::false_t>, boost::detail::empty_base, boost::detail::true_t>> = { , boost::detail::false_t> >> = { , boost::detail::false_t>> = { >> = { > = {}, }, }, }, }, members of boost::date_time::base_time > >: time_ = { time_count_ = { value_ = 212291212678371791 } } }, } lock = { m = 0x7d1c0008e768, is_locked = true } #4 0x00007ff3693b32a8 in kudu::master::CatalogManagerBgTasks::Run (this=0x7d1c0008e760) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/master/catalog_manager.cc:301 to_delete = std::vector of length 0, capacity 0 to_process = std::vector of length 0, capacity 0 vlocal__ = 0x7ff36a0e4330 vlocal__ = 0x7ff36a0f4480 #5 0x00007ff3693e791e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #6 0x00007ff3693e788b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #7 0x00007ff3693e7814 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800003d70) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #8 0x00007ff3693e75ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800003d40, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "bgtasks-140682931100864" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800003d40 } system_tid = loop_count = #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 147 (Thread 0x7ff34c85ecc0 (LWP 20763)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d44000ba898) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff3622142a6 in kudu::ThreadPool::DispatchThread (this=0x7d44000ba7c0, permanent=true) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/threadpool.cc:240 entry = { runnable = std::tr1::shared_ptr (count 1952539695) 0x7d1000093fa8, trace = 0x0 } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x7ff34c7f4bf8 }, old_trace_ = 0x7ff34c7f4bfc } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 unique_lock = { lock_ = 0x7d44000ba7e8, owned_ = true } #4 0x00007ff362215ce6 in boost::_mfi::mf1::operator() (this=, p=, a1=true) at /usr/include/boost/bind/mem_fn_template.hpp:162 No locals. #5 0x00007ff362215c4c in boost::_bi::list2, boost::_bi::value >::operator(), boost::_bi::list0> (this=0x7d08000637d0, f=, a=...) at /usr/include/boost/bind/bind.hpp:306 No locals. #6 0x00007ff362215bd4 in boost::_bi::bind_t, boost::_bi::list2, boost::_bi::value > >::operator() (this=0x7d08000637c0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #7 0x00007ff3622159d2 in boost::detail::function::void_function_obj_invoker0, boost::_bi::list2, boost::_bi::value > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000ca20, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "MaintenanceMgr [worker]-140682937625792" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000ca20 } system_tid = loop_count = #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 146 (Thread 0x7ff35a856cc0 (LWP 20764)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 No locals. #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d64000ee700, timeout=) at ev_epoll.c:153 i = eventcnt = #3 0x00007ff362b0b5da in ev_run (loop=0x7d64000ee700, flags=) at ev.c:3360 waittime = sleeptime = prev_mn_now = 9076.712562875 __PRETTY_FUNCTION__ = "ev_run" #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d4800021ac8, flags=768) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 No locals. #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d4800021ac0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000cc10) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000cbe0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc reactor-140683172474048" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000cbe0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 145 (Thread 0x7ff35222ccc0 (LWP 20765)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 No locals. #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d640021b600, timeout=) at ev_epoll.c:153 i = eventcnt = #3 0x00007ff362b0b5da in ev_run (loop=0x7d640021b600, flags=) at ev.c:3360 waittime = sleeptime = prev_mn_now = 9076.7121262519995 __PRETTY_FUNCTION__ = "ev_run" #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d480003b148, flags=1536) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 No locals. #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d480003b140) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000ccf0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000ccc0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc reactor-140683031792832" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000ccc0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 144 (Thread 0x7ff35c21dcc0 (LWP 20766)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 No locals. #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d6400265200, timeout=) at ev_epoll.c:153 i = eventcnt = #3 0x00007ff362b0b5da in ev_run (loop=0x7d6400265200, flags=) at ev.c:3360 waittime = sleeptime = prev_mn_now = 9076.7123930159996 __PRETTY_FUNCTION__ = "ev_run" #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d48000217c8, flags=2304) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 No locals. #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d48000217c0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000cdd0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000cda0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc reactor-140683199503552" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000cda0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 143 (Thread 0x7ff350fbecc0 (LWP 20767)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 No locals. #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d6400265700, timeout=) at ev_epoll.c:153 i = eventcnt = #3 0x00007ff362b0b5da in ev_run (loop=0x7d6400265700, flags=) at ev.c:3360 waittime = sleeptime = prev_mn_now = 9076.7215956910004 __PRETTY_FUNCTION__ = "ev_run" #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d480003b2c8, flags=3072) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 No locals. #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d480003b2c0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000ceb0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000ce80, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc reactor-140683012467904" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000ce80 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 142 (Thread 0x7ff34c3c6cc0 (LWP 20768)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 No locals. #2 0x00007ff3693f80c8 in boost::condition_variable::timed_wait (this=0x7d4c00029788, m=..., wait_until=) at /usr/include/boost/thread/pthread/condition_variable.hpp:27 check_for_interruption = { thread_info = 0x0 } timeout = { tv_sec = 1424409482, tv_nsec = 474825000 } #3 0x00007ff36905f754 in kudu::tserver::ScannerManager::RunRemovalThread (this=0x7d4c00029740) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tserver/scanners.cc:72 l = { m = 0x7d4c00029760, is_locked = true } wtime = { > >> = { , boost::detail::false_t>, boost::detail::empty_base, boost::detail::true_t>> = { , boost::detail::false_t> >> = { , boost::detail::false_t>> = { >> = { > = {}, }, }, }, }, members of boost::date_time::base_time > >: time_ = { time_count_ = { value_ = 212291212682474825 } } }, } l = { m = 0x7d4c00029760, is_locked = true } #4 0x00007ff369065f5e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #5 0x00007ff369065ecb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #6 0x00007ff369065e74 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800006d90) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #7 0x00007ff369065c7a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800006d60, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "removal_thread-140682932808896" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800006d60 } system_tid = loop_count = #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 141 (Thread 0x7ff34c974cc0 (LWP 20769)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 No locals. #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d440001d5a0, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 relative_time = { tv_sec = 10, tv_nsec = 0 } absolute_time = { tv_sec = 9081, tv_nsec = 577340030 } now = { tv_sec = 9071, tv_nsec = 577340030 } nsecs = _result = rv = #3 0x00007ff36a9cd11c in kudu::CountDownLatch::WaitFor (this=, delta=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:75 lock = { lock_ = 0x7d440001d570, owned_ = true } #4 0x00007ff369049196 in kudu::tserver::RemoteBootstrapServiceImpl::EndExpiredSessions (this=0x7d440001d4c0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tserver/remote_bootstrap_service.cc:333 No locals. #5 0x00007ff369051cbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #6 0x00007ff369051c2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #7 0x00007ff369051bd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800006930) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #8 0x00007ff3690519da in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800006900, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rb-session-exp-140682938764480" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800006900 } system_tid = loop_count = #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 140 (Thread 0x7ff34c8e9cc0 (LWP 20770)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000bbf8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbb0, out=0x7ff34c87fae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480000bbc8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbfc, out=0x7ff34c87fc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800006ad0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800006af0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800006ac0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140682938195136" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800006ac0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 139 (Thread 0x7ff35c0e5cc0 (LWP 20771)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000bbf8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbb0, out=0x7ff35c07bae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480000bbc8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbfc, out=0x7ff35c07bc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380000d210 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000d230) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000d200, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683198225600" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000d200 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 138 (Thread 0x7ff35a7bacc0 (LWP 20772)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000bbf8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbb0, out=0x7ff35a750ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480000bbc8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbfc, out=0x7ff35a750c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380000c950 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000c970) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000c940, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683171835072" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000c940 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 137 (Thread 0x7ff35c66dcc0 (LWP 20773)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000bbf8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbb0, out=0x7ff35c603ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480000bbc8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbfc, out=0x7ff35c603c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380000c870 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000c890) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000c860, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683204025536" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000c860 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 136 (Thread 0x7ff35c377cc0 (LWP 20774)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000bbf8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbb0, out=0x7ff35c30dae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480000bbc8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbfc, out=0x7ff35c30dc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800045d70 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800045d90) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800045d60, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683200920768" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800045d60 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 135 (Thread 0x7ff3567dccc0 (LWP 20775)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000bbf8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbb0, out=0x7ff356772ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480000bbc8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbfc, out=0x7ff356772c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800004290 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000042b0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800004280, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683104865472" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800004280 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 134 (Thread 0x7ff356608cc0 (LWP 20776)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000bbf8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbb0, out=0x7ff35659eae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480000bbc8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbfc, out=0x7ff35659ec20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380008bd70 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380008bd90) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380008bd60, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683102948544" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380008bd60 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 133 (Thread 0x7ff3566a4cc0 (LWP 20777)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000bbf8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbb0, out=0x7ff35663aae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480000bbc8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbfc, out=0x7ff35663ac20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800004450 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800004470) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800004440, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683103587520" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800004440 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 132 (Thread 0x7ff356740cc0 (LWP 20778)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000bbf8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbb0, out=0x7ff3566d6ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480000bbc8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbfc, out=0x7ff3566d6c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800029050 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800029070) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800029040, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683104226496" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800029040 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 131 (Thread 0x7ff350c90cc0 (LWP 20779)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000bbf8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbb0, out=0x7ff350c26ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480000bbc8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000bbfc, out=0x7ff350c26c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380007dbb0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380007dbd0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380007dba0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683009133760" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380007dba0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 130 (Thread 0x7ff35656ccc0 (LWP 20780)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000ba78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba30, out=0x7ff356502ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480000ba48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba7c, out=0x7ff356502c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20780, counter_ = 2, asserter_ = 0x7d0400009500 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800007030) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800007000, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683102309568" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800007000 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 129 (Thread 0x7ff352b95cc0 (LWP 20781)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000ba78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba30, out=0x7ff352b2bae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480000ba48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba7c, out=0x7ff352b2bc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20781, counter_ = 2, asserter_ = 0x7d0400028070 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800007110) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d38000070e0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683041660096" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d38000070e0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 128 (Thread 0x7ff34cd52cc0 (LWP 20782)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000ba78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba30, out=0x7ff34cce8ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480000ba48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba7c, out=0x7ff34cce8c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20782, counter_ = 2, asserter_ = 0x7d0400018e40 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000071f0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d38000071c0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140682942819520" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d38000071c0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 127 (Thread 0x7ff350b39cc0 (LWP 20783)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000ba78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba30, out=0x7ff350acfae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480000ba48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba7c, out=0x7ff350acfc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d38000072b0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000072d0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d38000072a0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683007728832" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d38000072a0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 126 (Thread 0x7ff350ea8cc0 (LWP 20784)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000ba78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba30, out=0x7ff350e3eae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480000ba48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba7c, out=0x7ff350e3ec20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800007390 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000073b0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800007380, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683011329216" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800007380 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 125 (Thread 0x7ff35054ecc0 (LWP 20785)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000ba78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba30, out=0x7ff3504e4ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480000ba48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba7c, out=0x7ff3504e4c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800007470 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800007490) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800007460, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683001523392" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800007460 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 124 (Thread 0x7ff3522f3cc0 (LWP 20786)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000ba78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba30, out=0x7ff352289ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480000ba48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba7c, out=0x7ff352289c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800007550 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800007570) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800007540, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683032607936" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800007540 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 123 (Thread 0x7ff356925cc0 (LWP 20787)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000ba78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba30, out=0x7ff3568bbae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480000ba48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba7c, out=0x7ff3568bbc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800007630 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800007650) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800007620, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683106213056" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800007620 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 122 (Thread 0x7ff34e84fcc0 (LWP 20788)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000ba78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba30, out=0x7ff34e7e5ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480000ba48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba7c, out=0x7ff34e7e5c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800007710 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800007730) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800007700, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140682971118784" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800007700 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 121 (Thread 0x7ff352c20cc0 (LWP 20789)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480000ba78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba30, out=0x7ff352bb6ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480000ba48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480000ba7c, out=0x7ff352bb6c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800006830 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800006850) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800006820, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683042229440" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800006820 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 120 (Thread 0x7ff352cabcc0 (LWP 20790)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800018df8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018db0, out=0x7ff352c41ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d4800018dc8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018dfc, out=0x7ff352c41c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20790, counter_ = 2, asserter_ = 0x7d0400008f90 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800030bd0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800030ba0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683042798784" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800030ba0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 119 (Thread 0x7ff3540e1cc0 (LWP 20791)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800018df8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018db0, out=0x7ff354077ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d4800018dc8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018dfc, out=0x7ff354077c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20791, counter_ = 2, asserter_ = 0x7d0400033b20 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800007810) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d38000077e0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683063991488" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d38000077e0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 118 (Thread 0x7ff35417dcc0 (LWP 20792)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800018df8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018db0, out=0x7ff354113ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d4800018dc8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018dfc, out=0x7ff354113c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20792, counter_ = 2, asserter_ = 0x7d0400049a40 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800006070) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800006040, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683064630464" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800006040 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 117 (Thread 0x7ff354219cc0 (LWP 20793)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800018df8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018db0, out=0x7ff3541afae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d4800018dc8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018dfc, out=0x7ff3541afc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20793, counter_ = 2, asserter_ = 0x7d0400049540 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800006150) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800006120, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683065269440" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800006120 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 116 (Thread 0x7ff3542b5cc0 (LWP 20794)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800018df8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018db0, out=0x7ff35424bae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d4800018dc8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018dfc, out=0x7ff35424bc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20794, counter_ = 2, asserter_ = 0x7d0400014d40 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800006230) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800006200, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683065908416" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800006200 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 115 (Thread 0x7ff354351cc0 (LWP 20795)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800018df8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018db0, out=0x7ff3542e7ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d4800018dc8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018dfc, out=0x7ff3542e7c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20795, counter_ = 2, asserter_ = 0x7d040003b4a0 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800006310) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d38000062e0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683066547392" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d38000062e0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 114 (Thread 0x7ff3543edcc0 (LWP 20796)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800018df8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018db0, out=0x7ff354383ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d4800018dc8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018dfc, out=0x7ff354383c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20796, counter_ = 2, asserter_ = 0x7d040002b040 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000063f0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d38000063c0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683067186368" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d38000063c0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 113 (Thread 0x7ff354489cc0 (LWP 20797)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800018df8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018db0, out=0x7ff35441fae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d4800018dc8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018dfc, out=0x7ff35441fc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20797, counter_ = 2, asserter_ = 0x7d0400027dd0 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000064d0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d38000064a0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683067825344" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d38000064a0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 112 (Thread 0x7ff35649ecc0 (LWP 20798)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800018df8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018db0, out=0x7ff356434ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d4800018dc8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018dfc, out=0x7ff356434c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20798, counter_ = 2, asserter_ = 0x7d0400025610 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000065b0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800006580, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683101465792" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800006580 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 111 (Thread 0x7ff354b0acc0 (LWP 20799)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800018df8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018db0, out=0x7ff354aa0ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d4800018dc8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d4800018dfc, out=0x7ff354aa0c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20799, counter_ = 2, asserter_ = 0x7d0400022530 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800006690) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800006660, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683074645184" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800006660 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 110 (Thread 0x7ff354b95cc0 (LWP 20800)): #0 0x00007ff36035cc7f in accept4 () from /lib64/libc.so.6 No symbol table info available. #1 0x00007ff36ae64f06 in __interceptor_accept4 () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:1335 No locals. #2 0x00007ff3621eb169 in kudu::Socket::Accept (this=0x7d140008ddb8, new_conn=0x7ff354b2bc20, remote=0x7ff354b2bc10, flags=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/net/socket.cc:257 addr = { sin_family = 64083, sin_port = 25378, sin_addr = { s_addr = 32755 }, sin_zero = "\020\274\262T\363\177\000" } olen = 16 _result = #3 0x00007ff3631d8963 in kudu::rpc::AcceptorPool::RunThread (this=0x7d140008ddb0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/acceptor_pool.cc:96 new_sock = { static FLAG_NONBLOCKING = 1, fd_ = -1 } remote = { addr_ = { sin_family = 2, sin_port = 0, sin_addr = { s_addr = 0 }, sin_zero = "\000\000\000\000\000\000\000" } } s = { state_ = 0x0 } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #4 0x00007ff3631dc2ae in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #5 0x00007ff3631dc21b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #6 0x00007ff3631dc1a4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000057b0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #7 0x00007ff3631dbf4a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800005780, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "acceptor-140683075214528" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800005780 } system_tid = loop_count = #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 109 (Thread 0x7ff354c20cc0 (LWP 20801)): #0 0x00007ff360351293 in poll () from /lib64/libc.so.6 No symbol table info available. #1 0x00007ff36ae69c8d in __interceptor_poll () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:1992 No locals. #2 0x00007ff36786237e in master_thread () from /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/build/fastdebug/libserver_process.so No symbol table info available. #3 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #4 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #5 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 108 (Thread 0x7ff354cabcc0 (LWP 20802)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 No locals. #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d4000057fb8, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 relative_time = { tv_sec = 0, tv_nsec = 10000000 } absolute_time = { tv_sec = 9076, tv_nsec = 731789699 } now = { tv_sec = 9076, tv_nsec = 721789699 } nsecs = _result = rv = #3 0x00007ff36a9cd11c in kudu::CountDownLatch::WaitFor (this=, delta=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:75 lock = { lock_ = 0x7d4000057f88, owned_ = true } #4 0x00007ff36902f5b0 in kudu::tserver::Heartbeater::Thread::RunThread (this=0x7d4000057f00) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tserver/heartbeater.cc:344 s = { state_ = 0x0 } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #5 0x00007ff36903235e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #6 0x00007ff3690322cb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #7 0x00007ff369032254 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800005890) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #8 0x00007ff369031ffa in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800005860, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "heartbeat-140683076353216" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800005860 } system_tid = loop_count = #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 107 (Thread 0x7ff354ffecc0 (LWP 20803)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 No locals. #2 0x00007ff3693f80c8 in boost::condition_variable::timed_wait (this=0x7d4000077f88, m=..., wait_until=) at /usr/include/boost/thread/pthread/condition_variable.hpp:27 check_for_interruption = { thread_info = 0x0 } timeout = { tv_sec = 1424409477, tv_nsec = 848573000 } #3 0x00007ff368bf35d8 in kudu::MaintenanceManager::RunSchedulerThread (this=0x7d4000077f00) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tablet/maintenance_manager.cc:185 s = { state_ = 0x7ff354f94bfc "" } op = vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 polling_interval = { = { >> = { , boost::detail::false_t>, boost::detail::empty_base, boost::detail::true_t>> = { , boost::detail::false_t> >> = { , boost::detail::false_t>> = { >> = { > = {}, }, }, }, }, members of boost::date_time::time_duration >: ticks_ = { value_ = 250000 } }, }, } guard = { m = 0x7d4000077f48, is_locked = true } cur_time = { > >> = { , boost::detail::false_t>, boost::detail::empty_base, boost::detail::true_t>> = { , boost::detail::false_t> >> = { , boost::detail::false_t>> = { >> = { > = {}, }, }, }, }, members of boost::date_time::base_time > >: time_ = { time_count_ = { value_ = 212291212677598573 } } }, } #4 0x00007ff368bf933e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #5 0x00007ff368bf92ab in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #6 0x00007ff368bf9254 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800005970) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #7 0x00007ff368bf905a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800005940, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "maintenance_scheduler-140683079838912" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800005940 } system_tid = loop_count = #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 106 (Thread 0x7ff35aaddcc0 (LWP 20806)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d440009ee18) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff3622142a6 in kudu::ThreadPool::DispatchThread (this=0x7d440009ed40, permanent=true) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/threadpool.cc:240 entry = { runnable = std::tr1::shared_ptr (count 1952539695) 0x7d100012dfa8, trace = 0x0 } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x7ff35aa73bf8 }, old_trace_ = 0x7ff35aa73bfc } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 unique_lock = { lock_ = 0x7d440009ed68, owned_ = true } #4 0x00007ff362215ce6 in boost::_mfi::mf1::operator() (this=, p=, a1=true) at /usr/include/boost/bind/mem_fn_template.hpp:162 No locals. #5 0x00007ff362215c4c in boost::_bi::list2, boost::_bi::value >::operator(), boost::_bi::list0> (this=0x7d0800056890, f=, a=...) at /usr/include/boost/bind/bind.hpp:306 No locals. #6 0x00007ff362215bd4 in boost::_bi::bind_t, boost::_bi::list2, boost::_bi::value > >::operator() (this=0x7d0800056880) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #7 0x00007ff3622159d2 in boost::detail::function::void_function_obj_invoker0, boost::_bi::list2, boost::_bi::value > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800005a20, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "MaintenanceMgr [worker]-140683175124160" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800005a20 } system_tid = loop_count = #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 105 (Thread 0x7ff35aa41cc0 (LWP 20807)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 No locals. #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d640029ae00, timeout=) at ev_epoll.c:153 i = eventcnt = #3 0x00007ff362b0b5da in ev_run (loop=0x7d640029ae00, flags=) at ev.c:3360 waittime = sleeptime = prev_mn_now = 9076.7148175639995 __PRETTY_FUNCTION__ = "ev_run" #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d4800004cc8, flags=6144) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 No locals. #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d4800004cc0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800005c10) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800005be0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc reactor-140683174485184" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800005be0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 104 (Thread 0x7ff35a9a5cc0 (LWP 20808)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 No locals. #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d640001e500, timeout=) at ev_epoll.c:153 i = eventcnt = #3 0x00007ff362b0b5da in ev_run (loop=0x7d640001e500, flags=) at ev.c:3360 waittime = sleeptime = prev_mn_now = 9076.7172065920004 __PRETTY_FUNCTION__ = "ev_run" #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d4800015048, flags=24576) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 No locals. #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d4800015040) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800005cf0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800005cc0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc reactor-140683173846208" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800005cc0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 103 (Thread 0x7ff35a909cc0 (LWP 20809)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 No locals. #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d640000ff00, timeout=) at ev_epoll.c:153 i = eventcnt = #3 0x00007ff362b0b5da in ev_run (loop=0x7d640000ff00, flags=) at ev.c:3360 waittime = sleeptime = prev_mn_now = 9076.7147492580007 __PRETTY_FUNCTION__ = "ev_run" #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d4800007b48, flags=25344) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 No locals. #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d4800007b40) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800005dd0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800005da0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc reactor-140683173207232" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800005da0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 102 (Thread 0x7ff35a72fcc0 (LWP 20810)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 No locals. #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d64002a0800, timeout=) at ev_epoll.c:153 i = eventcnt = #3 0x00007ff362b0b5da in ev_run (loop=0x7d64002a0800, flags=) at ev.c:3360 waittime = sleeptime = prev_mn_now = 9076.7157711 __PRETTY_FUNCTION__ = "ev_run" #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d480001e648, flags=26112) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 No locals. #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d480001e640) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800005eb0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800005e80, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc reactor-140683171265728" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800005e80 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 101 (Thread 0x7ff35a6a4cc0 (LWP 20811)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 No locals. #2 0x00007ff3693f80c8 in boost::condition_variable::timed_wait (this=0x7d4c000295c8, m=..., wait_until=) at /usr/include/boost/thread/pthread/condition_variable.hpp:27 check_for_interruption = { thread_info = 0x0 } timeout = { tv_sec = 1424409482, tv_nsec = 533503000 } #3 0x00007ff36905f754 in kudu::tserver::ScannerManager::RunRemovalThread (this=0x7d4c00029580) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tserver/scanners.cc:72 l = { m = 0x7d4c000295a0, is_locked = true } wtime = { > >> = { , boost::detail::false_t>, boost::detail::empty_base, boost::detail::true_t>> = { , boost::detail::false_t> >> = { , boost::detail::false_t>> = { >> = { > = {}, }, }, }, }, members of boost::date_time::base_time > >: time_ = { time_count_ = { value_ = 212291212682533503 } } }, } l = { m = 0x7d4c000295a0, is_locked = true } #4 0x00007ff369065f5e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #5 0x00007ff369065ecb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #6 0x00007ff369065e74 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800005f90) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #7 0x00007ff369065c7a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800005f60, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "removal_thread-140683170696384" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800005f60 } system_tid = loop_count = #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 100 (Thread 0x7ff35a619cc0 (LWP 20812)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 No locals. #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d440009a6e0, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 relative_time = { tv_sec = 10, tv_nsec = 0 } absolute_time = { tv_sec = 9081, tv_nsec = 639831384 } now = { tv_sec = 9071, tv_nsec = 639831384 } nsecs = _result = rv = #3 0x00007ff36a9cd11c in kudu::CountDownLatch::WaitFor (this=, delta=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:75 lock = { lock_ = 0x7d440009a6b0, owned_ = true } #4 0x00007ff369049196 in kudu::tserver::RemoteBootstrapServiceImpl::EndExpiredSessions (this=0x7d440009a600) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tserver/remote_bootstrap_service.cc:333 No locals. #5 0x00007ff369051cbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #6 0x00007ff369051c2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #7 0x00007ff369051bd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000c7b0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #8 0x00007ff3690519da in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000c780, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rb-session-exp-140683170127040" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000c780 } system_tid = loop_count = #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 99 (Thread 0x7ff35a53acc0 (LWP 20813)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800047478) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800047430, out=0x7ff35a4d0ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d4800047448, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480004747c, out=0x7ff35a4d0c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d38000056b0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000056d0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d38000056a0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683169213632" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d38000056a0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 98 (Thread 0x7ff35a49ecc0 (LWP 20814)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800047478) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800047430, out=0x7ff35a434ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d4800047448, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480004747c, out=0x7ff35a434c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d38000055d0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000055f0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d38000055c0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683168574656" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d38000055c0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 97 (Thread 0x7ff35a371cc0 (LWP 20815)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800047478) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800047430, out=0x7ff35a307ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d4800047448, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480004747c, out=0x7ff35a307c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800004d10 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800004d30) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800004d00, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683167341760" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800004d00 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 96 (Thread 0x7ff35a2d5cc0 (LWP 20816)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800047478) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800047430, out=0x7ff35a26bae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d4800047448, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480004747c, out=0x7ff35a26bc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380001b670 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380001b690) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380001b660, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683166702784" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380001b660 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 95 (Thread 0x7ff35a24acc0 (LWP 20817)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800047478) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800047430, out=0x7ff35a1e0ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d4800047448, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480004747c, out=0x7ff35a1e0c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380000dad0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000daf0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000dac0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683166133440" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000dac0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 94 (Thread 0x7ff35a112cc0 (LWP 20818)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800047478) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800047430, out=0x7ff35a0a8ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d4800047448, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480004747c, out=0x7ff35a0a8c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380000dc90 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000dcb0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000dc80, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683164855488" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000dc80 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 93 (Thread 0x7ff358ffecc0 (LWP 20819)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800047478) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800047430, out=0x7ff358f94ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d4800047448, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480004747c, out=0x7ff358f94c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380000d050 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000d070) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000d040, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683146947776" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000d040 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 92 (Thread 0x7ff358f52cc0 (LWP 20820)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800047478) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800047430, out=0x7ff358ee8ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d4800047448, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480004747c, out=0x7ff358ee8c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800030d70 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800030d90) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800030d60, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683146243264" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800030d60 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 91 (Thread 0x7ff358ec7cc0 (LWP 20821)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800047478) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800047430, out=0x7ff358e5dae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d4800047448, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480004747c, out=0x7ff358e5dc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380007dd70 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380007dd90) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380007dd60, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683145673920" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380007dd60 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 90 (Thread 0x7ff358df9cc0 (LWP 20822)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d4800047478) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d4800047430, out=0x7ff358d8fae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d4800047448, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480004747c, out=0x7ff358d8fc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d38000094d0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000094f0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d38000094c0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683144830144" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d38000094c0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 89 (Thread 0x7ff358d6ecc0 (LWP 20823)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001a3d78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d30, out=0x7ff358d04ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48001a3d48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d7c, out=0x7ff358d04c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20823, counter_ = 2, asserter_ = 0x7d040003c670 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000095d0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d38000095a0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683144260800" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d38000095a0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 88 (Thread 0x7ff358ce3cc0 (LWP 20824)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001a3d78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d30, out=0x7ff358c79ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48001a3d48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d7c, out=0x7ff358c79c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20824, counter_ = 2, asserter_ = 0x7d0400019710 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000096b0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800009680, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683143691456" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800009680 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 87 (Thread 0x7ff358c58cc0 (LWP 20825)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001a3d78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d30, out=0x7ff358beeae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48001a3d48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d7c, out=0x7ff358beec20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20825, counter_ = 2, asserter_ = 0x7d04000379b0 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800009790) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800009760, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683143122112" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800009760 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 86 (Thread 0x7ff358bcdcc0 (LWP 20826)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001a3d78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d30, out=0x7ff358b63ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48001a3d48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d7c, out=0x7ff358b63c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800009850 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800009870) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800009840, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683142552768" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800009840 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 85 (Thread 0x7ff358b42cc0 (LWP 20827)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001a3d78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d30, out=0x7ff358ad8ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48001a3d48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d7c, out=0x7ff358ad8c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800009930 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800009950) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800009920, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683141983424" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800009920 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 84 (Thread 0x7ff358ab7cc0 (LWP 20828)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001a3d78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d30, out=0x7ff358a4dae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48001a3d48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d7c, out=0x7ff358a4dc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800009a10 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800009a30) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800009a00, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683141414080" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800009a00 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 83 (Thread 0x7ff358983cc0 (LWP 20829)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001a3d78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d30, out=0x7ff358919ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48001a3d48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d7c, out=0x7ff358919c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800009af0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800009b10) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800009ae0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683140152512" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800009ae0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 82 (Thread 0x7ff3588f8cc0 (LWP 20830)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001a3d78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d30, out=0x7ff35888eae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48001a3d48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d7c, out=0x7ff35888ec20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800009bd0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800009bf0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800009bc0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683139583168" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800009bc0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 81 (Thread 0x7ff358829cc0 (LWP 20831)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001a3d78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d30, out=0x7ff3587bfae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48001a3d48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d7c, out=0x7ff3587bfc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800008350 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800008370) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800008340, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683138735296" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800008340 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 80 (Thread 0x7ff35879ecc0 (LWP 20832)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001a3d78) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d30, out=0x7ff358734ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48001a3d48, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001a3d7c, out=0x7ff358734c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800030ad0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800030af0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800030ac0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683138165952" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800030ac0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 79 (Thread 0x7ff358713cc0 (LWP 20833)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480014fef8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480014feb0, out=0x7ff3586a9ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480014fec8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480014fefc, out=0x7ff3586a9c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20833, counter_ = 2, asserter_ = 0x7d0400021470 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800008b50) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800008b20, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683137596608" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800008b20 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 78 (Thread 0x7ff358688cc0 (LWP 20834)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480014fef8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480014feb0, out=0x7ff35861eae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480014fec8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480014fefc, out=0x7ff35861ec20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20834, counter_ = 2, asserter_ = 0x7d0400014a00 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800008c30) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800008c00, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683137027264" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800008c00 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 77 (Thread 0x7ff3585fdcc0 (LWP 20835)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480014fef8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480014feb0, out=0x7ff358593ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480014fec8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480014fefc, out=0x7ff358593c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20835, counter_ = 2, asserter_ = 0x7d0400039750 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800008d10) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800008ce0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683136457920" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800008ce0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 76 (Thread 0x7ff358572cc0 (LWP 20836)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480014fef8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480014feb0, out=0x7ff358508ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480014fec8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480014fefc, out=0x7ff358508c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20836, counter_ = 2, asserter_ = 0x7d0400038bc0 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800008df0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800008dc0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683135888576" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800008dc0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 75 (Thread 0x7ff3584e7cc0 (LWP 20837)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480014fef8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480014feb0, out=0x7ff35847dae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480014fec8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480014fefc, out=0x7ff35847dc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20837, counter_ = 2, asserter_ = 0x7d040002abb0 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800008ed0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800008ea0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683135319232" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800008ea0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 74 (Thread 0x7ff35845ccc0 (LWP 20838)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480014fef8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480014feb0, out=0x7ff3583f2ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480014fec8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480014fefc, out=0x7ff3583f2c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20838, counter_ = 2, asserter_ = 0x7d0400027ce0 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800008fb0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800008f80, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683134749888" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800008f80 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 73 (Thread 0x7ff3583d1cc0 (LWP 20839)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480014fef8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480014feb0, out=0x7ff358367ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480014fec8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480014fefc, out=0x7ff358367c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20839, counter_ = 2, asserter_ = 0x7d040001f5c0 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800009090) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800009060, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683134180544" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800009060 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 72 (Thread 0x7ff358346cc0 (LWP 20840)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480014fef8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480014feb0, out=0x7ff3582dcae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480014fec8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480014fefc, out=0x7ff3582dcc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20840, counter_ = 2, asserter_ = 0x7d04000343a0 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800009170) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800009140, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683133611200" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800009140 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 71 (Thread 0x7ff3582aacc0 (LWP 20841)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480014fef8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480014feb0, out=0x7ff358240ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480014fec8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480014fefc, out=0x7ff358240c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20841, counter_ = 2, asserter_ = 0x7d0400025fe0 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800009250) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800009220, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683132972224" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800009220 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 70 (Thread 0x7ff35820ecc0 (LWP 20842)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480014fef8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480014feb0, out=0x7ff3581a4ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480014fec8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480014fefc, out=0x7ff3581a4c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20842, counter_ = 2, asserter_ = 0x7d040004f340 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800009330) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800009300, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683132333248" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800009300 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 69 (Thread 0x7ff358172cc0 (LWP 20843)): #0 0x00007ff36035cc7f in accept4 () from /lib64/libc.so.6 No symbol table info available. #1 0x00007ff36ae64f06 in __interceptor_accept4 () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:1335 No locals. #2 0x00007ff3621eb169 in kudu::Socket::Accept (this=0x7d140002c388, new_conn=0x7ff358108c20, remote=0x7ff358108c10, flags=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/net/socket.cc:257 addr = { sin_family = 64083, sin_port = 25378, sin_addr = { s_addr = 32755 }, sin_zero = "\020\214\020X\363\177\000" } olen = 16 _result = #3 0x00007ff3631d8963 in kudu::rpc::AcceptorPool::RunThread (this=0x7d140002c380) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/acceptor_pool.cc:96 new_sock = { static FLAG_NONBLOCKING = 1, fd_ = -1 } remote = { addr_ = { sin_family = 2, sin_port = 0, sin_addr = { s_addr = 0 }, sin_zero = "\000\000\000\000\000\000\000" } } s = { state_ = 0x0 } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #4 0x00007ff3631dc2ae in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #5 0x00007ff3631dc21b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #6 0x00007ff3631dc1a4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800008450) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #7 0x00007ff3631dbf4a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800008420, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "acceptor-140683131694272" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800008420 } system_tid = loop_count = #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 68 (Thread 0x7ff3580d6cc0 (LWP 20844)): #0 0x00007ff360351293 in poll () from /lib64/libc.so.6 No symbol table info available. #1 0x00007ff36ae69c8d in __interceptor_poll () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:1992 No locals. #2 0x00007ff36786237e in master_thread () from /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/build/fastdebug/libserver_process.so No symbol table info available. #3 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #4 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #5 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 67 (Thread 0x7ff356ffecc0 (LWP 20845)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 No locals. #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d400002fab8, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 relative_time = { tv_sec = 0, tv_nsec = 10000000 } absolute_time = { tv_sec = 9076, tv_nsec = 721622289 } now = { tv_sec = 9076, tv_nsec = 711622289 } nsecs = _result = rv = #3 0x00007ff36a9cd11c in kudu::CountDownLatch::WaitFor (this=, delta=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:75 lock = { lock_ = 0x7d400002fa88, owned_ = true } #4 0x00007ff36902f5b0 in kudu::tserver::Heartbeater::Thread::RunThread (this=0x7d400002fa00) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tserver/heartbeater.cc:344 s = { state_ = 0x0 } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #5 0x00007ff36903235e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #6 0x00007ff3690322cb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #7 0x00007ff369032254 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800008530) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #8 0x00007ff369031ffa in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800008500, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "heartbeat-140683113393344" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800008500 } system_tid = loop_count = #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 66 (Thread 0x7ff356f62cc0 (LWP 20846)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 No locals. #2 0x00007ff3693f80c8 in boost::condition_variable::timed_wait (this=0x7d4000057d88, m=..., wait_until=) at /usr/include/boost/thread/pthread/condition_variable.hpp:27 check_for_interruption = { thread_info = 0x0 } timeout = { tv_sec = 1424409477, tv_nsec = 848652000 } #3 0x00007ff368bf35d8 in kudu::MaintenanceManager::RunSchedulerThread (this=0x7d4000057d00) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tablet/maintenance_manager.cc:185 s = { state_ = 0x7ff356ef8bfc "" } op = vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 polling_interval = { = { >> = { , boost::detail::false_t>, boost::detail::empty_base, boost::detail::true_t>> = { , boost::detail::false_t> >> = { , boost::detail::false_t>> = { >> = { > = {}, }, }, }, }, members of boost::date_time::time_duration >: ticks_ = { value_ = 250000 } }, }, } guard = { m = 0x7d4000057d48, is_locked = true } cur_time = { > >> = { , boost::detail::false_t>, boost::detail::empty_base, boost::detail::true_t>> = { , boost::detail::false_t> >> = { , boost::detail::false_t>> = { >> = { > = {}, }, }, }, }, members of boost::date_time::base_time > >: time_ = { time_count_ = { value_ = 212291212677598652 } } }, } #4 0x00007ff368bf933e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #5 0x00007ff368bf92ab in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #6 0x00007ff368bf9254 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800008610) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #7 0x00007ff368bf905a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d38000085e0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "maintenance_scheduler-140683112754368" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d38000085e0 } system_tid = loop_count = #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 65 (Thread 0x7ff356e4ccc0 (LWP 20852)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d44000b9c18) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff3622142a6 in kudu::ThreadPool::DispatchThread (this=0x7d44000b9b40, permanent=true) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/threadpool.cc:240 entry = { runnable = std::tr1::shared_ptr (count 1952539695) 0x7d100014fba8, trace = 0x0 } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x7ff356de2bf8 }, old_trace_ = 0x7ff356de2bfc } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 unique_lock = { lock_ = 0x7d44000b9b68, owned_ = true } #4 0x00007ff362215ce6 in boost::_mfi::mf1::operator() (this=, p=, a1=true) at /usr/include/boost/bind/mem_fn_template.hpp:162 No locals. #5 0x00007ff362215c4c in boost::_bi::list2, boost::_bi::value >::operator(), boost::_bi::list0> (this=0x7d080000b930, f=, a=...) at /usr/include/boost/bind/bind.hpp:306 No locals. #6 0x00007ff362215bd4 in boost::_bi::bind_t, boost::_bi::list2, boost::_bi::value > >::operator() (this=0x7d080000b920) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #7 0x00007ff3622159d2 in boost::detail::function::void_function_obj_invoker0, boost::_bi::list2, boost::_bi::value > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d38000086c0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "MaintenanceMgr [worker]-140683111615680" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d38000086c0 } system_tid = loop_count = #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 64 (Thread 0x7ff356dc1cc0 (LWP 20858)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 No locals. #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d6400057800, timeout=) at ev_epoll.c:153 i = eventcnt = #3 0x00007ff362b0b5da in ev_run (loop=0x7d6400057800, flags=) at ev.c:3360 waittime = sleeptime = prev_mn_now = 9076.617567239 __PRETTY_FUNCTION__ = "ev_run" #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d480000a0c8, flags=26880) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 No locals. #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d480000a0c0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000088b0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800008880, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc reactor-140683111046336" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800008880 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 63 (Thread 0x7ff356d25cc0 (LWP 20859)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 No locals. #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d6400058c00, timeout=) at ev_epoll.c:153 i = eventcnt = #3 0x00007ff362b0b5da in ev_run (loop=0x7d6400058c00, flags=) at ev.c:3360 waittime = sleeptime = prev_mn_now = 9076.7136722750001 __PRETTY_FUNCTION__ = "ev_run" #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d480001e4c8, flags=6912) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 No locals. #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d480001e4c0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800008990) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800008960, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc reactor-140683110407360" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800008960 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 62 (Thread 0x7ff356c89cc0 (LWP 20860)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 No locals. #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d64002a0300, timeout=) at ev_epoll.c:153 i = eventcnt = #3 0x00007ff362b0b5da in ev_run (loop=0x7d64002a0300, flags=) at ev.c:3360 waittime = sleeptime = prev_mn_now = 9076.61698411 __PRETTY_FUNCTION__ = "ev_run" #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d4800203448, flags=7680) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 No locals. #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d4800203440) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800008a70) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800008a40, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc reactor-140683109768384" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800008a40 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 61 (Thread 0x7ff356bedcc0 (LWP 20861)): #0 0x00007ff36035af43 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x00007ff36ae595dc in __interceptor_epoll_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1623 No locals. #2 0x00007ff362b08c95 in epoll_poll (loop=0x7d640029fe00, timeout=) at ev_epoll.c:153 i = eventcnt = #3 0x00007ff362b0b5da in ev_run (loop=0x7d640029fe00, flags=) at ev.c:3360 waittime = sleeptime = prev_mn_now = 9076.7009008789992 __PRETTY_FUNCTION__ = "ev_run" #4 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d48000154c8, flags=8448) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 No locals. #5 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d48000154c0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #6 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800009cd0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800009ca0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc reactor-140683109129408" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800009ca0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 60 (Thread 0x7ff356b51cc0 (LWP 20862)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 No locals. #2 0x00007ff3693f80c8 in boost::condition_variable::timed_wait (this=0x7d4c0000cd08, m=..., wait_until=) at /usr/include/boost/thread/pthread/condition_variable.hpp:27 check_for_interruption = { thread_info = 0x0 } timeout = { tv_sec = 1424409477, tv_nsec = 628222000 } #3 0x00007ff36905f754 in kudu::tserver::ScannerManager::RunRemovalThread (this=0x7d4c0000ccc0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tserver/scanners.cc:72 l = { m = 0x7d4c0000cce0, is_locked = true } wtime = { > >> = { , boost::detail::false_t>, boost::detail::empty_base, boost::detail::true_t>> = { , boost::detail::false_t> >> = { , boost::detail::false_t>> = { >> = { > = {}, }, }, }, }, members of boost::date_time::base_time > >: time_ = { time_count_ = { value_ = 212291212677628222 } } }, } l = { m = 0x7d4c0000cce0, is_locked = true } #4 0x00007ff369065f5e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #5 0x00007ff369065ecb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #6 0x00007ff369065e74 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800008290) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #7 0x00007ff369065c7a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800008260, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "removal_thread-140683108490432" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800008260 } system_tid = loop_count = #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 59 (Thread 0x7ff356ab5cc0 (LWP 20863)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 No locals. #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d440009f0a0, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 relative_time = { tv_sec = 10, tv_nsec = 0 } absolute_time = { tv_sec = 9081, tv_nsec = 735750318 } now = { tv_sec = 9071, tv_nsec = 735750318 } nsecs = _result = rv = #3 0x00007ff36a9cd11c in kudu::CountDownLatch::WaitFor (this=, delta=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:75 lock = { lock_ = 0x7d440009f070, owned_ = true } #4 0x00007ff369049196 in kudu::tserver::RemoteBootstrapServiceImpl::EndExpiredSessions (this=0x7d440009efc0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tserver/remote_bootstrap_service.cc:333 No locals. #5 0x00007ff369051cbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #6 0x00007ff369051c2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #7 0x00007ff369051bd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800009410) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #8 0x00007ff3690519da in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d38000093e0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rb-session-exp-140683107851456" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d38000093e0 } system_tid = loop_count = #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 58 (Thread 0x7ff3569f6cc0 (LWP 20864)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480001b4f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4b0, out=0x7ff35698cae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480001b4c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4fc, out=0x7ff35698cc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800008190 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000081b0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800008180, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683107069120" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800008180 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 57 (Thread 0x7ff35689acc0 (LWP 20865)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480001b4f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4b0, out=0x7ff356830ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480001b4c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4fc, out=0x7ff356830c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d38000080b0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000080d0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d38000080a0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683105643712" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d38000080a0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 56 (Thread 0x7ff3563cdcc0 (LWP 20866)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480001b4f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4b0, out=0x7ff356363ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480001b4c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4fc, out=0x7ff356363c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380000d830 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000d850) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000d820, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683100609728" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000d820 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 55 (Thread 0x7ff356342cc0 (LWP 20867)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480001b4f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4b0, out=0x7ff3562d8ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480001b4c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4fc, out=0x7ff3562d8c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380001be50 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380001be70) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380001be40, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683100040384" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380001be40 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 54 (Thread 0x7ff356234cc0 (LWP 20868)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480001b4f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4b0, out=0x7ff3561caae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480001b4c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4fc, out=0x7ff3561cac20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800030670 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800030690) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800030660, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683098934464" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800030660 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 53 (Thread 0x7ff356198cc0 (LWP 20869)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480001b4f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4b0, out=0x7ff35612eae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480001b4c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4fc, out=0x7ff35612ec20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800007ef0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800007f10) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800007ee0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683098295488" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800007ee0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 52 (Thread 0x7ff3560fccc0 (LWP 20870)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480001b4f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4b0, out=0x7ff356092ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480001b4c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4fc, out=0x7ff356092c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800084ad0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800084af0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800084ac0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683097656512" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800084ac0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 51 (Thread 0x7ff354f73cc0 (LWP 20871)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480001b4f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4b0, out=0x7ff354f09ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480001b4c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4fc, out=0x7ff354f09c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380005af30 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380005af50) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380005af20, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683079269568" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380005af20 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 50 (Thread 0x7ff354ee8cc0 (LWP 20872)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480001b4f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4b0, out=0x7ff354e7eae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480001b4c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4fc, out=0x7ff354e7ec20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380000c5d0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000c5f0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000c5c0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683078700224" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000c5c0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 49 (Thread 0x7ff354e5dcc0 (LWP 20873)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480001b4f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4b0, out=0x7ff354df3ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480001b4c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480001b4fc, out=0x7ff354df3c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380000ba70 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000ba90) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000ba60, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683078130880" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000ba60 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 48 (Thread 0x7ff354dd2cc0 (LWP 20874)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001678f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678b0, out=0x7ff354d68ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48001678c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678fc, out=0x7ff354d68c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20874, counter_ = 2, asserter_ = 0x7d04000341c0 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000bb70) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000bb40, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683077561536" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000bb40 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 47 (Thread 0x7ff354d47cc0 (LWP 20875)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001678f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678b0, out=0x7ff354cddae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48001678c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678fc, out=0x7ff354cddc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20875, counter_ = 2, asserter_ = 0x7d0400022090 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000bc50) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000bc20, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683076992192" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000bc20 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 46 (Thread 0x7ff354a7fcc0 (LWP 20876)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001678f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678b0, out=0x7ff354a15ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48001678c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678fc, out=0x7ff354a15c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20876, counter_ = 2, asserter_ = 0x7d040003e480 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000bd30) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000bd00, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683074075840" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000bd00 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 45 (Thread 0x7ff3549f4cc0 (LWP 20877)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001678f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678b0, out=0x7ff35498aae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48001678c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678fc, out=0x7ff35498ac20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380000bdf0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000be10) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000bde0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683073506496" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000bde0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 44 (Thread 0x7ff354969cc0 (LWP 20878)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001678f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678b0, out=0x7ff3548ffae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48001678c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678fc, out=0x7ff3548ffc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380000bed0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000bef0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000bec0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683072937152" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000bec0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 43 (Thread 0x7ff3548decc0 (LWP 20879)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001678f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678b0, out=0x7ff354874ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48001678c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678fc, out=0x7ff354874c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380000bfb0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000bfd0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000bfa0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683072367808" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000bfa0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 42 (Thread 0x7ff354853cc0 (LWP 20880)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001678f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678b0, out=0x7ff3547e9ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48001678c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678fc, out=0x7ff3547e9c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380000af10 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000af30) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000af00, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683071798464" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000af00 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 41 (Thread 0x7ff3547c8cc0 (LWP 20881)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001678f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678b0, out=0x7ff35475eae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48001678c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678fc, out=0x7ff35475ec20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380000a810 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000a830) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000a800, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683071229120" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000a800 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 40 (Thread 0x7ff35473dcc0 (LWP 20882)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001678f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678b0, out=0x7ff3546d3ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48001678c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678fc, out=0x7ff3546d3c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d380000a8f0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000a910) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000a8e0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683070659776" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000a8e0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 39 (Thread 0x7ff3546b2cc0 (LWP 20883)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d48001678f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678b0, out=0x7ff354648ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d48001678c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d48001678fc, out=0x7ff354648c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 0, counter_ = 0, asserter_ = 0x0 }, old_trace_ = 0x7d3800030910 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800030930) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800030900, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683070090432" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800030900 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 38 (Thread 0x7ff354627cc0 (LWP 20884)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480007b1f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1b0, out=0x7ff3545bdae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480007b1c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1fc, out=0x7ff3545bdc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20884, counter_ = 2, asserter_ = 0x7d040003d170 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000b0f0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000b0c0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683069521088" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000b0c0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 37 (Thread 0x7ff35459ccc0 (LWP 20885)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480007b1f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1b0, out=0x7ff354532ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480007b1c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1fc, out=0x7ff354532c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20885, counter_ = 2, asserter_ = 0x7d040003d5c0 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000b1d0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000b1a0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683068951744" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000b1a0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 36 (Thread 0x7ff352ffecc0 (LWP 20886)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480007b1f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1b0, out=0x7ff352f94ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480007b1c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1fc, out=0x7ff352f94c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20886, counter_ = 2, asserter_ = 0x7d040002a050 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000b2b0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000b280, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683046284480" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000b280 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 35 (Thread 0x7ff352f73cc0 (LWP 20887)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480007b1f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1b0, out=0x7ff352f09ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480007b1c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1fc, out=0x7ff352f09c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20887, counter_ = 2, asserter_ = 0x7d040002f6a0 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000b390) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000b360, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683045715136" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000b360 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 34 (Thread 0x7ff352ee8cc0 (LWP 20888)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480007b1f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1b0, out=0x7ff352e7eae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480007b1c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1fc, out=0x7ff352e7ec20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20888, counter_ = 2, asserter_ = 0x7d0400017a70 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000b470) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000b440, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683045145792" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000b440 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 33 (Thread 0x7ff352e5dcc0 (LWP 20889)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480007b1f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1b0, out=0x7ff352df3ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480007b1c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1fc, out=0x7ff352df3c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20889, counter_ = 2, asserter_ = 0x7d040003afe0 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000b550) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000b520, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683044576448" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000b520 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 32 (Thread 0x7ff352dd2cc0 (LWP 20890)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480007b1f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1b0, out=0x7ff352d68ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480007b1c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1fc, out=0x7ff352d68c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20890, counter_ = 2, asserter_ = 0x7d0400002c90 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000b630) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000b600, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683044007104" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000b600 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 31 (Thread 0x7ff352d47cc0 (LWP 20891)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480007b1f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1b0, out=0x7ff352cddae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480007b1c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1fc, out=0x7ff352cddc20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20891, counter_ = 2, asserter_ = 0x7d0400015000 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000b710) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000b6e0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683043437760" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000b6e0 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 30 (Thread 0x7ff352b0acc0 (LWP 20892)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480007b1f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1b0, out=0x7ff352aa0ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480007b1c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1fc, out=0x7ff352aa0c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20892, counter_ = 2, asserter_ = 0x7d040004cd30 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000a590) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000a560, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683041090752" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000a560 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 29 (Thread 0x7ff352a7fcc0 (LWP 20893)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d480007b1f8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36322d021 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1b0, out=0x7ff352a15ae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:74 l = { lock_ = 0x7d480007b1c8, owned_ = true } #4 0x00007ff36322c088 in kudu::BlockingQueue::BlockingGet (this=0x7d480007b1fc, out=0x7ff352a15c20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:82 t = 0x0 t = 0x0 #5 0x00007ff36322abef in kudu::rpc::ServicePool::RunThread (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/service_pool.cc:128 incoming = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x0 } } } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 20893, counter_ = 2, asserter_ = 0x7d04000215e0 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 #6 0x00007ff36322d99e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #7 0x00007ff36322d90b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #8 0x00007ff36322d8b4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800061d90) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #9 0x00007ff36322d6ba in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #10 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #11 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800061d60, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc worker-140683040521408" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800061d60 } system_tid = loop_count = #12 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #13 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #14 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 28 (Thread 0x7ff3529f4cc0 (LWP 20894)): #0 0x00007ff36035cc7f in accept4 () from /lib64/libc.so.6 No symbol table info available. #1 0x00007ff36ae64f06 in __interceptor_accept4 () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:1335 No locals. #2 0x00007ff3621eb169 in kudu::Socket::Accept (this=0x7d140000f418, new_conn=0x7ff35298ac20, remote=0x7ff35298ac10, flags=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/net/socket.cc:257 addr = { sin_family = 64083, sin_port = 25378, sin_addr = { s_addr = 32755 }, sin_zero = "\020\254\230R\363\177\000" } olen = 16 _result = #3 0x00007ff3631d8963 in kudu::rpc::AcceptorPool::RunThread (this=0x7d140000f410) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/acceptor_pool.cc:96 new_sock = { static FLAG_NONBLOCKING = 1, fd_ = -1 } remote = { addr_ = { sin_family = 2, sin_port = 0, sin_addr = { s_addr = 0 }, sin_zero = "\000\000\000\000\000\000\000" } } s = { state_ = 0x0 } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #4 0x00007ff3631dc2ae in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #5 0x00007ff3631dc21b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #6 0x00007ff3631dc1a4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000a9f0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #7 0x00007ff3631dbf4a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000a9c0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "acceptor-140683039952064" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000a9c0 } system_tid = loop_count = #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 27 (Thread 0x7ff352969cc0 (LWP 20895)): #0 0x00007ff360351293 in poll () from /lib64/libc.so.6 No symbol table info available. #1 0x00007ff36ae69c8d in __interceptor_poll () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:1992 No locals. #2 0x00007ff36786237e in master_thread () from /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/build/fastdebug/libserver_process.so No symbol table info available. #3 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #4 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #5 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 26 (Thread 0x7ff3528decc0 (LWP 20896)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 No locals. #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d400002fcb8, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 relative_time = { tv_sec = 0, tv_nsec = 10000000 } absolute_time = { tv_sec = 9076, tv_nsec = 711139994 } now = { tv_sec = 9076, tv_nsec = 701139994 } nsecs = _result = rv = #3 0x00007ff36a9cd11c in kudu::CountDownLatch::WaitFor (this=, delta=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:75 lock = { lock_ = 0x7d400002fc88, owned_ = true } #4 0x00007ff36902f5b0 in kudu::tserver::Heartbeater::Thread::RunThread (this=0x7d400002fc00) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tserver/heartbeater.cc:344 s = { state_ = 0x0 } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #5 0x00007ff36903235e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #6 0x00007ff3690322cb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #7 0x00007ff369032254 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000aad0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #8 0x00007ff369031ffa in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000aaa0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "heartbeat-140683038813376" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000aaa0 } system_tid = loop_count = #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 25 (Thread 0x7ff352853cc0 (LWP 20897)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 No locals. #2 0x00007ff3693f80c8 in boost::condition_variable::timed_wait (this=0x7d400002fb88, m=..., wait_until=) at /usr/include/boost/thread/pthread/condition_variable.hpp:27 check_for_interruption = { thread_info = 0x0 } timeout = { tv_sec = 1424409477, tv_nsec = 602641000 } #3 0x00007ff368bf35d8 in kudu::MaintenanceManager::RunSchedulerThread (this=0x7d400002fb00) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tablet/maintenance_manager.cc:185 s = { state_ = 0x7ff3527e9bfc "" } op = vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 polling_interval = { = { >> = { , boost::detail::false_t>, boost::detail::empty_base, boost::detail::true_t>> = { , boost::detail::false_t> >> = { , boost::detail::false_t>> = { >> = { > = {}, }, }, }, }, members of boost::date_time::time_duration >: ticks_ = { value_ = 250000 } }, }, } guard = { m = 0x7d400002fb48, is_locked = true } cur_time = { > >> = { , boost::detail::false_t>, boost::detail::empty_base, boost::detail::true_t>> = { , boost::detail::false_t> >> = { , boost::detail::false_t>> = { >> = { > = {}, }, }, }, }, members of boost::date_time::base_time > >: time_ = { time_count_ = { value_ = 212291212677352641 } } }, } #4 0x00007ff368bf933e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #5 0x00007ff368bf92ab in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #6 0x00007ff368bf9254 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000abb0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #7 0x00007ff368bf905a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000ab80, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "maintenance_scheduler-140683038244032" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000ab80 } system_tid = loop_count = #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 24 (Thread 0x7ff35273dcc0 (LWP 20899)): #0 0x00007ff3661d8d2d in nanosleep () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae49a1c in __interceptor_nanosleep () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:254 No locals. #2 0x00007ff3693e667b in boost::detail::yield (k=) at /usr/include/boost/smart_ptr/detail/yield_k.hpp:123 rqtp = { tv_sec = 0, tv_nsec = 1000 } #3 0x00007ff3693e6569 in kudu::rw_semaphore::lock (this=0x7d2c0005d740) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/rw_semaphore.h:98 expected = try_new_state = #4 0x00007ff365542ec1 in kudu::client::KuduClient::Data::SetMasterServerProxyAsync (this=0x7d2c0005d6a0, client=0x0, cb=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/client/client-internal.cc:674 deadline = { static kNanosecondsPerSecond = 1000000000, static kNanosecondsPerMillisecond = 1000000, static kNanosecondsPerMicrosecond = 1000, static kMicrosecondsPerSecond = 1000000, nanos_ = 8197887530292 } master_sockaddrs = std::vector of length 1, capacity 1 = {{ addr_ = { sin_family = 2, sin_port = 12992, sin_addr = { s_addr = 16777343 }, sin_zero = "\000\000\000\000\000\000\000" } }} #5 0x00007ff365557c8a in kudu::client::internal::LookupRpc::ResetMasterLeaderAndRetry (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/client/meta_cache.cc:432 No locals. #6 0x00007ff36555800d in kudu::client::internal::LookupRpc::SendRpcCb (this=0x7d4000004400, status=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/client/meta_cache.cc:476 delete_me = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x7d4000004400 } } } new_status = { state_ = 0x7d140007b070 ";" } #7 0x00007ff363214283 in kudu::rpc::RpcRetrier::DelayedRetryCb (this=, rpc=0x7d4000004400, status=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/rpc.cc:69 new_status = { state_ = 0x7d1400073a00 ";" } #8 0x00007ff363214cbf in boost::_mfi::mf2::operator() (this=, p=, a1=0x7d4000004400, a2=...) at /usr/include/boost/bind/mem_fn_template.hpp:274 No locals. #9 0x00007ff363214c10 in boost::_bi::list3, boost::_bi::value, boost::arg<1> >::operator(), boost::_bi::list1 > (this=0x7d08000c71f0, f=, a=...) at /usr/include/boost/bind/bind.hpp:385 No locals. #10 0x00007ff363214b49 in boost::_bi::bind_t, boost::_bi::list3, boost::_bi::value, boost::arg<1> > >::operator() (this=0x7d08000c71e0, a1=) at /usr/include/boost/bind/bind_template.hpp:47 a = { > = { a1_ = @0x7ff3526d3a98 }, } #11 0x00007ff363214929 in boost::detail::function::void_function_obj_invoker1, boost::_bi::list3, boost::_bi::value, boost::arg<1> > >, void, kudu::Status const&>::invoke (function_obj_ptr=..., a0=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #12 0x00007ff36320c5ba in boost::function1::operator() (this=, a0=...) at /usr/include/boost/function/function_template.hpp:1012 No locals. #13 0x00007ff363209dca in kudu::rpc::DelayedTask::TimerHandler (this=0x7d2000026480, watcher=, revents=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:468 No locals. #14 0x00007ff36320f73b in ev::base::method_thunk (loop=, w=0x7d20000264c8, revents=982122496) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:479 No locals. #15 0x00007ff362b072bd in ev_invoke_pending (loop=0x7d640003b600) at ev.c:2994 p = #16 0x00007ff362b0bad2 in ev_run (loop=0x7d640003b600, flags=) at ev.c:3394 __PRETTY_FUNCTION__ = "ev_run" #17 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d4800203bc8, flags=0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 No locals. #18 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d4800203bc0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #19 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #20 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #21 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000ac90) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #22 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #23 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #24 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000ac60, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc reactor-140683037105344" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000ac60 } system_tid = loop_count = #25 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #26 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #27 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 23 (Thread 0x7ff35240fcc0 (LWP 20900)): #0 0x00007ff3661d8d2d in nanosleep () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae49a1c in __interceptor_nanosleep () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:254 No locals. #2 0x00007ff3693e667b in boost::detail::yield (k=) at /usr/include/boost/smart_ptr/detail/yield_k.hpp:123 rqtp = { tv_sec = 0, tv_nsec = 1000 } #3 0x00007ff3693e6569 in kudu::rw_semaphore::lock (this=0x7d2c0005d740) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/rw_semaphore.h:98 expected = try_new_state = #4 0x00007ff365542ec1 in kudu::client::KuduClient::Data::SetMasterServerProxyAsync (this=0x7d2c0005d6a0, client=0x0, cb=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/client/client-internal.cc:674 deadline = { static kNanosecondsPerSecond = 1000000000, static kNanosecondsPerMillisecond = 1000000, static kNanosecondsPerMicrosecond = 1000, static kMicrosecondsPerSecond = 1000000, nanos_ = 8197808725329 } master_sockaddrs = std::vector of length 1, capacity 1 = {{ addr_ = { sin_family = 2, sin_port = 12992, sin_addr = { s_addr = 16777343 }, sin_zero = "\000\000\000\000\000\000\000" } }} #5 0x00007ff365557c8a in kudu::client::internal::LookupRpc::ResetMasterLeaderAndRetry (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/client/meta_cache.cc:432 No locals. #6 0x00007ff36555800d in kudu::client::internal::LookupRpc::SendRpcCb (this=0x7d4000006300, status=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/client/meta_cache.cc:476 delete_me = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x7d4000006300 } } } new_status = { state_ = 0x7d14000a5fa0 ";" } #7 0x00007ff363214283 in kudu::rpc::RpcRetrier::DelayedRetryCb (this=, rpc=0x7d4000006300, status=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/rpc.cc:69 new_status = { state_ = 0x7d140000b220 ";" } #8 0x00007ff363214cbf in boost::_mfi::mf2::operator() (this=, p=, a1=0x7d4000006300, a2=...) at /usr/include/boost/bind/mem_fn_template.hpp:274 No locals. #9 0x00007ff363214c10 in boost::_bi::list3, boost::_bi::value, boost::arg<1> >::operator(), boost::_bi::list1 > (this=0x7d0800014f90, f=, a=...) at /usr/include/boost/bind/bind.hpp:385 No locals. #10 0x00007ff363214b49 in boost::_bi::bind_t, boost::_bi::list3, boost::_bi::value, boost::arg<1> > >::operator() (this=0x7d0800014f80, a1=) at /usr/include/boost/bind/bind_template.hpp:47 a = { > = { a1_ = @0x7ff3523a5a98 }, } #11 0x00007ff363214929 in boost::detail::function::void_function_obj_invoker1, boost::_bi::list3, boost::_bi::value, boost::arg<1> > >, void, kudu::Status const&>::invoke (function_obj_ptr=..., a0=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #12 0x00007ff36320c5ba in boost::function1::operator() (this=, a0=...) at /usr/include/boost/function/function_template.hpp:1012 No locals. #13 0x00007ff363209dca in kudu::rpc::DelayedTask::TimerHandler (this=0x7d2000007380, watcher=, revents=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:468 No locals. #14 0x00007ff36320f73b in ev::base::method_thunk (loop=, w=0x7d20000073c8, revents=1016840192) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:479 No locals. #15 0x00007ff362b072bd in ev_invoke_pending (loop=0x7d6400251c00) at ev.c:2994 p = #16 0x00007ff362b0bad2 in ev_run (loop=0x7d6400251c00, flags=) at ev.c:3394 __PRETTY_FUNCTION__ = "ev_run" #17 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d4800002ec8, flags=0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 No locals. #18 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d4800002ec0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #19 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #20 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #21 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000ad70) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #22 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #23 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #24 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000ad40, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc reactor-140683033771200" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000ad40 } system_tid = loop_count = #25 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #26 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #27 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 22 (Thread 0x7ff352384cc0 (LWP 20901)): #0 0x00007ff3661d8d2d in nanosleep () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae49a1c in __interceptor_nanosleep () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:254 No locals. #2 0x00007ff3693e667b in boost::detail::yield (k=) at /usr/include/boost/smart_ptr/detail/yield_k.hpp:123 rqtp = { tv_sec = 0, tv_nsec = 1000 } #3 0x00007ff3693e6569 in kudu::rw_semaphore::lock (this=0x7d2c0005d740) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/rw_semaphore.h:98 expected = try_new_state = #4 0x00007ff365542ec1 in kudu::client::KuduClient::Data::SetMasterServerProxyAsync (this=0x7d2c0005d6a0, client=0x0, cb=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/client/client-internal.cc:674 deadline = { static kNanosecondsPerSecond = 1000000000, static kNanosecondsPerMillisecond = 1000000, static kNanosecondsPerMicrosecond = 1000, static kMicrosecondsPerSecond = 1000000, nanos_ = 8197887569736 } master_sockaddrs = std::vector of length 1, capacity 1 = {{ addr_ = { sin_family = 2, sin_port = 12992, sin_addr = { s_addr = 16777343 }, sin_zero = "\000\000\000\000\000\000\000" } }} #5 0x00007ff365557c8a in kudu::client::internal::LookupRpc::ResetMasterLeaderAndRetry (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/client/meta_cache.cc:432 No locals. #6 0x00007ff36555800d in kudu::client::internal::LookupRpc::SendRpcCb (this=0x7d4000004a00, status=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/client/meta_cache.cc:476 delete_me = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x7d4000004a00 } } } new_status = { state_ = 0x7d140007fad0 ";" } #7 0x00007ff363214283 in kudu::rpc::RpcRetrier::DelayedRetryCb (this=, rpc=0x7d4000004a00, status=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/rpc.cc:69 new_status = { state_ = 0x7d140007fb70 ";" } #8 0x00007ff363214cbf in boost::_mfi::mf2::operator() (this=, p=, a1=0x7d4000004a00, a2=...) at /usr/include/boost/bind/mem_fn_template.hpp:274 No locals. #9 0x00007ff363214c10 in boost::_bi::list3, boost::_bi::value, boost::arg<1> >::operator(), boost::_bi::list1 > (this=0x7d0800000c10, f=, a=...) at /usr/include/boost/bind/bind.hpp:385 No locals. #10 0x00007ff363214b49 in boost::_bi::bind_t, boost::_bi::list3, boost::_bi::value, boost::arg<1> > >::operator() (this=0x7d0800000c00, a1=) at /usr/include/boost/bind/bind_template.hpp:47 a = { > = { a1_ = @0x7ff35231aa98 }, } #11 0x00007ff363214929 in boost::detail::function::void_function_obj_invoker1, boost::_bi::list3, boost::_bi::value, boost::arg<1> > >, void, kudu::Status const&>::invoke (function_obj_ptr=..., a0=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #12 0x00007ff36320c5ba in boost::function1::operator() (this=, a0=...) at /usr/include/boost/function/function_template.hpp:1012 No locals. #13 0x00007ff363209dca in kudu::rpc::DelayedTask::TimerHandler (this=0x7d2000009700, watcher=, revents=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:468 No locals. #14 0x00007ff36320f73b in ev::base::method_thunk (loop=, w=0x7d2000009748, revents=1051557888) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:479 No locals. #15 0x00007ff362b072bd in ev_invoke_pending (loop=0x7d64001f4500) at ev.c:2994 p = #16 0x00007ff362b0bad2 in ev_run (loop=0x7d64001f4500, flags=) at ev.c:3394 __PRETTY_FUNCTION__ = "ev_run" #17 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d480003a3c8, flags=0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 No locals. #18 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d480003a3c0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #19 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #20 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #21 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000ae50) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #22 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #23 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #24 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000ae20, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc reactor-140683033201856" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000ae20 } system_tid = loop_count = #25 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #26 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #27 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 21 (Thread 0x7ff350f33cc0 (LWP 20902)): #0 0x00007ff3661d8d2d in nanosleep () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae49a1c in __interceptor_nanosleep () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:254 No locals. #2 0x00007ff3693e667b in boost::detail::yield (k=) at /usr/include/boost/smart_ptr/detail/yield_k.hpp:123 rqtp = { tv_sec = 0, tv_nsec = 1000 } #3 0x00007ff3693e6569 in kudu::rw_semaphore::lock (this=0x7d2c0005d740) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/rw_semaphore.h:98 expected = try_new_state = #4 0x00007ff365542ec1 in kudu::client::KuduClient::Data::SetMasterServerProxyAsync (this=0x7d2c0005d6a0, client=0x0, cb=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/client/client-internal.cc:674 deadline = { static kNanosecondsPerSecond = 1000000000, static kNanosecondsPerMillisecond = 1000000, static kNanosecondsPerMicrosecond = 1000, static kMicrosecondsPerSecond = 1000000, nanos_ = 8197888955589 } master_sockaddrs = std::vector of length 1, capacity 1 = {{ addr_ = { sin_family = 2, sin_port = 12992, sin_addr = { s_addr = 16777343 }, sin_zero = "\000\000\000\000\000\000\000" } }} #5 0x00007ff365557c8a in kudu::client::internal::LookupRpc::ResetMasterLeaderAndRetry (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/client/meta_cache.cc:432 No locals. #6 0x00007ff36555800d in kudu::client::internal::LookupRpc::SendRpcCb (this=0x7d4000006000, status=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/client/meta_cache.cc:476 delete_me = { impl_ = { data_ = { > = {}, members of kudu::internal::gscoped_ptr_impl >::Data: ptr = 0x7d4000006000 } } } new_status = { state_ = 0x7d140008e300 ";" } #7 0x00007ff363214283 in kudu::rpc::RpcRetrier::DelayedRetryCb (this=, rpc=0x7d4000006000, status=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/rpc.cc:69 new_status = { state_ = 0x7d140008e3f0 ";" } #8 0x00007ff363214cbf in boost::_mfi::mf2::operator() (this=, p=, a1=0x7d4000006000, a2=...) at /usr/include/boost/bind/mem_fn_template.hpp:274 No locals. #9 0x00007ff363214c10 in boost::_bi::list3, boost::_bi::value, boost::arg<1> >::operator(), boost::_bi::list1 > (this=0x7d080007a290, f=, a=...) at /usr/include/boost/bind/bind.hpp:385 No locals. #10 0x00007ff363214b49 in boost::_bi::bind_t, boost::_bi::list3, boost::_bi::value, boost::arg<1> > >::operator() (this=0x7d080007a280, a1=) at /usr/include/boost/bind/bind_template.hpp:47 a = { > = { a1_ = @0x7ff350ec9a98 }, } #11 0x00007ff363214929 in boost::detail::function::void_function_obj_invoker1, boost::_bi::list3, boost::_bi::value, boost::arg<1> > >, void, kudu::Status const&>::invoke (function_obj_ptr=..., a0=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #12 0x00007ff36320c5ba in boost::function1::operator() (this=, a0=...) at /usr/include/boost/function/function_template.hpp:1012 No locals. #13 0x00007ff363209dca in kudu::rpc::DelayedTask::TimerHandler (this=0x7d2000008200, watcher=, revents=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:468 No locals. #14 0x00007ff36320f73b in ev::base::method_thunk (loop=, w=0x7d2000008248, revents=1086275584) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:479 No locals. #15 0x00007ff362b072bd in ev_invoke_pending (loop=0x7d640019d700) at ev.c:2994 p = #16 0x00007ff362b0bad2 in ev_run (loop=0x7d640019d700, flags=) at ev.c:3394 __PRETTY_FUNCTION__ = "ev_run" #17 0x00007ff36320c029 in ev::loop_ref::run (this=0x7d480003a248, flags=0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/installed/include/ev++.h:211 No locals. #18 0x00007ff363206826 in kudu::rpc::ReactorThread::RunThread (this=0x7d480003a240) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/rpc/reactor.cc:294 vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #19 0x00007ff363212dbe in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #20 0x00007ff363212d2b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #21 0x00007ff363212cd4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000c0b0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #22 0x00007ff363212ada in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #23 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #24 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000c080, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "rpc reactor-140683011898560" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000c080 } system_tid = loop_count = #25 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #26 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #27 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 20 (Thread 0x7ff34c10fcc0 (LWP 20934)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d600009ade8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff368439687 in kudu::BlockingQueue::BlockingDrainTo (this=0x7d600009ada0, out=0x7ff34c0a5c10) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:108 l = { lock_ = 0x7d600009adb8, owned_ = true } #4 0x00007ff368431107 in kudu::log::Log::AppendThread::RunThread (this=0x7d1000155dc0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/consensus/log.cc:99 entry_batches = std::vector of length 0, capacity 0 d = { deleter_ = 0x7d04000168f0 } group_commit_latency_metric = { latency_hist_ = 0x7d08000eafa0, time_started_ = { static kNanosecondsPerSecond = 1000000000, static kNanosecondsPerMillisecond = 1000000, static kNanosecondsPerMicrosecond = 1000, static kMicrosecondsPerSecond = 1000000, nanos_ = 8183646007064 } } s = { state_ = 0x0 } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 queue = 0x7d600009ada0 #5 0x00007ff36844527e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #6 0x00007ff3684451eb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #7 0x00007ff368445194 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800005190) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #8 0x00007ff368444f9a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800005160, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "appender-140682929962176" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800005160 } system_tid = loop_count = #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 19 (Thread 0x7ff350438cc0 (LWP 20939)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d600006a5e8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff368439687 in kudu::BlockingQueue::BlockingDrainTo (this=0x7d600006a5a0, out=0x7ff3503cec10) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:108 l = { lock_ = 0x7d600006a5b8, owned_ = true } #4 0x00007ff368431107 in kudu::log::Log::AppendThread::RunThread (this=0x7d10000c6b40) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/consensus/log.cc:99 entry_batches = std::vector of length 0, capacity 0 d = { deleter_ = 0x7d0400038330 } group_commit_latency_metric = { latency_hist_ = 0x7d0800047ec0, time_started_ = { static kNanosecondsPerSecond = 1000000000, static kNanosecondsPerMillisecond = 1000000, static kNanosecondsPerMicrosecond = 1000, static kMicrosecondsPerSecond = 1000000, nanos_ = 8183204199791 } } s = { state_ = 0x0 } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 queue = 0x7d600006a5a0 #5 0x00007ff36844527e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #6 0x00007ff3684451eb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #7 0x00007ff368445194 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000de70) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #8 0x00007ff368444f9a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000de40, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "appender-140683000384704" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000de40 } system_tid = loop_count = #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 18 (Thread 0x7ff3502a1cc0 (LWP 20944)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d600005ede8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff368439687 in kudu::BlockingQueue::BlockingDrainTo (this=0x7d600005eda0, out=0x7ff350237c10) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:108 l = { lock_ = 0x7d600005edb8, owned_ = true } #4 0x00007ff368431107 in kudu::log::Log::AppendThread::RunThread (this=0x7d100013fd00) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/consensus/log.cc:99 entry_batches = std::vector of length 0, capacity 0 d = { deleter_ = 0x7d0400036260 } group_commit_latency_metric = { latency_hist_ = 0x7d080003c1c0, time_started_ = { static kNanosecondsPerSecond = 1000000000, static kNanosecondsPerMillisecond = 1000000, static kNanosecondsPerMicrosecond = 1000, static kMicrosecondsPerSecond = 1000000, nanos_ = 8183739578125 } } s = { state_ = 0x0 } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 queue = 0x7d600005eda0 #5 0x00007ff36844527e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #6 0x00007ff3684451eb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #7 0x00007ff368445194 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380001b770) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #8 0x00007ff368444f9a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380001b740, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "appender-140682998717632" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380001b740 } system_tid = loop_count = #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 17 (Thread 0x7ff350a23cc0 (LWP 20954)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d60000ffde8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff368439687 in kudu::BlockingQueue::BlockingDrainTo (this=0x7d60000ffda0, out=0x7ff3509b9c10) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:108 l = { lock_ = 0x7d60000ffdb8, owned_ = true } #4 0x00007ff368431107 in kudu::log::Log::AppendThread::RunThread (this=0x7d100005a400) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/consensus/log.cc:99 entry_batches = std::vector of length 0, capacity 0 d = { deleter_ = 0x7d0400028fb0 } group_commit_latency_metric = { latency_hist_ = 0x7d080006d600, time_started_ = { static kNanosecondsPerSecond = 1000000000, static kNanosecondsPerMillisecond = 1000000, static kNanosecondsPerMicrosecond = 1000, static kMicrosecondsPerSecond = 1000000, nanos_ = 8183730535755 } } s = { state_ = 0x0 } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 queue = 0x7d60000ffda0 #5 0x00007ff36844527e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #6 0x00007ff3684451eb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #7 0x00007ff368445194 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800014af0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #8 0x00007ff368444f9a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800014ac0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "appender-140683006590144" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800014ac0 } system_tid = loop_count = #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 16 (Thread 0x7ff34ed89cc0 (LWP 20966)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d600009c9e8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff368439687 in kudu::BlockingQueue::BlockingDrainTo (this=0x7d600009c9a0, out=0x7ff34ed1fc10) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:108 l = { lock_ = 0x7d600009c9b8, owned_ = true } #4 0x00007ff368431107 in kudu::log::Log::AppendThread::RunThread (this=0x7d10000c6e00) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/consensus/log.cc:99 entry_batches = std::vector of length 0, capacity 0 d = { deleter_ = 0x7d0400012150 } group_commit_latency_metric = { latency_hist_ = 0x7d0800097b00, time_started_ = { static kNanosecondsPerSecond = 1000000000, static kNanosecondsPerMillisecond = 1000000, static kNanosecondsPerMicrosecond = 1000, static kMicrosecondsPerSecond = 1000000, nanos_ = 8183151661596 } } s = { state_ = 0x0 } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 queue = 0x7d600009c9a0 #5 0x00007ff36844527e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #6 0x00007ff3684451eb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #7 0x00007ff368445194 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800084a10) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #8 0x00007ff368444f9a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d38000849e0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "appender-140682976599232" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d38000849e0 } system_tid = loop_count = #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 15 (Thread 0x7ff350bc5cc0 (LWP 20967)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d600001e9e8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff368439687 in kudu::BlockingQueue::BlockingDrainTo (this=0x7d600001e9a0, out=0x7ff350b5bc10) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:108 l = { lock_ = 0x7d600001e9b8, owned_ = true } #4 0x00007ff368431107 in kudu::log::Log::AppendThread::RunThread (this=0x7d100014a4c0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/consensus/log.cc:99 entry_batches = std::vector of length 0, capacity 0 d = { deleter_ = 0x7d0400025c20 } group_commit_latency_metric = { latency_hist_ = 0x7d0800024200, time_started_ = { static kNanosecondsPerSecond = 1000000000, static kNanosecondsPerMillisecond = 1000000, static kNanosecondsPerMicrosecond = 1000, static kMicrosecondsPerSecond = 1000000, nanos_ = 8183181244389 } } s = { state_ = 0x0 } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 queue = 0x7d600001e9a0 #5 0x00007ff36844527e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #6 0x00007ff3684451eb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #7 0x00007ff368445194 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800030cb0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #8 0x00007ff368444f9a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800030c80, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "appender-140683008302272" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800030c80 } system_tid = loop_count = #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 14 (Thread 0x7ff34ebe8cc0 (LWP 20977)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d600000fde8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff368439687 in kudu::BlockingQueue::BlockingDrainTo (this=0x7d600000fda0, out=0x7ff34eb7ec10) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:108 l = { lock_ = 0x7d600000fdb8, owned_ = true } #4 0x00007ff368431107 in kudu::log::Log::AppendThread::RunThread (this=0x7d10000dc700) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/consensus/log.cc:99 entry_batches = std::vector of length 0, capacity 0 d = { deleter_ = 0x7d040001ff30 } group_commit_latency_metric = { latency_hist_ = 0x7d0800034a40, time_started_ = { static kNanosecondsPerSecond = 1000000000, static kNanosecondsPerMillisecond = 1000000, static kNanosecondsPerMicrosecond = 1000, static kMicrosecondsPerSecond = 1000000, nanos_ = 8183185163415 } } s = { state_ = 0x0 } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 queue = 0x7d600000fda0 #5 0x00007ff36844527e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #6 0x00007ff3684451eb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #7 0x00007ff368445194 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800005270) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #8 0x00007ff368444f9a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800005240, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "appender-140682974891200" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800005240 } system_tid = loop_count = #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 13 (Thread 0x7ff34e9f0cc0 (LWP 20992)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 No locals. #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d30000fb768, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 relative_time = { tv_sec = 0, tv_nsec = 500000000 } absolute_time = { tv_sec = 9076, tv_nsec = 716614280 } now = { tv_sec = 9076, tv_nsec = 216614280 } nsecs = _result = rv = #3 0x00007ff36a9cd11c in kudu::CountDownLatch::WaitFor (this=, delta=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:75 lock = { lock_ = 0x7d30000fb738, owned_ = true } #4 0x00007ff3621f88cb in kudu::ResettableHeartbeaterThread::RunThread (this=0x7d30000fb700) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/resettable_heartbeater.cc:90 s = { state_ = 0x0 } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #5 0x00007ff3621f96ae in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #6 0x00007ff3621f961b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #7 0x00007ff3621f95c4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800029310) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #8 0x00007ff3621f93ca in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d38000292e0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "481dcea30ed549ddbfe1fee17518a067-heartbeat-140682972826816" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d38000292e0 } system_tid = loop_count = #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 12 (Thread 0x7ff34e965cc0 (LWP 20993)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d600006b5e8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff368439687 in kudu::BlockingQueue::BlockingDrainTo (this=0x7d600006b5a0, out=0x7ff34e8fbc10) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:108 l = { lock_ = 0x7d600006b5b8, owned_ = true } #4 0x00007ff368431107 in kudu::log::Log::AppendThread::RunThread (this=0x7d10000716c0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/consensus/log.cc:99 entry_batches = std::vector of length 0, capacity 0 d = { deleter_ = 0x7d04000217c0 } group_commit_latency_metric = { latency_hist_ = 0x7d0800033840, time_started_ = { static kNanosecondsPerSecond = 1000000000, static kNanosecondsPerMillisecond = 1000000, static kNanosecondsPerMicrosecond = 1000, static kMicrosecondsPerSecond = 1000000, nanos_ = 8183682579401 } } s = { state_ = 0x0 } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 queue = 0x7d600006b5a0 #5 0x00007ff36844527e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #6 0x00007ff3684451eb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #7 0x00007ff368445194 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000a3d0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #8 0x00007ff368444f9a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000a3a0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "appender-140682972257472" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000a3a0 } system_tid = loop_count = #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 11 (Thread 0x7ff3504c3cc0 (LWP 20995)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 No locals. #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d30000fb6a8, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 relative_time = { tv_sec = 0, tv_nsec = 500000000 } absolute_time = { tv_sec = 9076, tv_nsec = 716166042 } now = { tv_sec = 9076, tv_nsec = 216166042 } nsecs = _result = rv = #3 0x00007ff36a9cd11c in kudu::CountDownLatch::WaitFor (this=, delta=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:75 lock = { lock_ = 0x7d30000fb678, owned_ = true } #4 0x00007ff3621f88cb in kudu::ResettableHeartbeaterThread::RunThread (this=0x7d30000fb640) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/resettable_heartbeater.cc:90 s = { state_ = 0x0 } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #5 0x00007ff3621f96ae in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #6 0x00007ff3621f961b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #7 0x00007ff3621f95c4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d38000293f0) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #8 0x00007ff3621f93ca in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d38000293c0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "7cf363f7a5b54e2bbfcb2f96b3d301ac-heartbeat-140683000954048" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d38000293c0 } system_tid = loop_count = #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 10 (Thread 0x7ff34e7c4cc0 (LWP 20998)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 No locals. #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d3000065ca8, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 relative_time = { tv_sec = 0, tv_nsec = 500000000 } absolute_time = { tv_sec = 9076, tv_nsec = 716824157 } now = { tv_sec = 9076, tv_nsec = 216824157 } nsecs = _result = rv = #3 0x00007ff36a9cd11c in kudu::CountDownLatch::WaitFor (this=, delta=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:75 lock = { lock_ = 0x7d3000065c78, owned_ = true } #4 0x00007ff3621f88cb in kudu::ResettableHeartbeaterThread::RunThread (this=0x7d3000065c40) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/resettable_heartbeater.cc:90 s = { state_ = 0x0 } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #5 0x00007ff3621f96ae in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #6 0x00007ff3621f961b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #7 0x00007ff3621f95c4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380008be70) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #8 0x00007ff3621f93ca in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380008be40, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "7cf363f7a5b54e2bbfcb2f96b3d301ac-heartbeat-140682970549440" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380008be40 } system_tid = loop_count = #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 9 (Thread 0x7ff34e739cc0 (LWP 20999)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7d600005d1e8) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff368439687 in kudu::BlockingQueue::BlockingDrainTo (this=0x7d600005d1a0, out=0x7ff34e6cfc10) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/blocking_queue.h:108 l = { lock_ = 0x7d600005d1b8, owned_ = true } #4 0x00007ff368431107 in kudu::log::Log::AppendThread::RunThread (this=0x7d10000a4f40) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/consensus/log.cc:99 entry_batches = std::vector of length 0, capacity 0 d = { deleter_ = 0x7d040002df00 } group_commit_latency_metric = { latency_hist_ = 0x7d0800057340, time_started_ = { static kNanosecondsPerSecond = 1000000000, static kNanosecondsPerMillisecond = 1000000, static kNanosecondsPerMicrosecond = 1000, static kMicrosecondsPerSecond = 1000000, nanos_ = 8183232506281 } } s = { state_ = 0x0 } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 queue = 0x7d600005d1a0 #5 0x00007ff36844527e in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #6 0x00007ff3684451eb in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #7 0x00007ff368445194 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380003ef50) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #8 0x00007ff368444f9a in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380003ef20, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "appender-140682969980096" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380003ef20 } system_tid = loop_count = #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 8 (Thread 0x7ff34e623cc0 (LWP 21002)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 No locals. #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d3000065be8, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 relative_time = { tv_sec = 0, tv_nsec = 500000000 } absolute_time = { tv_sec = 9076, tv_nsec = 714652521 } now = { tv_sec = 9076, tv_nsec = 214652521 } nsecs = _result = rv = #3 0x00007ff36a9cd11c in kudu::CountDownLatch::WaitFor (this=, delta=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:75 lock = { lock_ = 0x7d3000065bb8, owned_ = true } #4 0x00007ff3621f88cb in kudu::ResettableHeartbeaterThread::RunThread (this=0x7d3000065b80) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/resettable_heartbeater.cc:90 s = { state_ = 0x0 } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #5 0x00007ff3621f96ae in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #6 0x00007ff3621f961b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #7 0x00007ff3621f95c4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d3800084850) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #8 0x00007ff3621f93ca in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800084820, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "9931e8ff47354ae68705e0b49da46cd4-heartbeat-140682968841408" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800084820 } system_tid = loop_count = #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 7 (Thread 0x7ff34e48dcc0 (LWP 21005)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 No locals. #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d300006b168, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 relative_time = { tv_sec = 0, tv_nsec = 500000000 } absolute_time = { tv_sec = 9076, tv_nsec = 716270994 } now = { tv_sec = 9076, tv_nsec = 216270994 } nsecs = _result = rv = #3 0x00007ff36a9cd11c in kudu::CountDownLatch::WaitFor (this=, delta=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:75 lock = { lock_ = 0x7d300006b138, owned_ = true } #4 0x00007ff3621f88cb in kudu::ResettableHeartbeaterThread::RunThread (this=0x7d300006b100) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/resettable_heartbeater.cc:90 s = { state_ = 0x0 } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #5 0x00007ff3621f96ae in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #6 0x00007ff3621f961b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #7 0x00007ff3621f95c4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000a670) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #8 0x00007ff3621f93ca in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000a640, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "481dcea30ed549ddbfe1fee17518a067-heartbeat-140682967178432" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000a640 } system_tid = loop_count = #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 6 (Thread 0x7ff34e402cc0 (LWP 21006)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 No locals. #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d300006b0a8, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 relative_time = { tv_sec = 0, tv_nsec = 500000000 } absolute_time = { tv_sec = 9076, tv_nsec = 718916637 } now = { tv_sec = 9076, tv_nsec = 218916637 } nsecs = _result = rv = #3 0x00007ff36a9cd11c in kudu::CountDownLatch::WaitFor (this=, delta=...) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:75 lock = { lock_ = 0x7d300006b078, owned_ = true } #4 0x00007ff3621f88cb in kudu::ResettableHeartbeaterThread::RunThread (this=0x7d300006b040) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/resettable_heartbeater.cc:90 s = { state_ = 0x0 } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 #5 0x00007ff3621f96ae in boost::_mfi::mf0::operator() (this=, p=) at /usr/include/boost/bind/mem_fn_template.hpp:49 No locals. #6 0x00007ff3621f961b in boost::_bi::list1 >::operator(), boost::_bi::list0> (this=, f=, a=) at /usr/include/boost/bind/bind.hpp:246 No locals. #7 0x00007ff3621f95c4 in boost::_bi::bind_t, boost::_bi::list1 > >::operator() (this=0x7d380000c190) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #8 0x00007ff3621f93ca in boost::detail::function::void_function_obj_invoker0, boost::_bi::list1 > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #9 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #10 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000c160, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "9931e8ff47354ae68705e0b49da46cd4-heartbeat-140682966609088" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000c160 } system_tid = loop_count = #11 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #12 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #13 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 5 (Thread 0x7ff34e377cc0 (LWP 27036)): #0 0x00007ff3661d909d in waitpid () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6250a in __interceptor_waitpid () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:969 No locals. #2 0x00007ff3621fe76c in kudu::Subprocess::DoWait (this=0x7ff34e30da80, ret=0x7ff34e30da3c, options=0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/subprocess.cc:285 rc = _result = #3 0x00007ff36a54d0dc in kudu::Subprocess::Wait (this=0x7ff34e30da3c, ret=0x0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/subprocess.h:58 No locals. #4 0x00007ff3621aae8c in kudu::PstackWatcher::RunStackDump (prog=, argv=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/pstack_watcher.cc:159 _s = { state_ = 0x7ff36ae4c05c "dH\213<%" } pstack_proc = { program_ = "gdb", argv_ = std::vector of length 14, capacity 14 = {"gdb", "-quiet", "-batch", "-nx", "-ex", "set print pretty on", "-ex", "info threads", "-ex", "thread apply all bt", "-ex", "thread apply all bt full", "/proc/18449/exe", "18449"}, started_ = true, child_pid_ = 27041, fd_state_ = {kudu::Subprocess::PIPED, kudu::Subprocess::SHARED, kudu::Subprocess::SHARED}, child_fds_ = {-1, -1, -1} } ret = 0 #5 0x00007ff3621aaacb in kudu::PstackWatcher::RunGdbStackDump (pid=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/pstack_watcher.cc:136 prog = "gdb" argv = std::vector of length 14, capacity 16 = {"gdb", "-quiet", "-batch", "-nx", "-ex", "set print pretty on", "-ex", "info threads", "-ex", "thread apply all bt", "-ex", "thread apply all bt full", "/proc/18449/exe", "18449"} #6 0x00007ff3621aa604 in kudu::PstackWatcher::DumpStacks (pid=18449) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/pstack_watcher.cc:101 No locals. #7 0x00007ff3621aa161 in kudu::PstackWatcher::DumpStacks () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/pstack_watcher.cc:94 No locals. #8 0x00007ff36a306e80 in KillTestOnTimeout (sigval=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/test_main.cc:58 _s = { state_ = 0x7fffc6ff9910 "\300", } #9 0x00007ff360daa2ac in timer_sigev_thread () from /lib64/librt.so.1 No symbol table info available. #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 4 (Thread 0x7ff352116cc0 (LWP 27042)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 No locals. #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d44001e4a98, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 relative_time = { tv_sec = 0, tv_nsec = 500000000 } absolute_time = { tv_sec = 9076, tv_nsec = 719724138 } now = { tv_sec = 9076, tv_nsec = 219724138 } nsecs = _result = rv = #3 0x00007ff3622143b3 in kudu::ThreadPool::DispatchThread (this=0x7d44001e49c0, permanent=false) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/threadpool.cc:242 entry = { runnable = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 0) 0x7d0c000707d0, trace = 0x0 } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 27042, counter_ = 2, asserter_ = 0x7d0400015250 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 unique_lock = { lock_ = 0x7d44001e49e8, owned_ = true } #4 0x00007ff362215ce6 in boost::_mfi::mf1::operator() (this=, p=, a1=false) at /usr/include/boost/bind/mem_fn_template.hpp:162 No locals. #5 0x00007ff362215c4c in boost::_bi::list2, boost::_bi::value >::operator(), boost::_bi::list0> (this=0x7d0800057e70, f=, a=...) at /usr/include/boost/bind/bind.hpp:306 No locals. #6 0x00007ff362215bd4 in boost::_bi::bind_t, boost::_bi::list2, boost::_bi::value > >::operator() (this=0x7d0800057e60) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #7 0x00007ff3622159d2 in boost::detail::function::void_function_obj_invoker0, boost::_bi::list2, boost::_bi::value > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d380000d9e0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "queue-observers-pool [worker]-140683030654144" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d380000d9e0 } system_tid = loop_count = #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 3 (Thread 0x7ff34e6aecc0 (LWP 27043)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 No locals. #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d4400163858, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 relative_time = { tv_sec = 0, tv_nsec = 500000000 } absolute_time = { tv_sec = 9076, tv_nsec = 719295229 } now = { tv_sec = 9076, tv_nsec = 219295229 } nsecs = _result = rv = #3 0x00007ff3622143b3 in kudu::ThreadPool::DispatchThread (this=0x7d4400163780, permanent=false) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/threadpool.cc:242 entry = { runnable = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 0) 0x7d0c0003b100, trace = 0x0 } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 27043, counter_ = 2, asserter_ = 0x7d040000fa00 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 unique_lock = { lock_ = 0x7d44001637a8, owned_ = true } #4 0x00007ff362215ce6 in boost::_mfi::mf1::operator() (this=, p=, a1=false) at /usr/include/boost/bind/mem_fn_template.hpp:162 No locals. #5 0x00007ff362215c4c in boost::_bi::list2, boost::_bi::value >::operator(), boost::_bi::list0> (this=0x7d0800022750, f=, a=...) at /usr/include/boost/bind/bind.hpp:306 No locals. #6 0x00007ff362215bd4 in boost::_bi::bind_t, boost::_bi::list2, boost::_bi::value > >::operator() (this=0x7d0800022740) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #7 0x00007ff3622159d2 in boost::detail::function::void_function_obj_invoker0, boost::_bi::list2, boost::_bi::value > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800004ec0, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "queue-observers-pool [worker]-140682969410752" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800004ec0 } system_tid = loop_count = #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 2 (Thread 0x7ff34e518cc0 (LWP 27044)): #0 0x00007ff3661d57bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae51ebd in __interceptor_pthread_cond_timedwait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1102 No locals. #2 0x00007ff36216aef4 in kudu::ConditionVariable::TimedWait (this=0x7d4400109498, max_time=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:107 relative_time = { tv_sec = 0, tv_nsec = 500000000 } absolute_time = { tv_sec = 9076, tv_nsec = 721596917 } now = { tv_sec = 9076, tv_nsec = 221596917 } nsecs = _result = rv = #3 0x00007ff3622143b3 in kudu::ThreadPool::DispatchThread (this=0x7d44001093c0, permanent=false) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/threadpool.cc:242 entry = { runnable = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 0) 0x7d0c000529e0, trace = 0x0 } _adopt_trace = { ctor_dtor_ = { valid_thread_id_ = 27044, counter_ = 2, asserter_ = 0x7d0400015220 }, old_trace_ = 0x0 } vlocal__ = 0x7ff36a0f4480 vlocal__ = 0x7ff36a0f4480 unique_lock = { lock_ = 0x7d44001093e8, owned_ = true } #4 0x00007ff362215ce6 in boost::_mfi::mf1::operator() (this=, p=, a1=false) at /usr/include/boost/bind/mem_fn_template.hpp:162 No locals. #5 0x00007ff362215c4c in boost::_bi::list2, boost::_bi::value >::operator(), boost::_bi::list0> (this=0x7d08000ab650, f=, a=...) at /usr/include/boost/bind/bind.hpp:306 No locals. #6 0x00007ff362215bd4 in boost::_bi::bind_t, boost::_bi::list2, boost::_bi::value > >::operator() (this=0x7d08000ab640) at /usr/include/boost/bind/bind_template.hpp:20 a = {} #7 0x00007ff3622159d2 in boost::detail::function::void_function_obj_invoker0, boost::_bi::list2, boost::_bi::value > >, void>::invoke (function_obj_ptr=...) at /usr/include/boost/function/function_template.hpp:153 No locals. #8 0x00007ff3631e4192 in boost::function0::operator() (this=) at /usr/include/boost/function/function_template.hpp:1012 No locals. #9 0x00007ff36220909c in kudu::Thread::SuperviseThread (arg=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/thread.cc:441 __clframe = { __cancel_routine = 0x7ff3622091e0 , __cancel_arg = 0x7d3800004c20, __do_it = 1, __cancel_type = 32755 } occurrences_410 = 0 occurrences_mod_n_410 = 0 name = "queue-observers-pool [worker]-140682967747776" thread_mgr_ref = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 171) 0x7d200000bc00 thread_ref = { ptr_ = 0x7d3800004c20 } system_tid = loop_count = #10 0x00007ff36ae4f395 in __tsan_thread_start_func () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:867 No locals. #11 0x00007ff3661d1851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #12 0x00007ff36035a94d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 1 (Thread 0x7ff36ade1cc0 (LWP 18449)): #0 0x00007ff3661d543c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007ff36ae6bc29 in __interceptor_pthread_cond_wait () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/llvm-3.4.2.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_common_interceptors.inc:2215 No locals. #2 0x00007ff36216ac93 in kudu::ConditionVariable::Wait (this=0x7fffc6ff9340) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/condition_variable.cc:55 rv = _result = #3 0x00007ff36a553806 in kudu::CountDownLatch::Wait (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/countdown_latch.h:59 lock = { lock_ = 0x7fffc6ff9310, owned_ = true } #4 0x00007ff36a54c9ff in kudu::Synchronizer::Wait (this=0x7fffc6ff9308) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/async_util.h:39 No locals. #5 0x00007ff3655309a7 in kudu::client::KuduSession::Flush (this=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/client/client.cc:407 s = { s = { state_ = 0x0 }, l = { lock_ = { native_handle_ = { __data = { __lock = 0, __count = 0, __owner = 0, __nusers = 1, __kind = 2, __spins = 0, __list = { __prev = 0x0, __next = 0x0 } }, __size = '\000' , "\001\000\000\000\002", '\000' , __align = 0 }, owning_tid_ = 0 }, cond_ = { condition_ = { __data = { __lock = 0, __futex = 1, __total_seq = 1, __wakeup_seq = 0, __woken_seq = 0, __mutex = 0x7fffc6ff9310, __nwaiters = 3, __broadcast_seq = 0 }, __size = "\000\000\000\000\001\000\000\000\001", '\000' , "\020\223\377\306\377\177\000\000\003\000\000\000\000\000\000", __align = 4294967296 }, user_mutex_ = 0x7fffc6ff9310, user_lock_ = 0x7fffc6ff9310 }, count_ = 1 } } #6 0x00007ff36aeb4d30 in kudu::tools::RemoteKsckTest::GenerateRowWrites (this=, num_rows=) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tools/ksck_remote-test.cc:109 _s = { state_ = 0x7fffc6ff95e0 "" } vlocal__ = 0x7ff36a0f4480 table = { ptr_ = 0x7d0400033a10 } session = warning: RTTI symbol not found for class 'std::tr1::_Sp_counted_base_impl, (__gnu_cxx::_Lock_policy)2>' std::tr1::shared_ptr (count 1) 0x7d0800085d20 #7 0x00007ff36aeb32ec in kudu::tools::RemoteKsckTest_TestChecksum_Test::TestBody (this=0x7d280000dc00) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/tools/ksck_remote-test.cc:152 _s = { state_ = 0x0 } s = { state_ = 0x7d0c0007c098 "127.0.0.1:49202" } #8 0x00007ff360fec62d in HandleSehExceptionsInMethodIfSupported (object=0x7d280000dc00, method=&virtual testing::Test::TestBody(), location=0x7ff360ff7cf3 "the test body") at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/gmock-1.7.0/gtest/src/gtest.cc:2078 No locals. #9 testing::internal::HandleExceptionsInMethodIfSupported (object=0x7d280000dc00, method=&virtual testing::Test::TestBody(), location=0x7ff360ff7cf3 "the test body") at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/gmock-1.7.0/gtest/src/gtest.cc:2114 No locals. #10 0x00007ff360fddf21 in testing::Test::Run (this=0x7d280000dc00) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/gmock-1.7.0/gtest/src/gtest.cc:2151 impl = 0x7d500000fc00 #11 0x00007ff360fde007 in testing::TestInfo::Run (this=0x7d2c0000ac90) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/gmock-1.7.0/gtest/src/gtest.cc:2326 impl = 0x7d500000fc00 repeater = 0x7d0c0000a170 start = 1424408582314 test = 0x7d280000dc00 #12 0x00007ff360fde147 in testing::TestCase::Run (this=0x7d380000df20) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/gmock-1.7.0/gtest/src/gtest.cc:2444 i = 3 impl = 0x7d500000fc00 repeater = 0x7d0c0000a170 start = 1424408574596 #13 0x00007ff360fe244f in testing::internal::UnitTestImpl::RunAllTests (this=0x7d500000fc00) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/gmock-1.7.0/gtest/src/gtest.cc:4315 test_index = 0 start = 1424408574595 i = 0 should_shard = has_tests_to_run = true repeater = 0x7d0c0000a170 forever = false in_subprocess_for_death_test = failed = false repeat = 1 #14 0x00007ff360fec1bd in HandleSehExceptionsInMethodIfSupported (object=0x7d500000fc00, method=(bool (testing::internal::UnitTestImpl::*)(testing::internal::UnitTestImpl *)) 0x7ff360fe2170 , location=0x7ff360ff8fe8 "auxiliary test code (environments or event listeners)") at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/gmock-1.7.0/gtest/src/gtest.cc:2078 No locals. #15 testing::internal::HandleExceptionsInMethodIfSupported (object=0x7d500000fc00, method=(bool (testing::internal::UnitTestImpl::*)(testing::internal::UnitTestImpl *)) 0x7ff360fe2170 , location=0x7ff360ff8fe8 "auxiliary test code (environments or event listeners)") at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/gmock-1.7.0/gtest/src/gtest.cc:2114 No locals. #16 0x00007ff360fdd5af in testing::UnitTest::Run (this=0x7ff36120bae0) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/gmock-1.7.0/gtest/src/gtest.cc:3929 in_death_test_child_process = premature_exit_file = #17 0x00007ff36a30732c in RUN_ALL_TESTS () at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/thirdparty/gmock-1.7.0/gtest/include/gtest/gtest.h:2288 No locals. #18 0x00007ff36a306b72 in main (argc=1, argv=0x7fffc6ff9a38) at /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/TSAN/label/kudu-gerrit-slaves/src/kudu/util/test_main.cc:34 timerid = 0x7d180000dbc0 sevp = { sigev_value = { sival_int = -956327664, sival_ptr = 0x7fffc6ff9910 }, sigev_signo = 1793848150, sigev_notify = 2, _sigev_un = { _pad = {1781558880, 32755, 0, 0, 0, 0, 1793357539, 32755, 1793368957, 32755, 1793848037, 32755}, _tid = 1781558880, _sigev_thread = { _function = 0x7ff36a306e60 , _attribute = 0x0 } } } its = { it_interval = { tv_sec = 0, tv_nsec = 0 }, it_value = { tv_sec = 900, tv_nsec = 0 } } timerid = 0x7d180000dbc0 ret = #19 0x00007ff360290cdd in __libc_start_main () from /lib64/libc.so.6 No symbol table info available. #20 0x00007ff36aeb28a9 in _start () No symbol table info available. ************************* END STACKS *************************** F0219 21:18:06.240499 27036 test_main.cc:61] Maximum unit test time exceeded (900 sec) *** Check failure stack trace: *** *** Aborted at 1424409486 (unix time) try "date -d @1424409486" if you are using GNU date *** PC: @ 0x7ff3602a48e5 (unknown) *** SIGABRT (@0xfa000004811) received by PID 18449 (TID 0x7ff34e377cc0) from PID 18449; stack trace: *** @ 0x7ff36ae59a0a rtl_sigaction() at ??:0 @ 0x7ff3661d9500 (unknown) at ??:0 @ 0x7ff3602a48e5 (unknown) at ??:0 @ 0x7ff3602a60c5 (unknown) at ??:0 @ 0x7ff36ae58b4b __tsan::cur_thread_placeholder at ??:0 @ 0x7ff369ed0c79 google::logging_fail() at ??:0 @ 0x7ff369ed0bad google::LogMessage::Fail() at ??:0 @ 0x7ff369ed5047 google::LogMessage::SendToLog() at ??:0 @ 0x7ff369ed2ea9 google::LogMessage::Flush() at ??:0 @ 0x7ff369ed31ad google::LogMessageFatal::~LogMessageFatal() at ??:0 @ 0x7ff36a306f68 KillTestOnTimeout() at ??:0 @ 0x7ff360daa2ac (unknown) at ??:0 @ 0x7ff36ae4f395 __tsan::cur_thread_placeholder at ??:0 @ 0x7ff3661d1851 (unknown) at ??:0 @ 0x7ff36035a94d (unknown) at ??:0 @ 0x0 (unknown)