Major Description
Here's the log:
[ RUN ] ClientTest.TestReplicatedMultiTabletTable
I0611 13:51:48.564642 26853 fsmanager.cc:96] Generated new instance metadata in path /data/2/tmp/kudutest-jenkins/ClientTest.TestReplicatedMultiTabletTable.1402519908523199-26853/master-root/instance:
uuid: "e709632110e646cebab1a305f070b5e3"
format_stamp: "Formatted at 2014-06-11 20:51:48 on a1227.halxg.cloudera.com"
I0611 13:51:48.564746 26853 fsmanager.cc:56] Opened local filesystem: /data/2/tmp/kudutest-jenkins/ClientTest.TestReplicatedMultiTabletTable.1402519908523199-26853/master-root
uuid: "e709632110e646cebab1a305f070b5e3"
format_stamp: "Formatted at 2014-06-11 20:51:48 on a1227.halxg.cloudera.com"
I0611 13:51:48.600937 26853 tablet_bootstrap.cc:231] Tablet id 11111111111111111111111111111111: Bootstrap starting.
I0611 13:51:48.601742 26853 tablet_bootstrap.cc:312] No previous blocks or log segments found for tablet: 11111111111111111111111111111111 creating new one.
I0611 13:51:48.602496 26853 tablet_bootstrap.cc:231] Tablet id 11111111111111111111111111111111: No bootstrap required, opened a new log
I0611 13:51:48.669531 26853 tablet_bootstrap.cc:231] Tablet id 00000000000000000000000000000000: Bootstrap starting.
I0611 13:51:48.670689 26853 tablet_bootstrap.cc:312] No previous blocks or log segments found for tablet: 00000000000000000000000000000000 creating new one.
I0611 13:51:48.671536 26853 tablet_bootstrap.cc:231] Tablet id 00000000000000000000000000000000: No bootstrap required, opened a new log
I0611 13:51:48.705873 26853 webserver.cc:105] Starting webserver on 0.0.0.0:0
I0611 13:51:48.705899 26853 webserver.cc:114] Document root disabled
I0611 13:51:48.706115 26853 webserver.cc:194] Webserver started. Bound to: 0.0.0.0:45336
I0611 13:51:48.746970 26853 fsmanager.cc:96] Generated new instance metadata in path /data/2/tmp/kudutest-jenkins/ClientTest.TestReplicatedMultiTabletTable.1402519908523199-26853/ts-0-root/instance:
uuid: "b760d916003249a2b24db5b09df01bcd"
format_stamp: "Formatted at 2014-06-11 20:51:48 on a1227.halxg.cloudera.com"
I0611 13:51:48.753315 26853 fsmanager.cc:56] Opened local filesystem: /data/2/tmp/kudutest-jenkins/ClientTest.TestReplicatedMultiTabletTable.1402519908523199-26853/ts-0-root
uuid: "b760d916003249a2b24db5b09df01bcd"
format_stamp: "Formatted at 2014-06-11 20:51:48 on a1227.halxg.cloudera.com"
I0611 13:51:48.755643 26853 webserver.cc:105] Starting webserver on 0.0.0.0:0
I0611 13:51:48.755661 26853 webserver.cc:114] Document root disabled
I0611 13:51:48.755817 26853 webserver.cc:194] Webserver started. Bound to: 0.0.0.0:47670
I0611 13:51:48.755977 26853 maintenance_manager.cc:97] MaintenanceManager: targetting memory size of 37.702118 GB
I0611 13:51:48.757658 896 heartbeater.cc:226] Registering TS with master...
I0611 13:51:48.757711 896 heartbeater.cc:232] Sending a full tablet report to master...
I0611 13:51:48.758030 868 ts_manager.cc:65] Registered entirely new tablet server: permanent_uuid: "b760d916003249a2b24db5b09df01bcd" instance_seqno: 1402519908753338
I0611 13:51:48.758860 26853 mini_cluster.cc:163] 1 TS(s) registered with Master after 0.00219995s
I0611 13:51:48.760959 870 catalog_manager.cc:381] CreateTable from {real_user=jenkins, eff_user=} at 127.0.0.1:58405:
name: "client-testtb"
schema {
columns {
name: "key"
type: UINT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
}
columns {
name: "int_val"
type: UINT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
}
columns {
name: "non_null_with_default"
type: UINT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
write_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
}
}
pre_split_keys: "\000\000\000\t"
I0611 13:51:48.765164 884 tablet_service.cc:239] Processing CreateTablet for tablet e0b175135099427a91836902cc98caa1 (table=client-testtb [id=9a3419ef46b4469bae4062d529abdbb5]), range=["\x00\x00\x00\t", ""]
I0611 13:51:48.765175 885 tablet_service.cc:239] Processing CreateTablet for tablet 032944b9055e49f1b9d5d3b5f198f817 (table=client-testtb [id=9a3419ef46b4469bae4062d529abdbb5]), range=["", "\x00\x00\x00\t"]
I0611 13:51:48.865655 884 ts_tablet_manager.cc:381] Registered tablet e0b175135099427a91836902cc98caa1
I0611 13:51:48.865685 884 ts_tablet_manager.cc:276] Bootstrapping tablet: e0b175135099427a91836902cc98caa1
I0611 13:51:48.865804 884 tablet_bootstrap.cc:231] Tablet id e0b175135099427a91836902cc98caa1: Bootstrap starting.
I0611 13:51:48.866462 884 tablet_bootstrap.cc:312] No previous blocks or log segments found for tablet: e0b175135099427a91836902cc98caa1 creating new one.
I0611 13:51:48.867274 884 tablet_bootstrap.cc:231] Tablet id e0b175135099427a91836902cc98caa1: No bootstrap required, opened a new log
I0611 13:51:48.867373 884 ts_tablet_manager.cc:281] Times for tablet e0b175135099427a91836902cc98caa1 bootstrap: real 0.002s user 0.001s sys 0.000s
I0611 13:51:48.926830 885 ts_tablet_manager.cc:381] Registered tablet 032944b9055e49f1b9d5d3b5f198f817
I0611 13:51:48.926862 885 ts_tablet_manager.cc:276] Bootstrapping tablet: 032944b9055e49f1b9d5d3b5f198f817
I0611 13:51:48.926993 885 tablet_bootstrap.cc:231] Tablet id 032944b9055e49f1b9d5d3b5f198f817: Bootstrap starting.
I0611 13:51:48.927049 884 ts_tablet_manager.cc:301] Times for tablet e0b175135099427a91836902cc98caa1 startup: real 0.060s user 0.000s sys 0.001s
I0611 13:51:48.927954 885 tablet_bootstrap.cc:312] No previous blocks or log segments found for tablet: 032944b9055e49f1b9d5d3b5f198f817 creating new one.
I0611 13:51:48.928611 885 tablet_bootstrap.cc:231] Tablet id 032944b9055e49f1b9d5d3b5f198f817: No bootstrap required, opened a new log
I0611 13:51:48.928736 885 ts_tablet_manager.cc:281] Times for tablet 032944b9055e49f1b9d5d3b5f198f817 bootstrap: real 0.002s user 0.001s sys 0.001s
I0611 13:51:48.969990 885 ts_tablet_manager.cc:301] Times for tablet 032944b9055e49f1b9d5d3b5f198f817 startup: real 0.041s user 0.002s sys 0.000s
I0611 13:51:48.989573 872 catalog_manager.cc:381] CreateTable from {real_user=jenkins, eff_user=} at 127.0.0.1:58405:
name: "client-testtb2"
schema {
columns {
name: "key"
type: UINT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
}
columns {
name: "int_val"
type: UINT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
}
columns {
name: "non_null_with_default"
type: UINT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
write_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
}
}
I0611 13:51:48.991711 886 tablet_service.cc:239] Processing CreateTablet for tablet d880ff7b11b245b7906b58451c7cc7b6 (table=client-testtb2 [id=37a762b976eb4ccbaad1fa5c01a7f0e4]), range=["", ""]
I0611 13:51:49.071640 886 ts_tablet_manager.cc:381] Registered tablet d880ff7b11b245b7906b58451c7cc7b6
I0611 13:51:49.071668 886 ts_tablet_manager.cc:276] Bootstrapping tablet: d880ff7b11b245b7906b58451c7cc7b6
I0611 13:51:49.071794 886 tablet_bootstrap.cc:231] Tablet id d880ff7b11b245b7906b58451c7cc7b6: Bootstrap starting.
I0611 13:51:49.072633 886 tablet_bootstrap.cc:312] No previous blocks or log segments found for tablet: d880ff7b11b245b7906b58451c7cc7b6 creating new one.
I0611 13:51:49.073498 886 tablet_bootstrap.cc:231] Tablet id d880ff7b11b245b7906b58451c7cc7b6: No bootstrap required, opened a new log
I0611 13:51:49.073613 886 ts_tablet_manager.cc:281] Times for tablet d880ff7b11b245b7906b58451c7cc7b6 bootstrap: real 0.002s user 0.001s sys 0.000s
I0611 13:51:49.114876 886 ts_tablet_manager.cc:301] Times for tablet d880ff7b11b245b7906b58451c7cc7b6 startup: real 0.041s user 0.001s sys 0.001s
I0611 13:51:49.182298 26853 fsmanager.cc:96] Generated new instance metadata in path /data/2/tmp/kudutest-jenkins/ClientTest.TestReplicatedMultiTabletTable.1402519908523199-26853/ts-1-root/instance:
uuid: "daedf67d9a9b459a8f58493e8d7f68f0"
format_stamp: "Formatted at 2014-06-11 20:51:49 on a1227.halxg.cloudera.com"
I0611 13:51:49.188310 26853 fsmanager.cc:56] Opened local filesystem: /data/2/tmp/kudutest-jenkins/ClientTest.TestReplicatedMultiTabletTable.1402519908523199-26853/ts-1-root
uuid: "daedf67d9a9b459a8f58493e8d7f68f0"
format_stamp: "Formatted at 2014-06-11 20:51:49 on a1227.halxg.cloudera.com"
I0611 13:51:49.190940 26853 webserver.cc:105] Starting webserver on 0.0.0.0:0
I0611 13:51:49.190968 26853 webserver.cc:114] Document root disabled
I0611 13:51:49.191203 26853 webserver.cc:194] Webserver started. Bound to: 0.0.0.0:38231
I0611 13:51:49.191426 26853 maintenance_manager.cc:97] MaintenanceManager: targetting memory size of 37.702118 GB
I0611 13:51:49.193688 941 heartbeater.cc:226] Registering TS with master...
I0611 13:51:49.193733 941 heartbeater.cc:232] Sending a full tablet report to master...
I0611 13:51:49.194102 870 ts_manager.cc:65] Registered entirely new tablet server: permanent_uuid: "daedf67d9a9b459a8f58493e8d7f68f0" instance_seqno: 1402519909188331
I0611 13:51:49.241513 26853 fsmanager.cc:96] Generated new instance metadata in path /data/2/tmp/kudutest-jenkins/ClientTest.TestReplicatedMultiTabletTable.1402519908523199-26853/ts-2-root/instance:
uuid: "cc1e2884045d4c0ca59f2c523a6b7ba2"
format_stamp: "Formatted at 2014-06-11 20:51:49 on a1227.halxg.cloudera.com"
I0611 13:51:49.248792 26853 fsmanager.cc:56] Opened local filesystem: /data/2/tmp/kudutest-jenkins/ClientTest.TestReplicatedMultiTabletTable.1402519908523199-26853/ts-2-root
uuid: "cc1e2884045d4c0ca59f2c523a6b7ba2"
format_stamp: "Formatted at 2014-06-11 20:51:49 on a1227.halxg.cloudera.com"
I0611 13:51:49.251348 26853 webserver.cc:105] Starting webserver on 0.0.0.0:0
I0611 13:51:49.251373 26853 webserver.cc:114] Document root disabled
I0611 13:51:49.251616 26853 webserver.cc:194] Webserver started. Bound to: 0.0.0.0:40934
I0611 13:51:49.251801 26853 maintenance_manager.cc:97] MaintenanceManager: targetting memory size of 37.702118 GB
I0611 13:51:49.254380 964 heartbeater.cc:226] Registering TS with master...
I0611 13:51:49.254446 964 heartbeater.cc:232] Sending a full tablet report to master...
I0611 13:51:49.254695 873 ts_manager.cc:65] Registered entirely new tablet server: permanent_uuid: "cc1e2884045d4c0ca59f2c523a6b7ba2" instance_seqno: 1402519909248817
I0611 13:51:49.254780 26853 mini_cluster.cc:163] 3 TS(s) registered with Master after 0.00108594s
I0611 13:51:49.255331 869 catalog_manager.cc:381] CreateTable from {real_user=jenkins, eff_user=} at 127.0.0.1:58405:
name: "replicated"
schema {
columns {
name: "key"
type: UINT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
}
columns {
name: "int_val"
type: UINT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
}
columns {
name: "non_null_with_default"
type: UINT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
write_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
}
}
pre_split_keys: "\000\000\000\t"
num_replicas: 3
I0611 13:51:49.258044 887 tablet_service.cc:239] Processing CreateTablet for tablet 8e316e3ceaca4eb09fa54081298f3c3e (table=replicated [id=e4a930d23ee74508885d47986b42af45]), range=["\x00\x00\x00\t", ""]
I0611 13:51:49.258363 888 tablet_service.cc:239] Processing CreateTablet for tablet fd38b032e4eb4def86e23b57e9016125 (table=replicated [id=e4a930d23ee74508885d47986b42af45]), range=["", "\x00\x00\x00\t"]
I0611 13:51:49.258752 952 tablet_service.cc:239] Processing CreateTablet for tablet 8e316e3ceaca4eb09fa54081298f3c3e (table=replicated [id=e4a930d23ee74508885d47986b42af45]), range=["\x00\x00\x00\t", ""]
I0611 13:51:49.258774 953 tablet_service.cc:239] Processing CreateTablet for tablet fd38b032e4eb4def86e23b57e9016125 (table=replicated [id=e4a930d23ee74508885d47986b42af45]), range=["", "\x00\x00\x00\t"]
I0611 13:51:49.259330 929 tablet_service.cc:239] Processing CreateTablet for tablet 8e316e3ceaca4eb09fa54081298f3c3e (table=replicated [id=e4a930d23ee74508885d47986b42af45]), range=["\x00\x00\x00\t", ""]
I0611 13:51:49.259361 930 tablet_service.cc:239] Processing CreateTablet for tablet fd38b032e4eb4def86e23b57e9016125 (table=replicated [id=e4a930d23ee74508885d47986b42af45]), range=["", "\x00\x00\x00\t"]
I0611 13:51:49.396771 887 ts_tablet_manager.cc:381] Registered tablet 8e316e3ceaca4eb09fa54081298f3c3e
I0611 13:51:49.396772 929 ts_tablet_manager.cc:381] Registered tablet 8e316e3ceaca4eb09fa54081298f3c3e
I0611 13:51:49.396814 887 ts_tablet_manager.cc:276] Bootstrapping tablet: 8e316e3ceaca4eb09fa54081298f3c3e
I0611 13:51:49.396826 929 ts_tablet_manager.cc:276] Bootstrapping tablet: 8e316e3ceaca4eb09fa54081298f3c3e
I0611 13:51:49.396842 930 ts_tablet_manager.cc:381] Registered tablet fd38b032e4eb4def86e23b57e9016125
I0611 13:51:49.396863 930 ts_tablet_manager.cc:276] Bootstrapping tablet: fd38b032e4eb4def86e23b57e9016125
I0611 13:51:49.396860 953 ts_tablet_manager.cc:381] Registered tablet fd38b032e4eb4def86e23b57e9016125
I0611 13:51:49.396872 888 ts_tablet_manager.cc:381] Registered tablet fd38b032e4eb4def86e23b57e9016125
I0611 13:51:49.396878 953 ts_tablet_manager.cc:276] Bootstrapping tablet: fd38b032e4eb4def86e23b57e9016125
I0611 13:51:49.396906 888 ts_tablet_manager.cc:276] Bootstrapping tablet: fd38b032e4eb4def86e23b57e9016125
I0611 13:51:49.396997 887 tablet_bootstrap.cc:231] Tablet id 8e316e3ceaca4eb09fa54081298f3c3e: Bootstrap starting.
I0611 13:51:49.397013 929 tablet_bootstrap.cc:231] Tablet id 8e316e3ceaca4eb09fa54081298f3c3e: Bootstrap starting.
I0611 13:51:49.397018 930 tablet_bootstrap.cc:231] Tablet id fd38b032e4eb4def86e23b57e9016125: Bootstrap starting.
I0611 13:51:49.397104 953 tablet_bootstrap.cc:231] Tablet id fd38b032e4eb4def86e23b57e9016125: Bootstrap starting.
I0611 13:51:49.397258 888 tablet_bootstrap.cc:231] Tablet id fd38b032e4eb4def86e23b57e9016125: Bootstrap starting.
I0611 13:51:49.398381 953 tablet_bootstrap.cc:312] No previous blocks or log segments found for tablet: fd38b032e4eb4def86e23b57e9016125 creating new one.
I0611 13:51:49.398458 930 tablet_bootstrap.cc:312] No previous blocks or log segments found for tablet: fd38b032e4eb4def86e23b57e9016125 creating new one.
I0611 13:51:49.398707 887 tablet_bootstrap.cc:312] No previous blocks or log segments found for tablet: 8e316e3ceaca4eb09fa54081298f3c3e creating new one.
I0611 13:51:49.398746 929 tablet_bootstrap.cc:312] No previous blocks or log segments found for tablet: 8e316e3ceaca4eb09fa54081298f3c3e creating new one.
I0611 13:51:49.399127 930 tablet_bootstrap.cc:231] Tablet id fd38b032e4eb4def86e23b57e9016125: No bootstrap required, opened a new log
I0611 13:51:49.399225 953 tablet_bootstrap.cc:231] Tablet id fd38b032e4eb4def86e23b57e9016125: No bootstrap required, opened a new log
I0611 13:51:49.399253 930 ts_tablet_manager.cc:281] Times for tablet fd38b032e4eb4def86e23b57e9016125 bootstrap: real 0.002s user 0.000s sys 0.002s
I0611 13:51:49.399327 953 ts_tablet_manager.cc:281] Times for tablet fd38b032e4eb4def86e23b57e9016125 bootstrap: real 0.002s user 0.001s sys 0.001s
I0611 13:51:49.399422 888 tablet_bootstrap.cc:312] No previous blocks or log segments found for tablet: fd38b032e4eb4def86e23b57e9016125 creating new one.
I0611 13:51:49.399518 929 tablet_bootstrap.cc:231] Tablet id 8e316e3ceaca4eb09fa54081298f3c3e: No bootstrap required, opened a new log
I0611 13:51:49.399621 887 tablet_bootstrap.cc:231] Tablet id 8e316e3ceaca4eb09fa54081298f3c3e: No bootstrap required, opened a new log
I0611 13:51:49.399708 929 ts_tablet_manager.cc:281] Times for tablet 8e316e3ceaca4eb09fa54081298f3c3e bootstrap: real 0.003s user 0.001s sys 0.001s
I0611 13:51:49.399780 887 ts_tablet_manager.cc:281] Times for tablet 8e316e3ceaca4eb09fa54081298f3c3e bootstrap: real 0.003s user 0.001s sys 0.001s
I0611 13:51:49.400374 930 raft_consensus.cc:54] Created Raft consensus for peer Replica: daedf67d9a9b459a8f58493e8d7f68f0, State: 0, Role: NON_PARTICIPANT
Watermarks: {Received: term: 0 index: 0 Replicated: term: 0 index: 0 Committed: term: 0 index: 0}
Num. outstanding commits: 0 IsLocked: 0
I0611 13:51:49.400380 953 raft_consensus.cc:54] Created Raft consensus for peer Replica: cc1e2884045d4c0ca59f2c523a6b7ba2, State: 0, Role: NON_PARTICIPANT
Watermarks: {Received: term: 0 index: 0 Replicated: term: 0 index: 0 Committed: term: 0 index: 0}
Num. outstanding commits: 0 IsLocked: 0
I0611 13:51:49.400480 953 raft_consensus.cc:68] T fd38b032e4eb4def86e23b57e9016125 P cc1e2884045d4c0ca59f2c523a6b7ba2 [FOLLOWER]: Started. Quorum: seqno: -1 local: false peers { permanent_uuid: "cc1e2884045d4c0ca59f2c523a6b7ba2" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 52537 } } peers { permanent_uuid: "b760d916003249a2b24db5b09df01bcd" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 54810 } } peers { permanent_uuid: "daedf67d9a9b459a8f58493e8d7f68f0" role: LEADER last_known_addr { host: "127.0.0.1" port: 44214 } }
I0611 13:51:49.400605 888 tablet_bootstrap.cc:231] Tablet id fd38b032e4eb4def86e23b57e9016125: No bootstrap required, opened a new log
I0611 13:51:49.400378 929 raft_consensus.cc:54] Created Raft consensus for peer Replica: daedf67d9a9b459a8f58493e8d7f68f0, State: 0, Role: NON_PARTICIPANT
Watermarks: {Received: term: 0 index: 0 Replicated: term: 0 index: 0 Committed: term: 0 index: 0}
Num. outstanding commits: 0 IsLocked: 0
I0611 13:51:49.400735 929 raft_consensus.cc:68] T 8e316e3ceaca4eb09fa54081298f3c3e P daedf67d9a9b459a8f58493e8d7f68f0 [FOLLOWER]: Started. Quorum: seqno: -1 local: false peers { permanent_uuid: "cc1e2884045d4c0ca59f2c523a6b7ba2" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 52537 } } peers { permanent_uuid: "b760d916003249a2b24db5b09df01bcd" role: LEADER last_known_addr { host: "127.0.0.1" port: 54810 } } peers { permanent_uuid: "daedf67d9a9b459a8f58493e8d7f68f0" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 44214 } }
I0611 13:51:49.400739 888 ts_tablet_manager.cc:281] Times for tablet fd38b032e4eb4def86e23b57e9016125 bootstrap: real 0.004s user 0.001s sys 0.001s
I0611 13:51:49.400825 888 raft_consensus.cc:54] Created Raft consensus for peer Replica: b760d916003249a2b24db5b09df01bcd, State: 0, Role: NON_PARTICIPANT
Watermarks: {Received: term: 0 index: 0 Replicated: term: 0 index: 0 Committed: term: 0 index: 0}
Num. outstanding commits: 0 IsLocked: 0
I0611 13:51:49.400904 930 raft_consensus.cc:169] T fd38b032e4eb4def86e23b57e9016125 P daedf67d9a9b459a8f58493e8d7f68f0 [LEADER]: ChangeConfiguration(op=term: 0 index: 1, seqno=0): replicating to peers...
I0611 13:51:49.400910 888 raft_consensus.cc:68] T fd38b032e4eb4def86e23b57e9016125 P b760d916003249a2b24db5b09df01bcd [FOLLOWER]: Started. Quorum: seqno: -1 local: false peers { permanent_uuid: "cc1e2884045d4c0ca59f2c523a6b7ba2" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 52537 } } peers { permanent_uuid: "b760d916003249a2b24db5b09df01bcd" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 54810 } } peers { permanent_uuid: "daedf67d9a9b459a8f58493e8d7f68f0" role: LEADER last_known_addr { host: "127.0.0.1" port: 44214 } }
I0611 13:51:49.400943 887 raft_consensus.cc:54] Created Raft consensus for peer Replica: b760d916003249a2b24db5b09df01bcd, State: 0, Role: NON_PARTICIPANT
Watermarks: {Received: term: 0 index: 0 Replicated: term: 0 index: 0 Committed: term: 0 index: 0}
Num. outstanding commits: 0 IsLocked: 0
I0611 13:51:49.401487 887 raft_consensus.cc:169] T 8e316e3ceaca4eb09fa54081298f3c3e P b760d916003249a2b24db5b09df01bcd [LEADER]: ChangeConfiguration(op=term: 0 index: 1, seqno=0): replicating to peers...
W0611 13:51:49.402269 925 consensus_peers.cc:387] Couldn't send request to peer: cc1e2884045d4c0ca59f2c523a6b7ba2 Status: Service unavailable: Tablet not RUNNING: CONFIGURING. Retrying in the next heartbeat period. Already tried 1 times.
W0611 13:51:49.402426 926 consensus_peers.cc:387] Couldn't send request to peer: b760d916003249a2b24db5b09df01bcd Status: Service unavailable: Tablet not RUNNING: CONFIGURING. Retrying in the next heartbeat period. Already tried 1 times.
W0611 13:51:49.402838 880 consensus_peers.cc:387] Couldn't send request to peer: cc1e2884045d4c0ca59f2c523a6b7ba2 Status: Not found: Tablet not found. Retrying in the next heartbeat period. Already tried 1 times.
W0611 13:51:49.402854 883 consensus_peers.cc:387] Couldn't send request to peer: daedf67d9a9b459a8f58493e8d7f68f0 Status: Service unavailable: Tablet not RUNNING: CONFIGURING. Retrying in the next heartbeat period. Already tried 1 times.
I0611 13:51:49.504879 952 ts_tablet_manager.cc:381] Registered tablet 8e316e3ceaca4eb09fa54081298f3c3e
I0611 13:51:49.504925 952 ts_tablet_manager.cc:276] Bootstrapping tablet: 8e316e3ceaca4eb09fa54081298f3c3e
I0611 13:51:49.505007 953 ts_tablet_manager.cc:301] Times for tablet fd38b032e4eb4def86e23b57e9016125 startup: real 0.106s user 0.001s sys 0.001s
I0611 13:51:49.505110 929 ts_tablet_manager.cc:301] Times for tablet 8e316e3ceaca4eb09fa54081298f3c3e startup: real 0.105s user 0.001s sys 0.000s
I0611 13:51:49.505403 888 ts_tablet_manager.cc:301] Times for tablet fd38b032e4eb4def86e23b57e9016125 startup: real 0.105s user 0.000s sys 0.002s
I0611 13:51:49.507020 952 tablet_bootstrap.cc:231] Tablet id 8e316e3ceaca4eb09fa54081298f3c3e: Bootstrap starting.
I0611 13:51:49.508847 952 tablet_bootstrap.cc:312] No previous blocks or log segments found for tablet: 8e316e3ceaca4eb09fa54081298f3c3e creating new one.
I0611 13:51:49.509618 952 tablet_bootstrap.cc:231] Tablet id 8e316e3ceaca4eb09fa54081298f3c3e: No bootstrap required, opened a new log
I0611 13:51:49.509729 952 ts_tablet_manager.cc:281] Times for tablet 8e316e3ceaca4eb09fa54081298f3c3e bootstrap: real 0.005s user 0.003s sys 0.000s
I0611 13:51:49.509876 952 raft_consensus.cc:54] Created Raft consensus for peer Replica: cc1e2884045d4c0ca59f2c523a6b7ba2, State: 0, Role: NON_PARTICIPANT
Watermarks: {Received: term: 0 index: 0 Replicated: term: 0 index: 0 Committed: term: 0 index: 0}
Num. outstanding commits: 0 IsLocked: 0
I0611 13:51:49.510280 952 raft_consensus.cc:68] T 8e316e3ceaca4eb09fa54081298f3c3e P cc1e2884045d4c0ca59f2c523a6b7ba2 [FOLLOWER]: Started. Quorum: seqno: -1 local: false peers { permanent_uuid: "cc1e2884045d4c0ca59f2c523a6b7ba2" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 52537 } } peers { permanent_uuid: "b760d916003249a2b24db5b09df01bcd" role: LEADER last_known_addr { host: "127.0.0.1" port: 54810 } } peers { permanent_uuid: "daedf67d9a9b459a8f58493e8d7f68f0" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 44214 } }
I0611 13:51:49.569996 952 ts_tablet_manager.cc:301] Times for tablet 8e316e3ceaca4eb09fa54081298f3c3e startup: real 0.060s user 0.000s sys 0.000s
I0611 13:51:49.902266 887 raft_consensus.cc:181] T 8e316e3ceaca4eb09fa54081298f3c3e P b760d916003249a2b24db5b09df01bcd [LEADER]: ChangeConfiguration(op=term: 0 index: 1, seqno=0): committing...
I0611 13:51:49.902488 930 raft_consensus.cc:181] T fd38b032e4eb4def86e23b57e9016125 P daedf67d9a9b459a8f58493e8d7f68f0 [LEADER]: ChangeConfiguration(op=term: 0 index: 1, seqno=0): committing...
I0611 13:51:49.903084 887 raft_consensus.cc:204] T 8e316e3ceaca4eb09fa54081298f3c3e P b760d916003249a2b24db5b09df01bcd [LEADER]: ChangeConfiguration(op=term: 0 index: 1, seqno=0): a majority of peers have accepted the new configuration. Proceeding.
I0611 13:51:49.903172 887 raft_consensus.cc:68] T 8e316e3ceaca4eb09fa54081298f3c3e P b760d916003249a2b24db5b09df01bcd [LEADER]: Started. Quorum: seqno: 0 local: false peers { permanent_uuid: "cc1e2884045d4c0ca59f2c523a6b7ba2" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 52537 } } peers { permanent_uuid: "b760d916003249a2b24db5b09df01bcd" role: LEADER last_known_addr { host: "127.0.0.1" port: 54810 } } peers { permanent_uuid: "daedf67d9a9b459a8f58493e8d7f68f0" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 44214 } }
I0611 13:51:49.903177 930 raft_consensus.cc:204] T fd38b032e4eb4def86e23b57e9016125 P daedf67d9a9b459a8f58493e8d7f68f0 [LEADER]: ChangeConfiguration(op=term: 0 index: 1, seqno=0): a majority of peers have accepted the new configuration. Proceeding.
I0611 13:51:49.903239 930 raft_consensus.cc:68] T fd38b032e4eb4def86e23b57e9016125 P daedf67d9a9b459a8f58493e8d7f68f0 [LEADER]: Started. Quorum: seqno: 0 local: false peers { permanent_uuid: "cc1e2884045d4c0ca59f2c523a6b7ba2" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 52537 } } peers { permanent_uuid: "b760d916003249a2b24db5b09df01bcd" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 54810 } } peers { permanent_uuid: "daedf67d9a9b459a8f58493e8d7f68f0" role: LEADER last_known_addr { host: "127.0.0.1" port: 44214 } }
I0611 13:51:54.008699 897 maintenance_manager.cc:300] MaintenanceManager ran CompactRowSetsOp(e0b175135099427a91836902cc98caa1) in 3.5463e-05s
I0611 13:51:54.012612 930 ts_tablet_manager.cc:301] Times for tablet fd38b032e4eb4def86e23b57e9016125 startup: real 4.613s user 0.001s sys 0.002s
I0611 13:51:54.012619 887 ts_tablet_manager.cc:301] Times for tablet 8e316e3ceaca4eb09fa54081298f3c3e startup: real 4.613s user 0.002s sys 0.001s
I0611 13:51:54.258816 901 maintenance_manager.cc:300] MaintenanceManager ran CompactRowSetsOp(032944b9055e49f1b9d5d3b5f198f817) in 2.6182e-05s
I0611 13:51:54.506162 965 maintenance_manager.cc:300] MaintenanceManager ran CompactRowSetsOp(fd38b032e4eb4def86e23b57e9016125) in 3.1592e-05s
I0611 13:51:54.508775 898 maintenance_manager.cc:300] MaintenanceManager ran CompactRowSetsOp(d880ff7b11b245b7906b58451c7cc7b6) in 1.8345e-05s
I0611 13:51:54.694706 942 maintenance_manager.cc:300] MaintenanceManager ran CompactRowSetsOp(8e316e3ceaca4eb09fa54081298f3c3e) in 2.0715e-05s
I0611 13:51:54.756211 969 maintenance_manager.cc:300] MaintenanceManager ran CompactRowSetsOp(8e316e3ceaca4eb09fa54081298f3c3e) in 1.8848e-05s
I0611 13:51:54.758811 899 maintenance_manager.cc:300] MaintenanceManager ran CompactRowSetsOp(fd38b032e4eb4def86e23b57e9016125) in 2.1025e-05s
W0611 13:51:54.901053 27110 kernel_stack_watchdog.cc:87] Thread 979 stuck at /var/lib/jenkins/workspace/kudu-gerrit/BUILD_TYPE/DEBUG/label/centos6-kudu/src/consensus/log.cc:440 for 576ms:
[<ffffffffa005f408>] jbd2_log_do_checkpoint+0x5f8/0x6e0 [jbd2]
[<ffffffffa005ae23>] start_this_handle+0x113/0x4d0 [jbd2]
[<ffffffffa005b3c5>] jbd2_journal_start+0xb5/0x100 [jbd2]
[<ffffffffa009d208>] ext4_journal_start_sb+0x58/0x90 [ext4]
[<ffffffffa00845aa>] ext4_dirty_inode+0x2a/0x60 [ext4]
[<ffffffff8119fe4b>] __mark_inode_dirty+0x3b/0x160
[<ffffffff811903c2>] file_update_time+0xf2/0x170
[<ffffffff81112d30>] __generic_file_aio_write+0x220/0x480
[<ffffffff81112fff>] generic_file_aio_write+0x6f/0xe0
[<ffffffffa007dde1>] ext4_file_write+0x61/0x1e0 [ext4]
[<ffffffff811762da>] do_sync_write+0xfa/0x140
[<ffffffff811765d8>] vfs_write+0xb8/0x1a0
[<ffffffff81176fe1>] sys_write+0x51/0x90
[<ffffffff8100b0f2>] system_call_fastpath+0x16/0x1b
[<ffffffffffffffff>] 0xffffffffffffffff
W0611 13:51:54.901160 27110 kernel_stack_watchdog.cc:87] Thread 1002 stuck at /var/lib/jenkins/workspace/kudu-gerrit/BUILD_TYPE/DEBUG/label/centos6-kudu/src/consensus/log.cc:440 for 575ms:
[<ffffffffa005f408>] jbd2_log_do_checkpoint+0x5f8/0x6e0 [jbd2]
[<ffffffffa005ae23>] start_this_handle+0x113/0x4d0 [jbd2]
[<ffffffffa005b3c5>] jbd2_journal_start+0xb5/0x100 [jbd2]
[<ffffffffa009d208>] ext4_journal_start_sb+0x58/0x90 [ext4]
[<ffffffffa00845aa>] ext4_dirty_inode+0x2a/0x60 [ext4]
[<ffffffff8119fe4b>] __mark_inode_dirty+0x3b/0x160
[<ffffffff811903c2>] file_update_time+0xf2/0x170
[<ffffffff81112d30>] __generic_file_aio_write+0x220/0x480
[<ffffffff81112fff>] generic_file_aio_write+0x6f/0xe0
[<ffffffffa007dde1>] ext4_file_write+0x61/0x1e0 [ext4]
[<ffffffff811762da>] do_sync_write+0xfa/0x140
[<ffffffff811765d8>] vfs_write+0xb8/0x1a0
[<ffffffff81176fe1>] sys_write+0x51/0x90
[<ffffffff8100b0f2>] system_call_fastpath+0x16/0x1b
[<ffffffffffffffff>] 0xffffffffffffffff
W0611 13:51:54.901262 27110 kernel_stack_watchdog.cc:87] Thread 981 stuck at /var/lib/jenkins/workspace/kudu-gerrit/BUILD_TYPE/DEBUG/label/centos6-kudu/src/consensus/log.cc:440 for 576ms:
[<ffffffffa005f408>] jbd2_log_do_checkpoint+0x5f8/0x6e0 [jbd2]
[<ffffffffa005ae23>] start_this_handle+0x113/0x4d0 [jbd2]
[<ffffffffa005b3c5>] jbd2_journal_start+0xb5/0x100 [jbd2]
[<ffffffffa009d208>] ext4_journal_start_sb+0x58/0x90 [ext4]
[<ffffffffa00845aa>] ext4_dirty_inode+0x2a/0x60 [ext4]
[<ffffffff8119fe4b>] __mark_inode_dirty+0x3b/0x160
[<ffffffff811903c2>] file_update_time+0xf2/0x170
[<ffffffff81112d30>] __generic_file_aio_write+0x220/0x480
[<ffffffff81112fff>] generic_file_aio_write+0x6f/0xe0
[<ffffffffa007dde1>] ext4_file_write+0x61/0x1e0 [ext4]
[<ffffffff811762da>] do_sync_write+0xfa/0x140
[<ffffffff811765d8>] vfs_write+0xb8/0x1a0
[<ffffffff81176fe1>] sys_write+0x51/0x90
[<ffffffff8100b0f2>] system_call_fastpath+0x16/0x1b
[<ffffffffffffffff>] 0xffffffffffffffff
W0611 13:51:54.901357 27110 kernel_stack_watchdog.cc:87] Thread 982 stuck at /var/lib/jenkins/workspace/kudu-gerrit/BUILD_TYPE/DEBUG/label/centos6-kudu/src/consensus/log.cc:440 for 576ms:
[<ffffffffa005f408>] jbd2_log_do_checkpoint+0x5f8/0x6e0 [jbd2]
[<ffffffffa005ae23>] start_this_handle+0x113/0x4d0 [jbd2]
[<ffffffffa005b3c5>] jbd2_journal_start+0xb5/0x100 [jbd2]
[<ffffffffa009d208>] ext4_journal_start_sb+0x58/0x90 [ext4]
[<ffffffffa00845aa>] ext4_dirty_inode+0x2a/0x60 [ext4]
[<ffffffff8119fe4b>] __mark_inode_dirty+0x3b/0x160
[<ffffffff811903c2>] file_update_time+0xf2/0x170
[<ffffffff81112d30>] __generic_file_aio_write+0x220/0x480
[<ffffffff81112fff>] generic_file_aio_write+0x6f/0xe0
[<ffffffffa007dde1>] ext4_file_write+0x61/0x1e0 [ext4]
[<ffffffff811762da>] do_sync_write+0xfa/0x140
[<ffffffff811765d8>] vfs_write+0xb8/0x1a0
[<ffffffff81176fe1>] sys_write+0x51/0x90
[<ffffffff8100b0f2>] system_call_fastpath+0x16/0x1b
[<ffffffffffffffff>] 0xffffffffffffffff
W0611 13:51:54.901454 27110 kernel_stack_watchdog.cc:87] Thread 983 stuck at /var/lib/jenkins/workspace/kudu-gerrit/BUILD_TYPE/DEBUG/label/centos6-kudu/src/consensus/log.cc:440 for 576ms:
[<ffffffffa005f408>] jbd2_log_do_checkpoint+0x5f8/0x6e0 [jbd2]
[<ffffffffa005ae23>] start_this_handle+0x113/0x4d0 [jbd2]
[<ffffffffa005b3c5>] jbd2_journal_start+0xb5/0x100 [jbd2]
[<ffffffffa009d208>] ext4_journal_start_sb+0x58/0x90 [ext4]
[<ffffffffa00845aa>] ext4_dirty_inode+0x2a/0x60 [ext4]
[<ffffffff8119fe4b>] __mark_inode_dirty+0x3b/0x160
[<ffffffff811903c2>] file_update_time+0xf2/0x170
[<ffffffff81112d30>] __generic_file_aio_write+0x220/0x480
[<ffffffff81112fff>] generic_file_aio_write+0x6f/0xe0
[<ffffffffa007dde1>] ext4_file_write+0x61/0x1e0 [ext4]
[<ffffffff811762da>] do_sync_write+0xfa/0x140
[<ffffffff811765d8>] vfs_write+0xb8/0x1a0
[<ffffffff81176fe1>] sys_write+0x51/0x90
[<ffffffff8100b0f2>] system_call_fastpath+0x16/0x1b
[<ffffffffffffffff>] 0xffffffffffffffff
W0611 13:51:54.901547 27110 kernel_stack_watchdog.cc:87] Thread 985 stuck at /var/lib/jenkins/workspace/kudu-gerrit/BUILD_TYPE/DEBUG/label/centos6-kudu/src/consensus/log.cc:440 for 576ms:
[<ffffffffa005f408>] jbd2_log_do_checkpoint+0x5f8/0x6e0 [jbd2]
[<ffffffffa005ae23>] start_this_handle+0x113/0x4d0 [jbd2]
[<ffffffffa005b3c5>] jbd2_journal_start+0xb5/0x100 [jbd2]
[<ffffffffa009d208>] ext4_journal_start_sb+0x58/0x90 [ext4]
[<ffffffffa00845aa>] ext4_dirty_inode+0x2a/0x60 [ext4]
[<ffffffff8119fe4b>] __mark_inode_dirty+0x3b/0x160
[<ffffffff811903c2>] file_update_time+0xf2/0x170
[<ffffffff81112d30>] __generic_file_aio_write+0x220/0x480
[<ffffffff81112fff>] generic_file_aio_write+0x6f/0xe0
[<ffffffffa007dde1>] ext4_file_write+0x61/0x1e0 [ext4]
[<ffffffff811762da>] do_sync_write+0xfa/0x140
[<ffffffff811765d8>] vfs_write+0xb8/0x1a0
[<ffffffff81176fe1>] sys_write+0x51/0x90
[<ffffffff8100b0f2>] system_call_fastpath+0x16/0x1b
[<ffffffffffffffff>] 0xffffffffffffffff
W0611 13:51:55.101096 27110 kernel_stack_watchdog.cc:87] Thread 979 stuck at /var/lib/jenkins/workspace/kudu-gerrit/BUILD_TYPE/DEBUG/label/centos6-kudu/src/consensus/log.cc:440 for 776ms:
[<ffffffffa005f408>] jbd2_log_do_checkpoint+0x5f8/0x6e0 [jbd2]
[<ffffffffa005ae23>] start_this_handle+0x113/0x4d0 [jbd2]
[<ffffffffa005b3c5>] jbd2_journal_start+0xb5/0x100 [jbd2]
[<ffffffffa009d208>] ext4_journal_start_sb+0x58/0x90 [ext4]
[<ffffffffa00845aa>] ext4_dirty_inode+0x2a/0x60 [ext4]
[<ffffffff8119fe4b>] __mark_inode_dirty+0x3b/0x160
[<ffffffff811903c2>] file_update_time+0xf2/0x170
[<ffffffff81112d30>] __generic_file_aio_write+0x220/0x480
[<ffffffff81112fff>] generic_file_aio_write+0x6f/0xe0
[<ffffffffa007dde1>] ext4_file_write+0x61/0x1e0 [ext4]
[<ffffffff811762da>] do_sync_write+0xfa/0x140
[<ffffffff811765d8>] vfs_write+0xb8/0x1a0
[<ffffffff81176fe1>] sys_write+0x51/0x90
[<ffffffff8100b0f2>] system_call_fastpath+0x16/0x1b
[<ffffffffffffffff>] 0xffffffffffffffff
W0611 13:51:55.101218 27110 kernel_stack_watchdog.cc:87] Thread 1002 stuck at /var/lib/jenkins/workspace/kudu-gerrit/BUILD_TYPE/DEBUG/label/centos6-kudu/src/consensus/log.cc:440 for 775ms:
[<ffffffffa005f408>] jbd2_log_do_checkpoint+0x5f8/0x6e0 [jbd2]
[<ffffffffa005ae23>] start_this_handle+0x113/0x4d0 [jbd2]
[<ffffffffa005b3c5>] jbd2_journal_start+0xb5/0x100 [jbd2]
[<ffffffffa009d208>] ext4_journal_start_sb+0x58/0x90 [ext4]
[<ffffffffa00845aa>] ext4_dirty_inode+0x2a/0x60 [ext4]
[<ffffffff8119fe4b>] __mark_inode_dirty+0x3b/0x160
[<ffffffff811903c2>] file_update_time+0xf2/0x170
[<ffffffff81112d30>] __generic_file_aio_write+0x220/0x480
[<ffffffff81112fff>] generic_file_aio_write+0x6f/0xe0
[<ffffffffa007dde1>] ext4_file_write+0x61/0x1e0 [ext4]
[<ffffffff811762da>] do_sync_write+0xfa/0x140
[<ffffffff811765d8>] vfs_write+0xb8/0x1a0
[<ffffffff81176fe1>] sys_write+0x51/0x90
[<ffffffff8100b0f2>] system_call_fastpath+0x16/0x1b
[<ffffffffffffffff>] 0xffffffffffffffff
W0611 13:51:55.101336 27110 kernel_stack_watchdog.cc:87] Thread 981 stuck at /var/lib/jenkins/workspace/kudu-gerrit/BUILD_TYPE/DEBUG/label/centos6-kudu/src/consensus/log.cc:440 for 776ms:
[<ffffffffa005f408>] jbd2_log_do_checkpoint+0x5f8/0x6e0 [jbd2]
[<ffffffffa005ae23>] start_this_handle+0x113/0x4d0 [jbd2]
[<ffffffffa005b3c5>] jbd2_journal_start+0xb5/0x100 [jbd2]
[<ffffffffa009d208>] ext4_journal_start_sb+0x58/0x90 [ext4]
[<ffffffffa00845aa>] ext4_dirty_inode+0x2a/0x60 [ext4]
[<ffffffff8119fe4b>] __mark_inode_dirty+0x3b/0x160
[<ffffffff811903c2>] file_update_time+0xf2/0x170
[<ffffffff81112d30>] __generic_file_aio_write+0x220/0x480
[<ffffffff81112fff>] generic_file_aio_write+0x6f/0xe0
[<ffffffffa007dde1>] ext4_file_write+0x61/0x1e0 [ext4]
[<ffffffff811762da>] do_sync_write+0xfa/0x140
[<ffffffff811765d8>] vfs_write+0xb8/0x1a0
[<ffffffff81176fe1>] sys_write+0x51/0x90
[<ffffffff8100b0f2>] system_call_fastpath+0x16/0x1b
[<ffffffffffffffff>] 0xffffffffffffffff
W0611 13:51:55.101450 27110 kernel_stack_watchdog.cc:87] Thread 982 stuck at /var/lib/jenkins/workspace/kudu-gerrit/BUILD_TYPE/DEBUG/label/centos6-kudu/src/consensus/log.cc:440 for 776ms:
[<ffffffffa005f408>] jbd2_log_do_checkpoint+0x5f8/0x6e0 [jbd2]
[<ffffffffa005ae23>] start_this_handle+0x113/0x4d0 [jbd2]
[<ffffffffa005b3c5>] jbd2_journal_start+0xb5/0x100 [jbd2]
[<ffffffffa009d208>] ext4_journal_start_sb+0x58/0x90 [ext4]
[<ffffffffa00845aa>] ext4_dirty_inode+0x2a/0x60 [ext4]
[<ffffffff8119fe4b>] __mark_inode_dirty+0x3b/0x160
[<ffffffff811903c2>] file_update_time+0xf2/0x170
[<ffffffff81112d30>] __generic_file_aio_write+0x220/0x480
[<ffffffff81112fff>] generic_file_aio_write+0x6f/0xe0
[<ffffffffa007dde1>] ext4_file_write+0x61/0x1e0 [ext4]
[<ffffffff811762da>] do_sync_write+0xfa/0x140
[<ffffffff811765d8>] vfs_write+0xb8/0x1a0
[<ffffffff81176fe1>] sys_write+0x51/0x90
[<ffffffff8100b0f2>] system_call_fastpath+0x16/0x1b
[<ffffffffffffffff>] 0xffffffffffffffff
W0611 13:51:55.101565 27110 kernel_stack_watchdog.cc:87] Thread 983 stuck at /var/lib/jenkins/workspace/kudu-gerrit/BUILD_TYPE/DEBUG/label/centos6-kudu/src/consensus/log.cc:440 for 776ms:
[<ffffffffa005f408>] jbd2_log_do_checkpoint+0x5f8/0x6e0 [jbd2]
[<ffffffffa005ae23>] start_this_handle+0x113/0x4d0 [jbd2]
[<ffffffffa005b3c5>] jbd2_journal_start+0xb5/0x100 [jbd2]
[<ffffffffa009d208>] ext4_journal_start_sb+0x58/0x90 [ext4]
[<ffffffffa00845aa>] ext4_dirty_inode+0x2a/0x60 [ext4]
[<ffffffff8119fe4b>] __mark_inode_dirty+0x3b/0x160
[<ffffffff811903c2>] file_update_time+0xf2/0x170
[<ffffffff81112d30>] __generic_file_aio_write+0x220/0x480
[<ffffffff81112fff>] generic_file_aio_write+0x6f/0xe0
[<ffffffffa007dde1>] ext4_file_write+0x61/0x1e0 [ext4]
[<ffffffff811762da>] do_sync_write+0xfa/0x140
[<ffffffff811765d8>] vfs_write+0xb8/0x1a0
[<ffffffff81176fe1>] sys_write+0x51/0x90
[<ffffffff8100b0f2>] system_call_fastpath+0x16/0x1b
[<ffffffffffffffff>] 0xffffffffffffffff
W0611 13:51:55.101680 27110 kernel_stack_watchdog.cc:87] Thread 985 stuck at /var/lib/jenkins/workspace/kudu-gerrit/BUILD_TYPE/DEBUG/label/centos6-kudu/src/consensus/log.cc:440 for 776ms:
[<ffffffffa005f408>] jbd2_log_do_checkpoint+0x5f8/0x6e0 [jbd2]
[<ffffffffa005ae23>] start_this_handle+0x113/0x4d0 [jbd2]
[<ffffffffa005b3c5>] jbd2_journal_start+0xb5/0x100 [jbd2]
[<ffffffffa009d208>] ext4_journal_start_sb+0x58/0x90 [ext4]
[<ffffffffa00845aa>] ext4_dirty_inode+0x2a/0x60 [ext4]
[<ffffffff8119fe4b>] __mark_inode_dirty+0x3b/0x160
[<ffffffff811903c2>] file_update_time+0xf2/0x170
[<ffffffff81112d30>] __generic_file_aio_write+0x220/0x480
[<ffffffff81112fff>] generic_file_aio_write+0x6f/0xe0
[<ffffffffa007dde1>] ext4_file_write+0x61/0x1e0 [ext4]
[<ffffffff811762da>] do_sync_write+0xfa/0x140
[<ffffffff811765d8>] vfs_write+0xb8/0x1a0
[<ffffffff81176fe1>] sys_write+0x51/0x90
[<ffffffff8100b0f2>] system_call_fastpath+0x16/0x1b
[<ffffffffffffffff>] 0xffffffffffffffff
W0611 13:51:55.245689 979 log.cc:438] Times for Append to log took a long time: real 0.921s user 0.000s sys 0.000s
W0611 13:51:55.245692 983 log.cc:438] Times for Append to log took a long time: real 0.921s user 0.000s sys 0.000s
W0611 13:51:55.301220 27110 kernel_stack_watchdog.cc:87] Thread 1002 stuck at /var/lib/jenkins/workspace/kudu-gerrit/BUILD_TYPE/DEBUG/label/centos6-kudu/src/consensus/log.cc:440 for 976ms:
[<ffffffff811a9460>] sync_buffer+0x40/0x50
[<ffffffff811a9606>] __lock_buffer+0x36/0x40
[<ffffffffa005c293>] do_get_write_access+0x493/0x520 [jbd2]
[<ffffffffa005c471>] jbd2_journal_get_write_access+0x31/0x50 [jbd2]
[<ffffffffa00a8b78>] __ext4_journal_get_write_access+0x38/0x80 [ext4]
[<ffffffffa0084253>] ext4_reserve_inode_write+0x73/0xa0 [ext4]
[<ffffffffa00842cc>] ext4_mark_inode_dirty+0x4c/0x1d0 [ext4]
[<ffffffffa00845c0>] ext4_dirty_inode+0x40/0x60 [ext4]
[<ffffffff8119fe4b>] __mark_inode_dirty+0x3b/0x160
[<ffffffff811903c2>] file_update_time+0xf2/0x170
[<ffffffff81112d30>] __generic_file_aio_write+0x220/0x480
[<ffffffff81112fff>] generic_file_aio_write+0x6f/0xe0
[<ffffffffa007dde1>] ext4_file_write+0x61/0x1e0 [ext4]
[<ffffffff811762da>] do_sync_write+0xfa/0x140
[<ffffffff811765d8>] vfs_write+0xb8/0x1a0
[<ffffffff81176fe1>] sys_write+0x51/0x90
[<ffffffff8100b0f2>] system_call_fastpath+0x16/0x1b
[<ffffffffffffffff>] 0xffffffffffffffff
W0611 13:51:55.301358 27110 kernel_stack_watchdog.cc:87] Thread 981 stuck at /var/lib/jenkins/workspace/kudu-gerrit/BUILD_TYPE/DEBUG/label/centos6-kudu/src/consensus/log.cc:440 for 976ms:
[<ffffffff811a9460>] sync_buffer+0x40/0x50
[<ffffffff811a9606>] __lock_buffer+0x36/0x40
[<ffffffffa005c293>] do_get_write_access+0x493/0x520 [jbd2]
[<ffffffffa005c471>] jbd2_journal_get_write_access+0x31/0x50 [jbd2]
[<ffffffffa00a8b78>] __ext4_journal_get_write_access+0x38/0x80 [ext4]
[<ffffffffa0084253>] ext4_reserve_inode_write+0x73/0xa0 [ext4]
[<ffffffffa00842cc>] ext4_mark_inode_dirty+0x4c/0x1d0 [ext4]
[<ffffffffa00845c0>] ext4_dirty_inode+0x40/0x60 [ext4]
[<ffffffff8119fe4b>] __mark_inode_dirty+0x3b/0x160
[<ffffffff811903c2>] file_update_time+0xf2/0x170
[<ffffffff81112d30>] __generic_file_aio_write+0x220/0x480
[<ffffffff81112fff>] generic_file_aio_write+0x6f/0xe0
[<ffffffffa007dde1>] ext4_file_write+0x61/0x1e0 [ext4]
[<ffffffff811762da>] do_sync_write+0xfa/0x140
[<ffffffff811765d8>] vfs_write+0xb8/0x1a0
[<ffffffff81176fe1>] sys_write+0x51/0x90
[<ffffffff8100b0f2>] system_call_fastpath+0x16/0x1b
[<ffffffffffffffff>] 0xffffffffffffffff
W0611 13:51:55.301487 27110 kernel_stack_watchdog.cc:87] Thread 982 stuck at /var/lib/jenkins/workspace/kudu-gerrit/BUILD_TYPE/DEBUG/label/centos6-kudu/src/consensus/log.cc:440 for 976ms:
[<ffffffff811a9460>] sync_buffer+0x40/0x50
[<ffffffff811a9606>] __lock_buffer+0x36/0x40
[<ffffffffa005c293>] do_get_write_access+0x493/0x520 [jbd2]
[<ffffffffa005c471>] jbd2_journal_get_write_access+0x31/0x50 [jbd2]
[<ffffffffa00a8b78>] __ext4_journal_get_write_access+0x38/0x80 [ext4]
[<ffffffffa0084253>] ext4_reserve_inode_write+0x73/0xa0 [ext4]
[<ffffffffa00842cc>] ext4_mark_inode_dirty+0x4c/0x1d0 [ext4]
[<ffffffffa00845c0>] ext4_dirty_inode+0x40/0x60 [ext4]
[<ffffffff8119fe4b>] __mark_inode_dirty+0x3b/0x160
[<ffffffff811903c2>] file_update_time+0xf2/0x170
[<ffffffff81112d30>] __generic_file_aio_write+0x220/0x480
[<ffffffff81112fff>] generic_file_aio_write+0x6f/0xe0
[<ffffffffa007dde1>] ext4_file_write+0x61/0x1e0 [ext4]
[<ffffffff811762da>] do_sync_write+0xfa/0x140
[<ffffffff811765d8>] vfs_write+0xb8/0x1a0
[<ffffffff81176fe1>] sys_write+0x51/0x90
[<ffffffff8100b0f2>] system_call_fastpath+0x16/0x1b
[<ffffffffffffffff>] 0xffffffffffffffff
W0611 13:51:55.301614 27110 kernel_stack_watchdog.cc:87] Thread 985 stuck at /var/lib/jenkins/workspace/kudu-gerrit/BUILD_TYPE/DEBUG/label/centos6-kudu/src/consensus/log.cc:440 for 976ms:
[<ffffffff811a9460>] sync_buffer+0x40/0x50
[<ffffffff811a9606>] __lock_buffer+0x36/0x40
[<ffffffffa005c293>] do_get_write_access+0x493/0x520 [jbd2]
[<ffffffffa005c471>] jbd2_journal_get_write_access+0x31/0x50 [jbd2]
[<ffffffffa00a8b78>] __ext4_journal_get_write_access+0x38/0x80 [ext4]
[<ffffffffa0084253>] ext4_reserve_inode_write+0x73/0xa0 [ext4]
[<ffffffffa00842cc>] ext4_mark_inode_dirty+0x4c/0x1d0 [ext4]
[<ffffffffa00845c0>] ext4_dirty_inode+0x40/0x60 [ext4]
[<ffffffff8119fe4b>] __mark_inode_dirty+0x3b/0x160
[<ffffffff811903c2>] file_update_time+0xf2/0x170
[<ffffffff81112d30>] __generic_file_aio_write+0x220/0x480
[<ffffffff81112fff>] generic_file_aio_write+0x6f/0xe0
[<ffffffffa007dde1>] ext4_file_write+0x61/0x1e0 [ext4]
[<ffffffff811762da>] do_sync_write+0xfa/0x140
[<ffffffff811765d8>] vfs_write+0xb8/0x1a0
[<ffffffff81176fe1>] sys_write+0x51/0x90
[<ffffffff8100b0f2>] system_call_fastpath+0x16/0x1b
[<ffffffffffffffff>] 0xffffffffffffffff
W0611 13:51:55.324717 925 consensus_peers.cc:387] Couldn't send request to peer: cc1e2884045d4c0ca59f2c523a6b7ba2 Status: Timed out: Call timed out. Retrying in the next heartbeat period. Already tried 1 times.
W0611 13:51:55.324858 926 consensus_peers.cc:387] Couldn't send request to peer: b760d916003249a2b24db5b09df01bcd Status: Timed out: Call timed out. Retrying in the next heartbeat period. Already tried 1 times.
W0611 13:51:55.324949 883 consensus_peers.cc:387] Couldn't send request to peer: daedf67d9a9b459a8f58493e8d7f68f0 Status: Timed out: Call timed out. Retrying in the next heartbeat period. Already tried 1 times.
W0611 13:51:55.325675 880 consensus_peers.cc:387] Couldn't send request to peer: cc1e2884045d4c0ca59f2c523a6b7ba2 Status: Timed out: Call timed out. Retrying in the next heartbeat period. Already tried 1 times.
W0611 13:51:55.367351 982 log.cc:438] Times for Append to log took a long time: real 1.042s user 0.000s sys 0.000s
W0611 13:51:55.367481 935 inbound_call.cc:134] Call UpdateConsensus from 127.0.0.1:59910 (#12) took 1042ms (client timeout 1000).
W0611 13:51:55.367619 935 inbound_call.cc:138] Trace:
0611 13:51:54.324745 (+ 0us) service_pool.cc:90] Inserting onto call queue
0611 13:51:54.324779 (+ 34us) service_pool.cc:148] Handling call
0611 13:51:54.324830 (+ 51us) raft_consensus.cc:401] Updating replica for 1 ops
0611 13:51:54.324885 (+ 55us) log.cc:346] Serialized 3724 byte log entry
0611 13:51:54.325817 (+ 932us) raft_consensus.cc:462] Waiting on the replicates to finish logging
0611 13:51:55.367403 (+1041586us) raft_consensus.cc:464] finished
0611 13:51:55.367424 (+ 21us) raft_consensus.cc:376] Updating watermarks
0611 13:51:55.367451 (+ 27us) inbound_call.cc:81] Queueing success response
W0611 13:51:55.377398 985 log.cc:438] Times for Append to log took a long time: real 1.053s user 0.000s sys 0.000s
W0611 13:51:55.377487 893 inbound_call.cc:134] Call UpdateConsensus from 127.0.0.1:41402 (#12) took 1052ms (client timeout 1000).
W0611 13:51:55.377553 893 inbound_call.cc:138] Trace:
0611 13:51:54.324623 (+ 0us) service_pool.cc:90] Inserting onto call queue
0611 13:51:54.324650 (+ 27us) service_pool.cc:148] Handling call
0611 13:51:54.324721 (+ 71us) raft_consensus.cc:401] Updating replica for 1 ops
0611 13:51:54.324762 (+ 41us) log.cc:346] Serialized 517 byte log entry
0611 13:51:54.325797 (+ 1035us) raft_consensus.cc:462] Waiting on the replicates to finish logging
0611 13:51:55.377434 (+1051637us) raft_consensus.cc:464] finished
0611 13:51:55.377447 (+ 13us) raft_consensus.cc:376] Updating watermarks
0611 13:51:55.377469 (+ 22us) inbound_call.cc:81] Queueing success response
I0611 13:51:55.408206 26853 tablet_server.cc:97] TabletServer shutting down...
I0611 13:51:55.418925 26853 ts_tablet_manager.cc:336] Shutting down tablet manager...
I0611 13:51:55.418957 26853 maintenance_manager.cc:160] Unregistered op FlushRowSetsOp(8e316e3ceaca4eb09fa54081298f3c3e)
I0611 13:51:55.418968 26853 maintenance_manager.cc:160] Unregistered op CompactRowSetsOp(8e316e3ceaca4eb09fa54081298f3c3e)
I0611 13:51:55.418977 26853 maintenance_manager.cc:160] Unregistered op FlushDeltaMemStoresOp(8e316e3ceaca4eb09fa54081298f3c3e)
I0611 13:51:55.419102 26853 consensus_peers.cc:407] Closing peer: daedf67d9a9b459a8f58493e8d7f68f0 Waiting for outstanding requests to complete 0
I0611 13:51:55.419121 26853 consensus_peers.cc:407] Closing peer: b760d916003249a2b24db5b09df01bcd Waiting for outstanding requests to complete 0
I0611 13:51:55.419194 26853 consensus_peers.cc:407] Closing peer: cc1e2884045d4c0ca59f2c523a6b7ba2 Waiting for outstanding requests to complete 1
W0611 13:51:55.441781 1002 log.cc:438] Times for Append to log took a long time: real 1.117s user 0.000s sys 0.000s
W0611 13:51:55.441882 957 inbound_call.cc:134] Call UpdateConsensus from 127.0.0.1:44021 (#12) took 1117ms (client timeout 1000).
W0611 13:51:55.441943 957 inbound_call.cc:138] Trace:
0611 13:51:54.324829 (+ 0us) service_pool.cc:90] Inserting onto call queue
0611 13:51:54.324861 (+ 32us) service_pool.cc:148] Handling call
0611 13:51:54.324916 (+ 55us) raft_consensus.cc:401] Updating replica for 1 ops
0611 13:51:54.324970 (+ 54us) log.cc:346] Serialized 3724 byte log entry
0611 13:51:54.325843 (+ 873us) raft_consensus.cc:462] Waiting on the replicates to finish logging
0611 13:51:55.441828 (+1115985us) raft_consensus.cc:464] finished
0611 13:51:55.441840 (+ 12us) raft_consensus.cc:376] Updating watermarks
0611 13:51:55.441866 (+ 26us) inbound_call.cc:81] Queueing success response
I0611 13:51:55.442189 26853 raft_consensus_state.cc:190] Replica b760d916003249a2b24db5b09df01bcd waiting on 0 outstanding commits.
I0611 13:51:55.442214 26853 raft_consensus_state.cc:194] All local commits completed for replica: b760d916003249a2b24db5b09df01bcd
W0611 13:51:55.501322 27110 kernel_stack_watchdog.cc:87] Thread 981 stuck at /var/lib/jenkins/workspace/kudu-gerrit/BUILD_TYPE/DEBUG/label/centos6-kudu/src/consensus/log.cc:440 for 1176ms:
[<ffffffff811a9460>] sync_buffer+0x40/0x50
[<ffffffff811a9606>] __lock_buffer+0x36/0x40
[<ffffffffa005c293>] do_get_write_access+0x493/0x520 [jbd2]
[<ffffffffa005c471>] jbd2_journal_get_write_access+0x31/0x50 [jbd2]
[<ffffffffa00a8b78>] __ext4_journal_get_write_access+0x38/0x80 [ext4]
[<ffffffffa0084253>] ext4_reserve_inode_write+0x73/0xa0 [ext4]
[<ffffffffa00842cc>] ext4_mark_inode_dirty+0x4c/0x1d0 [ext4]
[<ffffffffa00845c0>] ext4_dirty_inode+0x40/0x60 [ext4]
[<ffffffff8119fe4b>] __mark_inode_dirty+0x3b/0x160
[<ffffffff811903c2>] file_update_time+0xf2/0x170
[<ffffffff81112d30>] __generic_file_aio_write+0x220/0x480
[<ffffffff81112fff>] generic_file_aio_write+0x6f/0xe0
[<ffffffffa007dde1>] ext4_file_write+0x61/0x1e0 [ext4]
[<ffffffff811762da>] do_sync_write+0xfa/0x140
[<ffffffff811765d8>] vfs_write+0xb8/0x1a0
[<ffffffff81176fe1>] sys_write+0x51/0x90
[<ffffffff8100b0f2>] system_call_fastpath+0x16/0x1b
[<ffffffffffffffff>] 0xffffffffffffffff
W0611 13:51:55.540704 981 log.cc:438] Times for Append to log took a long time: real 1.216s user 0.000s sys 0.000s
W0611 13:51:55.540812 956 inbound_call.cc:134] Call UpdateConsensus from 127.0.0.1:44019 (#12) took 1216ms (client timeout 1000).
W0611 13:51:55.540869 956 inbound_call.cc:138] Trace:
0611 13:51:54.324562 (+ 0us) service_pool.cc:90] Inserting onto call queue
0611 13:51:54.324617 (+ 55us) service_pool.cc:148] Handling call
0611 13:51:54.324683 (+ 66us) raft_consensus.cc:401] Updating replica for 1 ops
0611 13:51:54.324738 (+ 55us) log.cc:346] Serialized 517 byte log entry
0611 13:51:54.325030 (+ 292us) raft_consensus.cc:462] Waiting on the replicates to finish logging
0611 13:51:55.540749 (+1215719us) raft_consensus.cc:464] finished
0611 13:51:55.540765 (+ 16us) raft_consensus.cc:376] Updating watermarks
0611 13:51:55.540789 (+ 24us) inbound_call.cc:81] Queueing success response
I0611 13:51:55.759474 26853 raft_consensus.cc:514] Raft consensus Shutdown!
I0611 13:51:55.759559 26853 maintenance_manager.cc:160] Unregistered op FlushRowSetsOp(d880ff7b11b245b7906b58451c7cc7b6)
I0611 13:51:55.759584 26853 maintenance_manager.cc:160] Unregistered op CompactRowSetsOp(d880ff7b11b245b7906b58451c7cc7b6)
I0611 13:51:55.759596 26853 maintenance_manager.cc:160] Unregistered op FlushDeltaMemStoresOp(d880ff7b11b245b7906b58451c7cc7b6)
I0611 13:51:55.761519 26853 maintenance_manager.cc:160] Unregistered op FlushRowSetsOp(032944b9055e49f1b9d5d3b5f198f817)
I0611 13:51:55.761539 26853 maintenance_manager.cc:160] Unregistered op CompactRowSetsOp(032944b9055e49f1b9d5d3b5f198f817)
I0611 13:51:55.761551 26853 maintenance_manager.cc:160] Unregistered op FlushDeltaMemStoresOp(032944b9055e49f1b9d5d3b5f198f817)
I0611 13:51:55.763968 26853 maintenance_manager.cc:160] Unregistered op FlushRowSetsOp(e0b175135099427a91836902cc98caa1)
I0611 13:51:55.763986 26853 maintenance_manager.cc:160] Unregistered op CompactRowSetsOp(e0b175135099427a91836902cc98caa1)
I0611 13:51:55.763998 26853 maintenance_manager.cc:160] Unregistered op FlushDeltaMemStoresOp(e0b175135099427a91836902cc98caa1)
I0611 13:51:55.765486 26853 maintenance_manager.cc:160] Unregistered op FlushRowSetsOp(fd38b032e4eb4def86e23b57e9016125)
I0611 13:51:55.765502 26853 maintenance_manager.cc:160] Unregistered op CompactRowSetsOp(fd38b032e4eb4def86e23b57e9016125)
I0611 13:51:55.765513 26853 maintenance_manager.cc:160] Unregistered op FlushDeltaMemStoresOp(fd38b032e4eb4def86e23b57e9016125)
I0611 13:51:55.765588 26853 raft_consensus_state.cc:190] Replica b760d916003249a2b24db5b09df01bcd waiting on 0 outstanding commits.
I0611 13:51:55.765611 26853 raft_consensus_state.cc:194] All local commits completed for replica: b760d916003249a2b24db5b09df01bcd
I0611 13:51:55.767079 26853 raft_consensus.cc:514] Raft consensus Shutdown!
I0611 13:51:55.767123 26853 raft_consensus_state.cc:190] Replica b760d916003249a2b24db5b09df01bcd waiting on 0 outstanding commits.
I0611 13:51:55.767133 26853 raft_consensus_state.cc:194] All local commits completed for replica: b760d916003249a2b24db5b09df01bcd
I0611 13:51:55.767151 26853 raft_consensus.cc:514] Raft consensus Shutdown!
I0611 13:51:55.769507 26853 raft_consensus_state.cc:190] Replica b760d916003249a2b24db5b09df01bcd waiting on 0 outstanding commits.
I0611 13:51:55.769531 26853 raft_consensus_state.cc:194] All local commits completed for replica: b760d916003249a2b24db5b09df01bcd
I0611 13:51:55.769551 26853 raft_consensus.cc:514] Raft consensus Shutdown!
I0611 13:51:55.770153 26853 tablet_server.cc:106] TabletServer shut down complete. Bye!
W0611 13:51:55.770221 26853 rpc_server.cc:102] Unable to unregister service kudu.tserver.TabletServerService: Service unavailable: Service is not registered
W0611 13:51:55.770263 26853 rpc_server.cc:102] Unable to unregister service kudu.tserver.TabletServerService: Service unavailable: Service is not registered
I0611 13:51:55.770530 26853 tablet_server.cc:97] TabletServer shutting down...
I0611 13:51:55.781651 26853 ts_tablet_manager.cc:336] Shutting down tablet manager...
I0611 13:51:55.781694 26853 maintenance_manager.cc:160] Unregistered op FlushRowSetsOp(8e316e3ceaca4eb09fa54081298f3c3e)
I0611 13:51:55.781729 26853 maintenance_manager.cc:160] Unregistered op CompactRowSetsOp(8e316e3ceaca4eb09fa54081298f3c3e)
I0611 13:51:55.781756 26853 maintenance_manager.cc:160] Unregistered op FlushDeltaMemStoresOp(8e316e3ceaca4eb09fa54081298f3c3e)
I0611 13:51:55.781887 26853 raft_consensus_state.cc:190] Replica daedf67d9a9b459a8f58493e8d7f68f0 waiting on 0 outstanding commits.
I0611 13:51:55.781919 26853 raft_consensus_state.cc:194] All local commits completed for replica: daedf67d9a9b459a8f58493e8d7f68f0
I0611 13:51:55.784085 26853 raft_consensus.cc:514] Raft consensus Shutdown!
I0611 13:51:55.784128 26853 maintenance_manager.cc:160] Unregistered op FlushRowSetsOp(fd38b032e4eb4def86e23b57e9016125)
I0611 13:51:55.784145 26853 maintenance_manager.cc:160] Unregistered op CompactRowSetsOp(fd38b032e4eb4def86e23b57e9016125)
I0611 13:51:55.784159 26853 maintenance_manager.cc:160] Unregistered op FlushDeltaMemStoresOp(fd38b032e4eb4def86e23b57e9016125)
I0611 13:51:55.784355 26853 consensus_peers.cc:407] Closing peer: daedf67d9a9b459a8f58493e8d7f68f0 Waiting for outstanding requests to complete 0
I0611 13:51:55.784466 26853 consensus_peers.cc:407] Closing peer: b760d916003249a2b24db5b09df01bcd Waiting for outstanding requests to complete 0
I0611 13:51:55.784566 26853 consensus_peers.cc:407] Closing peer: cc1e2884045d4c0ca59f2c523a6b7ba2 Waiting for outstanding requests to complete 0
I0611 13:51:55.784662 26853 raft_consensus_state.cc:190] Replica daedf67d9a9b459a8f58493e8d7f68f0 waiting on 0 outstanding commits.
I0611 13:51:55.784687 26853 raft_consensus_state.cc:194] All local commits completed for replica: daedf67d9a9b459a8f58493e8d7f68f0
I0611 13:51:55.786661 26853 raft_consensus.cc:514] Raft consensus Shutdown!
I0611 13:51:55.786871 26853 raft_consensus_state.cc:190] Replica daedf67d9a9b459a8f58493e8d7f68f0 waiting on 0 outstanding commits.
I0611 13:51:55.786885 26853 raft_consensus_state.cc:194] All local commits completed for replica: daedf67d9a9b459a8f58493e8d7f68f0
I0611 13:51:55.786900 26853 raft_consensus.cc:514] Raft consensus Shutdown!
I0611 13:51:55.787562 26853 raft_consensus_state.cc:190] Replica daedf67d9a9b459a8f58493e8d7f68f0 waiting on 0 outstanding commits.
I0611 13:51:55.787583 26853 raft_consensus_state.cc:194] All local commits completed for replica: daedf67d9a9b459a8f58493e8d7f68f0
I0611 13:51:55.787597 26853 raft_consensus.cc:514] Raft consensus Shutdown!
I0611 13:51:55.788303 26853 tablet_server.cc:106] TabletServer shut down complete. Bye!
W0611 13:51:55.788365 26853 rpc_server.cc:102] Unable to unregister service kudu.tserver.TabletServerService: Service unavailable: Service is not registered
W0611 13:51:55.788419 26853 rpc_server.cc:102] Unable to unregister service kudu.tserver.TabletServerService: Service unavailable: Service is not registered
I0611 13:51:55.788602 26853 tablet_server.cc:97] TabletServer shutting down...
I0611 13:51:55.800178 26853 ts_tablet_manager.cc:336] Shutting down tablet manager...
I0611 13:51:55.800209 26853 maintenance_manager.cc:160] Unregistered op FlushRowSetsOp(8e316e3ceaca4eb09fa54081298f3c3e)
I0611 13:51:55.800222 26853 maintenance_manager.cc:160] Unregistered op CompactRowSetsOp(8e316e3ceaca4eb09fa54081298f3c3e)
I0611 13:51:55.800230 26853 maintenance_manager.cc:160] Unregistered op FlushDeltaMemStoresOp(8e316e3ceaca4eb09fa54081298f3c3e)
W0611 13:51:56.806093 26853 transaction_tracker.cc:130] TransactionTracker waiting for 1 outstanding transactions to complete now for 1005 ms
W0611 13:51:58.253661 26853 transaction_tracker.cc:130] TransactionTracker waiting for 1 outstanding transactions to complete now for 2453 ms
W0611 13:51:58.866518 26853 transaction_tracker.cc:130] TransactionTracker waiting for 1 outstanding transactions to complete now for 3066 ms
...
W0611 14:06:21.801770 26853 transaction_tracker.cc:130] TransactionTracker waiting for 1 outstanding transactions to complete now for 866001 ms
F0611 14:06:22.238441 3408 test_main.cc:56] Maximum unit test time exceeded (900 sec)
*** Check failure stack trace: ***
*** Aborted at 1402520782 (unix time) try "date -d @1402520782" if you are using GNU date ***
PC: @ 0x335c632885 (unknown)
*** SIGABRT (@0xfa0000068e5) received by PID 26853 (TID 0x7f086d9f7700) from PID 26853; stack trace: ***
@ 0x335ca0f4a0 (unknown) at ??:0
@ 0x335c632885 (unknown) at ??:0
@ 0x335c634065 (unknown) at ??:0
@ 0x7f08b66a7a69 google::logging_fail() at ??:0
@ 0x7f08b66a799d google::LogMessage::Fail() at ??:0
@ 0x7f08b66ac017 google::LogMessage::SendToLog() at ??:0
@ 0x7f08b66a9e79 google::LogMessage::Flush() at ??:0
@ 0x7f08b66aa17d google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x9e5fcb KillTestOnTimeout() at /var/lib/jenkins/workspace/kudu-gerrit/BUILD_TYPE/DEBUG/label/centos6-kudu/src/util/test_main.cc:57
@ 0x335d6052ac (unknown) at ??:0
@ 0x335ca077f1 (unknown) at ??:0
@ 0x335c6e5ccd (unknown) at ??:0
Attachments
Issue Links
- duplicates
-
KUDU-341 Allow to abort transactions
-
- Resolved
-