[2019-01-18 03:30:02,566] INFO [ReplicaFetcherThread-0-3]: Stopped (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:02,566] INFO [ReplicaFetcherThread-0-3]: Shutdown completed (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:02,568] INFO [Group Metadata Manager on Broker 2]: Scheduling loading of offsets and group metadata from __consumer_offsets-22 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,568] INFO [Group Metadata Manager on Broker 2]: Scheduling loading of offsets and group metadata from __consumer_offsets-34 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,568] INFO [Group Metadata Manager on Broker 2]: Scheduling loading of offsets and group metadata from __consumer_offsets-46 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,568] INFO [Group Metadata Manager on Broker 2]: Scheduling loading of offsets and group metadata from __consumer_offsets-10 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,568] INFO [Group Metadata Manager on Broker 2]: Scheduling loading of offsets and group metadata from __consumer_offsets-28 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,568] INFO [Group Metadata Manager on Broker 2]: Scheduling loading of offsets and group metadata from __consumer_offsets-40 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,568] INFO [Group Metadata Manager on Broker 2]: Scheduling loading of offsets and group metadata from __consumer_offsets-4 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,568] INFO [Group Metadata Manager on Broker 2]: Scheduling loading of offsets and group metadata from __consumer_offsets-16 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,568] INFO [Group Metadata Manager on Broker 2]: Scheduling unloading of offsets and group metadata from __consumer_offsets-25 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,568] INFO [Group Metadata Manager on Broker 2]: Scheduling unloading of offsets and group metadata from __consumer_offsets-31 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,568] INFO [Group Metadata Manager on Broker 2]: Scheduling unloading of offsets and group metadata from __consumer_offsets-37 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,568] INFO [Group Metadata Manager on Broker 2]: Scheduling unloading of offsets and group metadata from __consumer_offsets-43 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,568] INFO [Group Metadata Manager on Broker 2]: Scheduling unloading of offsets and group metadata from __consumer_offsets-5 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,568] INFO [Group Metadata Manager on Broker 2]: Scheduling unloading of offsets and group metadata from __consumer_offsets-49 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,568] INFO [Group Metadata Manager on Broker 2]: Scheduling unloading of offsets and group metadata from __consumer_offsets-11 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,568] INFO [Group Metadata Manager on Broker 2]: Scheduling unloading of offsets and group metadata from __consumer_offsets-17 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,568] INFO [Group Metadata Manager on Broker 2]: Scheduling unloading of offsets and group metadata from __consumer_offsets-23 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,568] INFO [Group Metadata Manager on Broker 2]: Scheduling unloading of offsets and group metadata from __consumer_offsets-29 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,568] INFO [Group Metadata Manager on Broker 2]: Scheduling unloading of offsets and group metadata from __consumer_offsets-35 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,568] INFO [Group Metadata Manager on Broker 2]: Scheduling unloading of offsets and group metadata from __consumer_offsets-41 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,568] INFO [Group Metadata Manager on Broker 2]: Scheduling unloading of offsets and group metadata from __consumer_offsets-47 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,568] INFO [Group Metadata Manager on Broker 2]: Scheduling unloading of offsets and group metadata from __consumer_offsets-1 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,568] INFO [Group Metadata Manager on Broker 2]: Scheduling unloading of offsets and group metadata from __consumer_offsets-7 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,568] INFO [Group Metadata Manager on Broker 2]: Scheduling unloading of offsets and group metadata from __consumer_offsets-13 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,568] INFO [Group Metadata Manager on Broker 2]: Scheduling unloading of offsets and group metadata from __consumer_offsets-19 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,590] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-21defec5-ef0e-474d-808b-48657149e8a2-1500934242-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,590] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-f0fae3e6-2bef-4009-90bd-f26ccccbd7f1--674755424-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,605] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-f8d058d2-89e7-41a3-9717-161bffb44b42-164541527-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,605] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-50891b63-1e02-4b4d-900a-78946f061716--1635017607-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,605] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-c7c7aba8-5627-4bcf-9c71-0067dc26273e-1980337821-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,606] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-90f1440b-7178-494d-a4b7-db46e24ada3f-959379369-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,606] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-8d3187f3-5c44-4a7f-8191-1b1e64a3f43a-363747211-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,606] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-54a69af1-34ac-4feb-9b39-6422b6c51564-18935318-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,606] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-3c6f4d85-c421-4c51-8c21-4d3108aa8e1a-878766843-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,606] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-70914656-c1c1-4984-883c-498e7c8f1f62--2091281741-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,606] ERROR [Group Metadata Manager on Broker 2]: Error loading offsets from __consumer_offsets-22 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,612] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-c30a6178-46c3-49c3-85ea-0836a051504d-1012125394-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,612] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-1834ba12-09ef-4f1c-896d-38a7d933d70a--520317169-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,612] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-bf0ecc11-b6e4-4eab-a981-7dc7c8f136eb--893727825-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,615] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-82684294-fe6b-4384-8cc6-af83a113d773--107734625-driver-0 with generation 2 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,615] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-c30a6178-46c3-49c3-85ea-0836a051504d-1012125394-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,615] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-c8d8c497-54ae-4bbc-9170-b7ee454d9b7e--1326516306-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,615] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-231043b3-a1e7-48f9-a40e-b2b053fec84d-754807165-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,615] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-5224b608-8625-4a48-a00a-123aae0326ad--838347820-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,615] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-3b5a007a-21b0-428b-bebf-ea76f472589e--1903965178-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,615] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-d2dd95cf-57b8-41a6-b5fd-51d871d240e5--1121879855-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,615] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-6e2b14f4-cba5-4d15-a4a7-2eb04ada7be7--165061468-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,615] ERROR [Group Metadata Manager on Broker 2]: Error loading offsets from __consumer_offsets-34 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,617] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-1d0a4ee8-dea4-42ed-81ea-6d599726acf0-873014061-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,617] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-3e89a0ec-be8e-4b9e-8daf-59b266571c3c--922636116-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,620] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-e321ca1f-99c9-4f92-ba65-a897bb49fbd0--1503309537-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,620] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-f2f2132d-5f42-48f8-a4fc-6cb2e77efbc4-936564608-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,620] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-7ca36a55-a410-42b7-9e8d-3808c3c0cc46--1339925294-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,620] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-867696d5-882f-4245-adb1-78239704d563--2116687846-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,620] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-b4b61b77-891a-478e-83c1-1cd78f40af98-1595567877-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,621] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-e07546bf-bce1-437a-95e2-a17e4d0c826b--1148853637-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,621] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-50f27a0e-3975-42c3-8ca5-fcb64a83fa02-246903481-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,621] ERROR [Group Metadata Manager on Broker 2]: Error loading offsets from __consumer_offsets-46 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,711] INFO [GroupCoordinator 2]: Loading group metadata for console-consumer-39629 with generation 2 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,712] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-30c0a3cc-ff9e-48cf-812a-1f53228d81c4--450400697-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,712] INFO [GroupCoordinator 2]: Loading group metadata for console-consumer-39629 with generation 2 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,712] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-4eccdce3-0674-4797-a5be-25a23fe088e3--1860131400-driver-0 with generation 4 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,713] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-0c15d7a6-4547-419d-a8bb-975061adfb1d-171477955-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,713] INFO [GroupCoordinator 2]: Loading group metadata for console-consumer-39629 with generation 2 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,713] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-c3e8611b-3983-4bff-a6ef-07f5bd1d5be0--1357814371-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,713] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-f27214b6-2c76-4201-9900-01f9c5cdb243-1489355756-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,713] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-fe4525ec-9abf-4f65-9d6a-22ff482bbc0f--2094223633-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,713] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-1b0ec6db-fb7d-4c65-a93a-40899ecd854c--83758738-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,713] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-454589f7-c5cc-40d9-98b7-1f9a5fadd2af--1911592677-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,713] ERROR [Group Metadata Manager on Broker 2]: Error loading offsets from __consumer_offsets-10 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,739] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-12042a22-8380-4edc-bdcb-c4d012d2dbc0-1111989292-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,739] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-40be70c3-79cd-4202-9641-8d5164b47f00-394561952-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,739] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-ea428a0e-ae74-44e1-9d88-6e7bfbf4604e-1983204404-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,739] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-34337553-5aaf-49ae-9f26-db7a9bf377ce-1550699902-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,739] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-ba935ba4-c466-4564-a1e0-aa939b501b4d--386179572-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,739] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-c3c1f015-745a-4e0d-a51b-9b577f262698-1138326006-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,739] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-9b491c3d-ddf8-4e4c-98b3-1bab367f6127--398334897-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,739] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-d78cc55b-49c7-40ce-be10-1493361d3a71-1985994950-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,740] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-c3ac2992-8536-42db-8115-4c579e8008c7-1149510353-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,740] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-cac90800-0a4e-491b-9532-f31e177e06c2-547237285-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,740] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-f1c6ec5e-28f8-4ded-9ada-f8f54ea6a96d-832245173-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,740] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-a004089e-376d-44b6-b9d0-0cc4670a820a-5273170-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,740] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-c6c9c611-af76-4eff-aa11-5b5b27a40b01--1153363991-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,740] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-7435b9c4-ff76-4b30-be79-083f830a782a--1121675225-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,740] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-31e5327f-ba42-4069-afa1-e145946b1bc3--679019966-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,740] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-ba935ba4-c466-4564-a1e0-aa939b501b4d--386179572-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,740] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-2d792022-5cd7-4a5a-a406-e35fb63ab1d4--943954688-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,740] ERROR [Group Metadata Manager on Broker 2]: Error loading offsets from __consumer_offsets-28 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,765] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-8c08f6bd-e59b-4639-9b25-a88aa6c578cc-1391691611-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,765] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-79446d2c-d88c-489e-bfd9-2f646483a43a--1009770329-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,766] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-6bcd0f7d-1c6e-4650-8ba0-3b2a9d590c3d-266638014-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,766] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-570810dc-22d4-4d98-b6b3-d5f0389bcbf1--1917112046-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,766] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-17bcd7eb-03cc-4502-ac16-771aef1afe07--59455901-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,766] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-6330bff8-e707-4a57-be8f-0b01dbab3e13-734533970-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,766] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-1902fd9d-c869-4cb8-aed6-7b16c2037e5e-1818686459-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,766] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-383c147d-b048-4371-ab03-65f5bd3ce728--1096427631-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,766] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-52bedabb-f5aa-4cab-acf9-c890806de890-705962877-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,766] ERROR [Group Metadata Manager on Broker 2]: Error loading offsets from __consumer_offsets-40 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,788] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-41890689-365f-446e-86f2-7c0f3b9e750c--976965348-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,789] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-1482d8f7-d0b4-4834-927c-eb63b6932222-200311988-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,789] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-10e3e32e-dc0d-489f-b754-b72a42793cd2--226666368-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,789] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-045840d2-bc8a-44cf-82db-aba686728d73-647130893-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,789] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-0b5d08df-3e8a-4e2a-b732-bb3fdbfbca10-1943740145-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,789] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-fd06f6ca-a8dc-43ce-8990-a58783f17c3d-2016975157-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,789] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-eb185211-5bae-4835-a925-613d2241dc1b--113775164-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,789] ERROR [Group Metadata Manager on Broker 2]: Error loading offsets from __consumer_offsets-4 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:02,808] INFO [GroupCoordinator 2]: Loading group metadata for notifier with generation 6 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,808] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-e3390259-f48f-4964-8b25-ab04390cf474-474598688-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,808] INFO [GroupCoordinator 2]: Loading group metadata for notifier with generation 6 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,808] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-0837961a-3bf9-4ef6-abc6-131b66798793-1412175702-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:02,808] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-26e1af8e-9b47-44b3-ae67-2c4b6a1f0cd2--1179013869-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:06,089] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 112836 >= the follower's log end offset 112836 in __consumer_offsets-47. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:06,089] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 24324 >= the follower's log end offset 24324 in __consumer_offsets-13. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:06,089] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 87531 >= the follower's log end offset 87531 in __consumer_offsets-11. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:06,089] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 5379 >= the follower's log end offset 5379 in __consumer_offsets-43. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:06,089] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 4936982 >= the follower's log end offset 4936982 in __consumer_offsets-41. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:06,089] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 121460 >= the follower's log end offset 121460 in __consumer_offsets-23. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:06,089] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 228487214 >= the follower's log end offset 228487214 in __consumer_offsets-19. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:06,089] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 24277 >= the follower's log end offset 24277 in __consumer_offsets-49. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:06,089] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 7207 >= the follower's log end offset 7207 in __consumer_offsets-17. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:06,089] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 1051 >= the follower's log end offset 1051 in __consumer_offsets-31. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:06,089] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 107341547 >= the follower's log end offset 107341547 in __consumer_offsets-29. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:06,089] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 3378 >= the follower's log end offset 3378 in __consumer_offsets-25. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:06,089] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 2112 >= the follower's log end offset 2112 in __consumer_offsets-7. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:06,089] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 63605 >= the follower's log end offset 63605 in __consumer_offsets-37. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:06,089] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 30827 >= the follower's log end offset 30827 in __consumer_offsets-5. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:06,089] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 3717 >= the follower's log end offset 3717 in __consumer_offsets-35. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:06,089] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 14877069 >= the follower's log end offset 14877069 in __consumer_offsets-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:06,090] INFO Truncating __consumer_offsets-49 to 24277 has no effect as the largest offset in the log is 24276. (kafka.log.Log) [2019-01-18 03:30:06,090] INFO Truncating __consumer_offsets-19 to 228487214 has no effect as the largest offset in the log is 228487213. (kafka.log.Log) [2019-01-18 03:30:06,090] INFO Truncating __consumer_offsets-13 to 24324 has no effect as the largest offset in the log is 24323. (kafka.log.Log) [2019-01-18 03:30:06,090] INFO Truncating __consumer_offsets-35 to 3717 has no effect as the largest offset in the log is 3716. (kafka.log.Log) [2019-01-18 03:30:06,090] INFO Truncating __consumer_offsets-5 to 30827 has no effect as the largest offset in the log is 30826. (kafka.log.Log) [2019-01-18 03:30:06,090] INFO Truncating __consumer_offsets-43 to 5379 has no effect as the largest offset in the log is 5378. (kafka.log.Log) [2019-01-18 03:30:06,090] INFO Truncating __consumer_offsets-37 to 63605 has no effect as the largest offset in the log is 63604. (kafka.log.Log) [2019-01-18 03:30:06,090] INFO Truncating __consumer_offsets-29 to 107341547 has no effect as the largest offset in the log is 107341546. (kafka.log.Log) [2019-01-18 03:30:06,090] INFO Truncating __consumer_offsets-7 to 2112 has no effect as the largest offset in the log is 2111. (kafka.log.Log) [2019-01-18 03:30:06,090] INFO Truncating __consumer_offsets-23 to 121460 has no effect as the largest offset in the log is 121459. (kafka.log.Log) [2019-01-18 03:30:06,090] INFO Truncating __consumer_offsets-31 to 1051 has no effect as the largest offset in the log is 1050. (kafka.log.Log) [2019-01-18 03:30:06,090] INFO Truncating __consumer_offsets-1 to 14877069 has no effect as the largest offset in the log is 14877068. (kafka.log.Log) [2019-01-18 03:30:06,090] INFO Truncating __consumer_offsets-17 to 7207 has no effect as the largest offset in the log is 7206. (kafka.log.Log) [2019-01-18 03:30:06,090] INFO Truncating __consumer_offsets-47 to 112836 has no effect as the largest offset in the log is 112835. (kafka.log.Log) [2019-01-18 03:30:06,090] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-8b7d0af3-73e4-4750-ae33-85876aa8fd6a-873014061-driver-0 with old generation 1 (__consumer_offsets-39) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:06,091] INFO [GroupCoordinator 2]: Group spark-kafka-source-8b7d0af3-73e4-4750-ae33-85876aa8fd6a-873014061-driver-0 with generation 2 is now empty (__consumer_offsets-39) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:06,091] INFO Truncating __consumer_offsets-25 to 3378 has no effect as the largest offset in the log is 3377. (kafka.log.Log) [2019-01-18 03:30:06,091] INFO Truncating __consumer_offsets-41 to 4936982 has no effect as the largest offset in the log is 4936981. (kafka.log.Log) [2019-01-18 03:30:06,091] INFO Updated PartitionLeaderEpoch. New: {epoch:34, offset:6276}, Current: {epoch:33, offset6102} for Partition: __consumer_offsets-39. Cache now contains 4 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:06,091] INFO Truncating __consumer_offsets-11 to 87531 has no effect as the largest offset in the log is 87530. (kafka.log.Log) [2019-01-18 03:30:06,121] WARN Attempting to send response via channel for which there is no open connection, connection id 0 (kafka.network.Processor) [2019-01-18 03:30:06,209] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-2b313860-dbdf-4332-9c01-b621a46c1152-199510799-driver-0 with old generation 4 (__consumer_offsets-32) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:09,380] INFO [GroupCoordinator 2]: Stabilized group spark-kafka-source-2b313860-dbdf-4332-9c01-b621a46c1152-199510799-driver-0 generation 5 (__consumer_offsets-32) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:09,400] INFO Updated PartitionLeaderEpoch. New: {epoch:34, offset:107341547}, Current: {epoch:33, offset107338533} for Partition: __consumer_offsets-29. Cache now contains 16 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:09,403] INFO [GroupCoordinator 2]: Assignment received from leader for group spark-kafka-source-2b313860-dbdf-4332-9c01-b621a46c1152-199510799-driver-0 for generation 5 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:09,405] INFO Partition [__consumer_offsets,22] on broker 2: Expanding ISR from 2,1 to 2,1,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,405] WARN Attempting to send response via channel for which there is no open connection, connection id 2 (kafka.network.Processor) [2019-01-18 03:30:09,406] INFO Partition [__consumer_offsets,4] on broker 2: Expanding ISR from 2,1 to 2,1,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,415] INFO Partition [__consumer_offsets,46] on broker 2: Expanding ISR from 2,1 to 2,1,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,416] INFO Partition [__consumer_offsets,16] on broker 2: Expanding ISR from 2,1 to 2,1,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,416] INFO Partition [__consumer_offsets,28] on broker 2: Expanding ISR from 2,1 to 2,1,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,418] INFO Partition [__consumer_offsets,34] on broker 2: Expanding ISR from 2,1 to 2,1,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,418] INFO Partition [__consumer_offsets,10] on broker 2: Expanding ISR from 2,1 to 2,1,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,419] INFO Partition [__consumer_offsets,40] on broker 2: Expanding ISR from 2,1 to 2,1,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,420] INFO Partition [dmp.gateway.source-mf.integral_chain_db.user_task_rel,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,421] INFO Partition [dmp.gateway.source-mf.integral_chain_db.user_daily_record,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,422] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_guess_category,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,423] INFO Partition [dmp.gateway.source-mf.integral_chain_db.prompt_recode,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,424] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.withdrawal_reocrd,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,424] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_guess_channel_rel,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,425] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.user_factor_record,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,426] INFO Partition [dmp.gateway.source-mf.integral_chain_db.alipayreceipts,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,427] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.prompt_conf,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,428] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_guess_source,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,429] INFO Partition [dmp.gateway.source-mf.integral_chain_db.rewards,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,430] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.duobao_goods,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,430] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_guess_channel_rel,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,431] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_invite_record,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,432] INFO Partition [dmp.gateway.source-mf.integral_chain_db.reward_records,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,433] INFO Partition [dmp.gateway.source-mf.integral_chain_db.share_record,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,434] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_user_address,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,434] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_reward_detail,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,463] INFO Partition [dmp.gateway.source-mf.integral_chain_db.banners,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,467] INFO Partition [dmp.gateway.source-mf.integral_chain_db.game_questions,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,469] INFO Partition [dmp.gateway.source-mf.integral_chain_db.certificate_record,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,470] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_guess_template,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,470] INFO Partition [dmp.gateway.source-mf.integral_chain_db.user_factor_time_record,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,472] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_real_name_record,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,475] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_invite_record,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,476] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_lottery_strategy_template,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,477] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_dict,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,477] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_lottery_strategy_template,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,478] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_account_record,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,479] INFO Partition [dmp.gateway.source-mf.integral_chain_db.duobao_goods,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,480] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_card_reward_record,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,481] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_channel_pop_record,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,481] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_user_card,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,482] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.user_task_rel,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,483] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.banners,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,483] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_guess_template_rel,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,484] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_channel_pop_record,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,485] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.zhongan_records,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,486] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.alipayreceipts,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,487] INFO Partition [dmp.gateway.source-mf.integral_chain_db.page_links,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,488] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_card,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,488] INFO Partition [dmp.gateway.source-mf.integral_chain_db.action_record,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,489] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_dict,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,490] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.blocks,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,491] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.wx_codes,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,688] INFO Partition [dmp.gateway.source-mf.integral_chain_db.users,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,690] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_banner,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,691] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_guess_source,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,692] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_zhongan_record,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,692] INFO Partition [dmp.gateway.source-mf.integral_chain_db.ads,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,693] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_zhongan_record,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,694] INFO Partition [dmp.gateway.source-mf.integral_chain_db.prompt_conf,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,695] INFO Partition [dmp.gateway.source-mf.integral_chain_db.task_template,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,695] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_guess_channel,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,696] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-e3390259-f48f-4964-8b25-ab04390cf474-474598688-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:09,696] INFO [GroupCoordinator 2]: Loading group metadata for notifier with generation 6 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:09,696] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-0837961a-3bf9-4ef6-abc6-131b66798793-1412175702-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:09,696] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-26e1af8e-9b47-44b3-ae67-2c4b6a1f0cd2--1179013869-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:09,696] INFO Partition [dmp.gateway.source-mf.integral_chain_db.jujibao_goods,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,697] INFO Partition [dmp.gateway.source-mf.integral_chain_db.withdrawal_reocrd,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,698] INFO Partition [dmp.gateway.source-mf.integral_chain_db.blocks,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,699] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_guess,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,700] INFO Partition [dmp.gateway.source-mf.integral_chain_db.integral_record,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,734] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_token_recycle_record,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,736] INFO Partition [dmp.gateway.source-mf.integral_chain_db.duobao_support_record,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:09,762] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_user_feedback,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,687] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_guess_category,2] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,687] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-4944b586-9529-4dc2-84c4-696b76ee1fc3-859284423-driver-0 with old generation 2 (__consumer_offsets-45) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,689] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_card_reward_detail,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,690] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_withdraw_record,1] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,690] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-21defec5-ef0e-474d-808b-48657149e8a2-1500934242-driver-0 with old generation 1 (__consumer_offsets-22) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,690] INFO [GroupCoordinator 2]: Stabilized group spark-kafka-source-4944b586-9529-4dc2-84c4-696b76ee1fc3-859284423-driver-0 generation 3 (__consumer_offsets-45) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,690] INFO [GroupCoordinator 2]: Group spark-kafka-source-21defec5-ef0e-474d-808b-48657149e8a2-1500934242-driver-0 with generation 2 is now empty (__consumer_offsets-22) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,690] INFO Updated PartitionLeaderEpoch. New: {epoch:32, offset:4063}, Current: {epoch:30, offset70} for Partition: __consumer_offsets-22. Cache now contains 3 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:12,690] INFO Partition [dmp.gateway.source-mf.integral_chain_db.reports,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,691] INFO Partition [dmp.gateway.formatted-dop.visit.collect_v2,1] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,691] INFO [GroupCoordinator 2]: Assignment received from leader for group spark-kafka-source-4944b586-9529-4dc2-84c4-696b76ee1fc3-859284423-driver-0 for generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,710] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-f0fae3e6-2bef-4009-90bd-f26ccccbd7f1--674755424-driver-0 with old generation 1 (__consumer_offsets-22) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,710] INFO [GroupCoordinator 2]: Group spark-kafka-source-f0fae3e6-2bef-4009-90bd-f26ccccbd7f1--674755424-driver-0 with generation 2 is now empty (__consumer_offsets-22) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,710] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-c30a6178-46c3-49c3-85ea-0836a051504d-1012125394-driver-0 with old generation 1 (__consumer_offsets-34) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,710] INFO [GroupCoordinator 2]: Group spark-kafka-source-c30a6178-46c3-49c3-85ea-0836a051504d-1012125394-driver-0 with generation 2 is now empty (__consumer_offsets-34) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,710] INFO Updated PartitionLeaderEpoch. New: {epoch:32, offset:7124}, Current: {epoch:30, offset6808} for Partition: __consumer_offsets-34. Cache now contains 3 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:12,711] INFO Partition [dmp.gateway.source-mf.integral_chain_db.news,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,711] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_real_name_record,2] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,712] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-1834ba12-09ef-4f1c-896d-38a7d933d70a--520317169-driver-0 with old generation 3 (__consumer_offsets-34) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,712] INFO [GroupCoordinator 2]: Group spark-kafka-source-1834ba12-09ef-4f1c-896d-38a7d933d70a--520317169-driver-0 with generation 4 is now empty (__consumer_offsets-34) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,712] INFO Partition [dmp.gateway.source-mf.integral_chain_db.chiefpromotedocs,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,712] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-bf0ecc11-b6e4-4eab-a981-7dc7c8f136eb--893727825-driver-0 with old generation 1 (__consumer_offsets-34) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,712] INFO [GroupCoordinator 2]: Group spark-kafka-source-bf0ecc11-b6e4-4eab-a981-7dc7c8f136eb--893727825-driver-0 with generation 2 is now empty (__consumer_offsets-34) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,712] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-c30a6178-46c3-49c3-85ea-0836a051504d-1012125394-driver-0 with old generation 3 (__consumer_offsets-34) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,712] INFO [GroupCoordinator 2]: Group spark-kafka-source-c30a6178-46c3-49c3-85ea-0836a051504d-1012125394-driver-0 with generation 4 is now empty (__consumer_offsets-34) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,712] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_guess,2] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,712] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-1d0a4ee8-dea4-42ed-81ea-6d599726acf0-873014061-driver-0 with old generation 1 (__consumer_offsets-46) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,712] INFO [GroupCoordinator 2]: Group spark-kafka-source-1d0a4ee8-dea4-42ed-81ea-6d599726acf0-873014061-driver-0 with generation 2 is now empty (__consumer_offsets-46) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,713] INFO Updated PartitionLeaderEpoch. New: {epoch:33, offset:34304}, Current: {epoch:31, offset34074} for Partition: __consumer_offsets-46. Cache now contains 6 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:12,713] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_withdraw_record,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,713] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.advertising,2] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,713] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_attend_params,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,714] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-3e89a0ec-be8e-4b9e-8daf-59b266571c3c--922636116-driver-0 with old generation 1 (__consumer_offsets-46) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,714] INFO [GroupCoordinator 2]: Group spark-kafka-source-3e89a0ec-be8e-4b9e-8daf-59b266571c3c--922636116-driver-0 with generation 2 is now empty (__consumer_offsets-46) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,714] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-30c0a3cc-ff9e-48cf-812a-1f53228d81c4--450400697-driver-0 with old generation 3 (__consumer_offsets-10) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,714] INFO [GroupCoordinator 2]: Group spark-kafka-source-30c0a3cc-ff9e-48cf-812a-1f53228d81c4--450400697-driver-0 with generation 4 is now empty (__consumer_offsets-10) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,714] INFO Updated PartitionLeaderEpoch. New: {epoch:31, offset:9518}, Current: {epoch:29, offset9363} for Partition: __consumer_offsets-10. Cache now contains 11 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:12,714] INFO Partition [__consumer_offsets,32] on broker 2: Shrinking ISR from 2,3,1 to 2,1 (kafka.cluster.Partition) [2019-01-18 03:30:12,714] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_real_name_record,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,715] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-4eccdce3-0674-4797-a5be-25a23fe088e3--1860131400-driver-0 with old generation 4 (__consumer_offsets-10) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,715] INFO [GroupCoordinator 2]: Group spark-kafka-source-4eccdce3-0674-4797-a5be-25a23fe088e3--1860131400-driver-0 with generation 5 is now empty (__consumer_offsets-10) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,715] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.integral_record,1] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,715] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_real_name_record,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,716] INFO Partition [dmp.gateway.source-mf.integral_chain_db.zhongan_records,0] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,716] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_withdraw_record,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,717] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.ads,0] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,719] INFO Partition [dmp.gateway.source-mf.integral_chain_db.user_daily_check_prize,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,723] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.reports,4] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,723] INFO Partition [dmp.gateway.source-mf.integral_chain_db.dictionaries,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,724] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_user,2] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,724] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_guess_order,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,725] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_user_card,1] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,725] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.duobao_order_code_rel,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,726] INFO Partition [dmp.gateway.source-mf.integral_chain_db.user_integral_record,1] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,726] INFO Partition [dmp.gateway.source-mf.integral_chain_db.receipts,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,726] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.chiefpromotedocs,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,727] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.user_question_record,0] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,727] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_guess_category,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,727] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.game_questions,0] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,728] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_guess_category,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,728] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.duobao_support_record,3] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,729] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.documents,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,729] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_card_reward_detail,0] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,729] INFO Partition [dmp.gateway.source-mf.integral_chain_db.documents,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,730] INFO Partition [dmp.gateway.source-mf.integral_chain_db.duobao_orders,1] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,730] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.game_questions,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,730] INFO Partition [dmp.gateway.source-mf.integral_chain_db.wx_codes,3] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,731] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.game_questions,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,731] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_reward_record,1] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,732] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_banner,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,732] INFO Partition [dmp.gateway.source-mf.integral_chain_db.tasks,2] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,732] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_guess_option,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,733] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_action_record,0] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,733] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.duobao_support_record,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,734] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.news,2] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,734] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.duobao_support_record,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,734] INFO Partition [dmp.gateway.source-dmp.gateway.source-dop.fdn.v2.t_rel_party_prop,2] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,735] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_reward_type,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,735] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_guess_order,1] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,736] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.reports,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,736] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_user_address,1] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,736] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.reports,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,736] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_attend_params,1] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,737] INFO Partition [dmp.gateway.source-mf.integral_chain_db.duobao_orders,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,737] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_moses_id,1] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,754] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-12042a22-8380-4edc-bdcb-c4d012d2dbc0-1111989292-driver-0 with old generation 3 (__consumer_offsets-28) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,754] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_user,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,754] INFO [GroupCoordinator 2]: Group spark-kafka-source-12042a22-8380-4edc-bdcb-c4d012d2dbc0-1111989292-driver-0 with generation 4 is now empty (__consumer_offsets-28) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,755] INFO Updated PartitionLeaderEpoch. New: {epoch:31, offset:6715}, Current: {epoch:29, offset6603} for Partition: __consumer_offsets-28. Cache now contains 4 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:12,755] INFO Partition [dmp.gateway.source-mf.integral_chain_db.duobao_order_code_rel,2] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,755] INFO Partition [dmp.gateway.source-mf.integral_chain_db.wx_codes,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,755] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-40be70c3-79cd-4202-9641-8d5164b47f00-394561952-driver-0 with old generation 1 (__consumer_offsets-28) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,756] INFO [GroupCoordinator 2]: Group spark-kafka-source-40be70c3-79cd-4202-9641-8d5164b47f00-394561952-driver-0 with generation 2 is now empty (__consumer_offsets-28) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,756] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-ea428a0e-ae74-44e1-9d88-6e7bfbf4604e-1983204404-driver-0 with old generation 3 (__consumer_offsets-28) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,756] INFO [GroupCoordinator 2]: Group spark-kafka-source-ea428a0e-ae74-44e1-9d88-6e7bfbf4604e-1983204404-driver-0 with generation 4 is now empty (__consumer_offsets-28) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,756] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-34337553-5aaf-49ae-9f26-db7a9bf377ce-1550699902-driver-0 with old generation 3 (__consumer_offsets-28) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,756] INFO [GroupCoordinator 2]: Group spark-kafka-source-34337553-5aaf-49ae-9f26-db7a9bf377ce-1550699902-driver-0 with generation 4 is now empty (__consumer_offsets-28) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,756] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-c3c1f015-745a-4e0d-a51b-9b577f262698-1138326006-driver-0 with old generation 3 (__consumer_offsets-28) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,756] INFO [GroupCoordinator 2]: Group spark-kafka-source-c3c1f015-745a-4e0d-a51b-9b577f262698-1138326006-driver-0 with generation 4 is now empty (__consumer_offsets-28) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,756] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-9b491c3d-ddf8-4e4c-98b3-1bab367f6127--398334897-driver-0 with old generation 3 (__consumer_offsets-28) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,756] INFO [GroupCoordinator 2]: Group spark-kafka-source-9b491c3d-ddf8-4e4c-98b3-1bab367f6127--398334897-driver-0 with generation 4 is now empty (__consumer_offsets-28) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,756] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-d78cc55b-49c7-40ce-be10-1493361d3a71-1985994950-driver-0 with old generation 3 (__consumer_offsets-28) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,756] INFO [GroupCoordinator 2]: Group spark-kafka-source-d78cc55b-49c7-40ce-be10-1493361d3a71-1985994950-driver-0 with generation 4 is now empty (__consumer_offsets-28) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,756] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_guess_channel,2] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,756] INFO Partition [dmp.gateway.source-mf.integral_chain_db.wx_codes,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,757] INFO Partition [dmp.gateway.source-mf.integral_chain_db.advertising,4] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,757] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.news,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,758] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.share_record,1] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,758] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.news,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,759] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_comment_like_record,1] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,759] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.jujibao_order,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,759] INFO Partition [dmp.gateway.source-mf.integral_chain_db.user_factor_record,1] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,759] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_guess_order,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,760] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_moses_id,1] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,760] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_card_reward_detail,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,761] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_guess_comment,1] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,761] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_card_reward_detail,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,761] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_block,2] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,761] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_user_feedback,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,762] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.jujibao_goods,1] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,762] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_guess_template,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,763] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.user_feedbacks,1] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,763] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_guess_comment,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,764] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.receipts,0] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,764] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.user_daily_record,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,764] INFO Partition [dmp.gateway.source-mf.integral_chain_db.user_question_record,1] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,764] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.ads,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,765] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.rewards,3] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,765] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.ads,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,765] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-8c08f6bd-e59b-4639-9b25-a88aa6c578cc-1391691611-driver-0 with old generation 1 (__consumer_offsets-40) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,765] INFO [GroupCoordinator 2]: Group spark-kafka-source-8c08f6bd-e59b-4639-9b25-a88aa6c578cc-1391691611-driver-0 with generation 2 is now empty (__consumer_offsets-40) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,766] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.task_template,3] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,766] INFO Updated PartitionLeaderEpoch. New: {epoch:32, offset:27845}, Current: {epoch:30, offset27709} for Partition: __consumer_offsets-40. Cache now contains 14 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:12,766] INFO Partition [dmp.gateway.formatted-dop.visit.collect_v2,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,766] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.user_integral_record,0] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,766] INFO Partition [dmp.gateway.source-mf.integral_chain_db.advertising,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,766] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-79446d2c-d88c-489e-bfd9-2f646483a43a--1009770329-driver-0 with old generation 3 (__consumer_offsets-40) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,766] INFO [GroupCoordinator 2]: Group spark-kafka-source-79446d2c-d88c-489e-bfd9-2f646483a43a--1009770329-driver-0 with generation 4 is now empty (__consumer_offsets-40) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,767] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_reward_detail,1] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,767] INFO Partition [dmp.gateway.source-mf.integral_chain_db.advertising,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,767] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.reward_records,1] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:12,768] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.user_integral_record,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,768] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.user_integral_record,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,769] INFO Partition [dmp.gateway.source-mf.integral_chain_db.duobao_order_code_rel,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,770] INFO Partition [dmp.gateway.source-mf.integral_chain_db.duobao_order_code_rel,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,770] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.certificate_record,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,771] INFO Partition [dmp.gateway.source-dmp.gateway.source-dop.fdn.v2.t_rel_party_prop,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,772] INFO Partition [dmp.gateway.source-dmp.gateway.source-dop.fdn.v2.t_rel_party_prop,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,772] INFO Partition [dmp.gateway.formatted-fd.fengdai_riskcontrol.loan_apply_cold_data,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,773] INFO Partition [dmp.gateway.source-mf.integral_chain_db.user_question_record,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,773] INFO Partition [dmp.gateway.source-mf.integral_chain_db.user_integral_record,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,774] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.user_feedbacks,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,775] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_attend_params,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,775] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_guess_channel,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,776] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_guess_channel,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,777] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_user_address,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,777] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_comment_like_record,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,778] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.share_record,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,779] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.integral_record,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,779] INFO Partition [dmp.gateway.source-mf.integral_chain_db.tasks,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,780] INFO Partition [dmp.gateway.source-mf.integral_chain_db.tasks,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,797] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-41890689-365f-446e-86f2-7c0f3b9e750c--976965348-driver-0 with old generation 1 (__consumer_offsets-4) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,797] INFO Partition [dmp.gateway.source-mf.integral_chain_db.user_feedbacks,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,797] INFO [GroupCoordinator 2]: Group spark-kafka-source-41890689-365f-446e-86f2-7c0f3b9e750c--976965348-driver-0 with generation 2 is now empty (__consumer_offsets-4) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,797] INFO Updated PartitionLeaderEpoch. New: {epoch:32, offset:468}, Current: {epoch:30, offset235} for Partition: __consumer_offsets-4. Cache now contains 15 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:12,798] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.rewards,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,799] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.rewards,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,800] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_comment_like_record,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,802] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_block,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,807] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_block,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,808] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-e3390259-f48f-4964-8b25-ab04390cf474-474598688-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,808] INFO [GroupCoordinator 2]: Loading group metadata for notifier with generation 6 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,808] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-0837961a-3bf9-4ef6-abc6-131b66798793-1412175702-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,808] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-26e1af8e-9b47-44b3-ae67-2c4b6a1f0cd2--1179013869-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,810] INFO Partition [dmp.gateway.source-fd.fengdai_riskcontrol.loan_apply_cold_data,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,814] INFO Partition [dmp.gateway.source-mf.integral_chain_db.user_factor_record,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,817] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_reward_detail,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,823] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_guess_template_rel,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,829] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_user,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,836] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_user,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,843] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_moses_id,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,968] INFO Updated PartitionLeaderEpoch. New: {epoch:34, offset:30827}, Current: {epoch:33, offset30818} for Partition: __consumer_offsets-5. Cache now contains 12 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:12,971] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_moses_id,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,977] INFO Updated PartitionLeaderEpoch. New: {epoch:31, offset:3378}, Current: {epoch:29, offset3238} for Partition: __consumer_offsets-25. Cache now contains 4 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:12,978] INFO Updated PartitionLeaderEpoch. New: {epoch:34, offset:87531}, Current: {epoch:33, offset87519} for Partition: __consumer_offsets-11. Cache now contains 11 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:12,978] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-c30a6178-46c3-49c3-85ea-0836a051504d-1012125394-driver-0 with old generation 2 (__consumer_offsets-34) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,979] INFO [GroupCoordinator 2]: Stabilized group spark-kafka-source-c30a6178-46c3-49c3-85ea-0836a051504d-1012125394-driver-0 generation 3 (__consumer_offsets-34) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,980] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.prompt_recode,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,983] INFO Updated PartitionLeaderEpoch. New: {epoch:31, offset:24324}, Current: {epoch:29, offset24162} for Partition: __consumer_offsets-13. Cache now contains 6 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:12,984] INFO [GroupCoordinator 2]: Assignment received from leader for group spark-kafka-source-c30a6178-46c3-49c3-85ea-0836a051504d-1012125394-driver-0 for generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:12,985] INFO Updated PartitionLeaderEpoch. New: {epoch:31, offset:5379}, Current: {epoch:29, offset1410} for Partition: __consumer_offsets-43. Cache now contains 6 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:12,988] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.user_question_record,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:12,990] INFO Updated PartitionLeaderEpoch. New: {epoch:34, offset:3717}, Current: {epoch:33, offset3707} for Partition: __consumer_offsets-35. Cache now contains 13 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:12,999] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.user_question_record,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:13,000] INFO Updated PartitionLeaderEpoch. New: {epoch:31, offset:2112}, Current: {epoch:29, offset1918} for Partition: __consumer_offsets-7. Cache now contains 6 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:13,065] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_guess,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:13,066] INFO Updated PartitionLeaderEpoch. New: {epoch:31, offset:1051}, Current: {epoch:29, offset962} for Partition: __consumer_offsets-31. Cache now contains 9 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:16,246] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_guess,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:16,248] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-8b7d0af3-73e4-4750-ae33-85876aa8fd6a-873014061-driver-0 with old generation 2 (__consumer_offsets-39) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:16,267] INFO [GroupCoordinator 2]: Stabilized group spark-kafka-source-8b7d0af3-73e4-4750-ae33-85876aa8fd6a-873014061-driver-0 generation 3 (__consumer_offsets-39) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:16,267] INFO Updated PartitionLeaderEpoch. New: {epoch:35, offset:4936982}, Current: {epoch:34, offset4936977} for Partition: __consumer_offsets-41. Cache now contains 7 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:16,268] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_reward_record,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:16,268] INFO Updated PartitionLeaderEpoch. New: {epoch:34, offset:121460}, Current: {epoch:33, offset121451} for Partition: __consumer_offsets-23. Cache now contains 12 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:16,269] INFO Updated PartitionLeaderEpoch. New: {epoch:31, offset:24277}, Current: {epoch:29, offset24126} for Partition: __consumer_offsets-49. Cache now contains 5 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:16,271] INFO Updated PartitionLeaderEpoch. New: {epoch:34, offset:112836}, Current: {epoch:33, offset112833} for Partition: __consumer_offsets-47. Cache now contains 7 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:16,272] INFO Updated PartitionLeaderEpoch. New: {epoch:31, offset:63605}, Current: {epoch:29, offset63520} for Partition: __consumer_offsets-37. Cache now contains 5 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:16,276] INFO Updated PartitionLeaderEpoch. New: {epoch:35, offset:7207}, Current: {epoch:34, offset7203} for Partition: __consumer_offsets-17. Cache now contains 8 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:16,277] INFO Updated PartitionLeaderEpoch. New: {epoch:33, offset:228487214}, Current: {epoch:31, offset228482795} for Partition: __consumer_offsets-19. Cache now contains 12 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:16,278] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.advertising,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:16,282] INFO Updated PartitionLeaderEpoch. New: {epoch:31, offset:14877069}, Current: {epoch:29, offset14876898} for Partition: __consumer_offsets-1. Cache now contains 14 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:16,287] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-e3390259-f48f-4964-8b25-ab04390cf474-474598688-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:16,287] INFO [GroupCoordinator 2]: Loading group metadata for notifier with generation 6 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:16,287] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-0837961a-3bf9-4ef6-abc6-131b66798793-1412175702-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:16,287] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-26e1af8e-9b47-44b3-ae67-2c4b6a1f0cd2--1179013869-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:16,287] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.advertising,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:16,300] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_card,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:16,315] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.receipts,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:16,489] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-8b7d0af3-73e4-4750-ae33-85876aa8fd6a-873014061-driver-0 with old generation 3 (__consumer_offsets-39) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:16,493] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.receipts,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:16,512] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.jujibao_goods,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:16,550] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_action_record,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:16,566] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_action_record,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:16,576] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-e3390259-f48f-4964-8b25-ab04390cf474-474598688-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:16,576] INFO [GroupCoordinator 2]: Loading group metadata for notifier with generation 6 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:16,576] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-0837961a-3bf9-4ef6-abc6-131b66798793-1412175702-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:16,576] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-26e1af8e-9b47-44b3-ae67-2c4b6a1f0cd2--1179013869-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:16,584] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.task_template,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:16,597] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.task_template,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:16,628] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.reward_records,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:16,643] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_user_card,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:16,655] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_guess_comment,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:16,717] INFO Partition [dmp.gateway.source-mf.integral_chain_db.zhongan_records,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:16,720] INFO Partition [dmp.gateway.source-mf.integral_chain_db.zhongan_records,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:19,799] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.user_daily_check_prize,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:19,801] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-4944b586-9529-4dc2-84c4-696b76ee1fc3-859284423-driver-0 with old generation 3 (__consumer_offsets-45) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,801] WARN [GroupCoordinator 2]: Failed to write empty metadata for group spark-kafka-source-21defec5-ef0e-474d-808b-48657149e8a2-1500934242-driver-0: The group is rebalancing, so a rejoin is needed. (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,801] WARN [GroupCoordinator 2]: Failed to write empty metadata for group spark-kafka-source-f0fae3e6-2bef-4009-90bd-f26ccccbd7f1--674755424-driver-0: The group is rebalancing, so a rejoin is needed. (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,801] WARN [GroupCoordinator 2]: Failed to write empty metadata for group spark-kafka-source-c30a6178-46c3-49c3-85ea-0836a051504d-1012125394-driver-0: The group is rebalancing, so a rejoin is needed. (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,801] WARN [GroupCoordinator 2]: Failed to write empty metadata for group spark-kafka-source-1834ba12-09ef-4f1c-896d-38a7d933d70a--520317169-driver-0: The group is rebalancing, so a rejoin is needed. (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,801] WARN [GroupCoordinator 2]: Failed to write empty metadata for group spark-kafka-source-bf0ecc11-b6e4-4eab-a981-7dc7c8f136eb--893727825-driver-0: The group is rebalancing, so a rejoin is needed. (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,801] WARN [GroupCoordinator 2]: Failed to write empty metadata for group spark-kafka-source-c30a6178-46c3-49c3-85ea-0836a051504d-1012125394-driver-0: The group is rebalancing, so a rejoin is needed. (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,802] WARN [GroupCoordinator 2]: Failed to write empty metadata for group spark-kafka-source-1d0a4ee8-dea4-42ed-81ea-6d599726acf0-873014061-driver-0: The group is rebalancing, so a rejoin is needed. (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,802] WARN [GroupCoordinator 2]: Failed to write empty metadata for group spark-kafka-source-3e89a0ec-be8e-4b9e-8daf-59b266571c3c--922636116-driver-0: The group is rebalancing, so a rejoin is needed. (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,802] WARN [GroupCoordinator 2]: Failed to write empty metadata for group spark-kafka-source-30c0a3cc-ff9e-48cf-812a-1f53228d81c4--450400697-driver-0: The group is rebalancing, so a rejoin is needed. (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,802] WARN [GroupCoordinator 2]: Failed to write empty metadata for group spark-kafka-source-4eccdce3-0674-4797-a5be-25a23fe088e3--1860131400-driver-0: The group is rebalancing, so a rejoin is needed. (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,802] WARN [GroupCoordinator 2]: Failed to write empty metadata for group spark-kafka-source-12042a22-8380-4edc-bdcb-c4d012d2dbc0-1111989292-driver-0: The group is rebalancing, so a rejoin is needed. (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,802] WARN [GroupCoordinator 2]: Failed to write empty metadata for group spark-kafka-source-40be70c3-79cd-4202-9641-8d5164b47f00-394561952-driver-0: The group is rebalancing, so a rejoin is needed. (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,802] WARN [GroupCoordinator 2]: Failed to write empty metadata for group spark-kafka-source-ea428a0e-ae74-44e1-9d88-6e7bfbf4604e-1983204404-driver-0: The group is rebalancing, so a rejoin is needed. (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,802] WARN [GroupCoordinator 2]: Failed to write empty metadata for group spark-kafka-source-34337553-5aaf-49ae-9f26-db7a9bf377ce-1550699902-driver-0: The group is rebalancing, so a rejoin is needed. (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,802] WARN [GroupCoordinator 2]: Failed to write empty metadata for group spark-kafka-source-c3c1f015-745a-4e0d-a51b-9b577f262698-1138326006-driver-0: The group is rebalancing, so a rejoin is needed. (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,802] WARN [GroupCoordinator 2]: Failed to write empty metadata for group spark-kafka-source-9b491c3d-ddf8-4e4c-98b3-1bab367f6127--398334897-driver-0: The group is rebalancing, so a rejoin is needed. (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,802] WARN [GroupCoordinator 2]: Failed to write empty metadata for group spark-kafka-source-d78cc55b-49c7-40ce-be10-1493361d3a71-1985994950-driver-0: The group is rebalancing, so a rejoin is needed. (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,802] WARN [GroupCoordinator 2]: Failed to write empty metadata for group spark-kafka-source-8c08f6bd-e59b-4639-9b25-a88aa6c578cc-1391691611-driver-0: The group is rebalancing, so a rejoin is needed. (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,802] WARN [GroupCoordinator 2]: Failed to write empty metadata for group spark-kafka-source-79446d2c-d88c-489e-bfd9-2f646483a43a--1009770329-driver-0: The group is rebalancing, so a rejoin is needed. (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,802] WARN [GroupCoordinator 2]: Failed to write empty metadata for group spark-kafka-source-41890689-365f-446e-86f2-7c0f3b9e750c--976965348-driver-0: The group is rebalancing, so a rejoin is needed. (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,802] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-c30a6178-46c3-49c3-85ea-0836a051504d-1012125394-driver-0 with old generation 3 (__consumer_offsets-34) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,829] INFO [GroupCoordinator 2]: Stabilized group spark-kafka-source-4944b586-9529-4dc2-84c4-696b76ee1fc3-859284423-driver-0 generation 4 (__consumer_offsets-45) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,832] INFO [GroupCoordinator 2]: Stabilized group spark-kafka-source-c30a6178-46c3-49c3-85ea-0836a051504d-1012125394-driver-0 generation 4 (__consumer_offsets-34) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,834] INFO [GroupCoordinator 2]: Assignment received from leader for group spark-kafka-source-4944b586-9529-4dc2-84c4-696b76ee1fc3-859284423-driver-0 for generation 4 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,834] INFO [GroupCoordinator 2]: Assignment received from leader for group spark-kafka-source-c30a6178-46c3-49c3-85ea-0836a051504d-1012125394-driver-0 for generation 4 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,847] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-e3390259-f48f-4964-8b25-ab04390cf474-474598688-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,847] INFO [GroupCoordinator 2]: Loading group metadata for notifier with generation 8 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,847] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-0837961a-3bf9-4ef6-abc6-131b66798793-1412175702-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:19,847] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-26e1af8e-9b47-44b3-ae67-2c4b6a1f0cd2--1179013869-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:20,132] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.receipts,4] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:23,206] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_card_reward_record,1] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:23,228] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.ads,4] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:23,229] INFO Partition [dmp.gateway.source-mf.integral_chain_db.action_record,0] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:23,239] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_card_reward_record,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:23,241] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_guess_category,2] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:23,244] INFO Partition [dmp.gateway.source-mf.integral_chain_db.action_record,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:23,244] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_withdraw_record,1] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:23,246] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.duobao_order_code_rel,4] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:23,246] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_withdraw_record,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:23,247] INFO Partition [dmp.gateway.formatted-dop.visit.collect_v2,1] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:23,248] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.duobao_order_code_rel,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:23,250] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.prompt_recode,0] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:23,250] INFO Partition [dmp.gateway.formatted-mx.trchain_moses_db.t_guess_category,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:23,252] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_guess,2] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:23,253] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.ads,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:23,256] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.advertising,3] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:23,259] INFO Partition [dmp.gateway.formatted-dop.visit.collect_v2,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:23,263] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_guess,3] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:23,294] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.advertising,2] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:23,294] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.prompt_recode,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:23,297] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-e3390259-f48f-4964-8b25-ab04390cf474-474598688-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:23,297] INFO [GroupCoordinator 2]: Loading group metadata for notifier with generation 8 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:23,297] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-0837961a-3bf9-4ef6-abc6-131b66798793-1412175702-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:23,297] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-26e1af8e-9b47-44b3-ae67-2c4b6a1f0cd2--1179013869-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:23,310] INFO Partition [dmp.gateway.source-mf.integral_chain_db.zhongan_records,0] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:23,312] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_guess,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:23,319] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_user_card,1] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:23,322] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_guess,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:23,328] INFO Partition [__consumer_offsets,34] on broker 2: Shrinking ISR from 2,1,3 to 2,1 (kafka.cluster.Partition) [2019-01-18 03:30:23,336] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.advertising,2] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:23,341] INFO Partition [dmp.gateway.source-mf.integral_chain_db.zhongan_records,4] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:23,346] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.advertising,3] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:23,474] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.user_daily_check_prize,0] on broker 2: Shrinking ISR from 2,3 to 2 (kafka.cluster.Partition) [2019-01-18 03:30:23,481] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.receipts,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:23,481] INFO Partition [__consumer_offsets,4] on broker 2: Shrinking ISR from 2,1,3 to 2,1 (kafka.cluster.Partition) [2019-01-18 03:30:23,483] INFO Partition [dmp.gateway.source-mx.trchain_moses_db.t_user_card,1] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:23,483] INFO Partition [__consumer_offsets,40] on broker 2: Shrinking ISR from 2,1,3 to 2,1 (kafka.cluster.Partition) [2019-01-18 03:30:23,484] INFO Partition [dmp.gateway.source-mf.integral_chain_db.zhongan_records,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:23,484] INFO Partition [__consumer_offsets,10] on broker 2: Shrinking ISR from 2,1,3 to 2,1 (kafka.cluster.Partition) [2019-01-18 03:30:23,485] INFO Partition [dmp.gateway.source-mf.integral_chain_db.zhongan_records,4] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:23,486] INFO Partition [__consumer_offsets,46] on broker 2: Shrinking ISR from 2,1,3 to 2,1 (kafka.cluster.Partition) [2019-01-18 03:30:23,488] INFO Partition [dmp.gateway.formatted-mf.integral_chain_db.user_daily_check_prize,0] on broker 2: Expanding ISR from 2 to 2,3 (kafka.cluster.Partition) [2019-01-18 03:30:23,489] INFO Partition [__consumer_offsets,45] on broker 2: Shrinking ISR from 2,3,1 to 2,1 (kafka.cluster.Partition) [2019-01-18 03:30:23,490] INFO Partition [__consumer_offsets,32] on broker 2: Expanding ISR from 2,1 to 2,1,3 (kafka.cluster.Partition) [2019-01-18 03:30:23,491] INFO Partition [__consumer_offsets,22] on broker 2: Shrinking ISR from 2,1,3 to 2,1 (kafka.cluster.Partition) [2019-01-18 03:30:23,492] INFO Partition [__consumer_offsets,28] on broker 2: Shrinking ISR from 2,1,3 to 2,1 (kafka.cluster.Partition) [2019-01-18 03:30:26,481] INFO [GroupCoordinator 2]: Stabilized group spark-kafka-source-8b7d0af3-73e4-4750-ae33-85876aa8fd6a-873014061-driver-0 generation 4 (__consumer_offsets-39) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:26,483] INFO [GroupCoordinator 2]: Assignment received from leader for group spark-kafka-source-8b7d0af3-73e4-4750-ae33-85876aa8fd6a-873014061-driver-0 for generation 4 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:26,485] INFO Partition [__consumer_offsets,22] on broker 2: Expanding ISR from 2,1 to 2,1,3 (kafka.cluster.Partition) [2019-01-18 03:30:26,487] INFO Partition [__consumer_offsets,4] on broker 2: Expanding ISR from 2,1 to 2,1,3 (kafka.cluster.Partition) [2019-01-18 03:30:26,489] INFO Partition [__consumer_offsets,46] on broker 2: Expanding ISR from 2,1 to 2,1,3 (kafka.cluster.Partition) [2019-01-18 03:30:26,490] INFO Partition [__consumer_offsets,28] on broker 2: Expanding ISR from 2,1 to 2,1,3 (kafka.cluster.Partition) [2019-01-18 03:30:26,510] INFO Partition [__consumer_offsets,45] on broker 2: Expanding ISR from 2,1 to 2,1,3 (kafka.cluster.Partition) [2019-01-18 03:30:26,511] INFO Partition [__consumer_offsets,34] on broker 2: Expanding ISR from 2,1 to 2,1,3 (kafka.cluster.Partition) [2019-01-18 03:30:26,512] INFO Partition [__consumer_offsets,10] on broker 2: Expanding ISR from 2,1 to 2,1,3 (kafka.cluster.Partition) [2019-01-18 03:30:26,517] INFO Partition [__consumer_offsets,40] on broker 2: Expanding ISR from 2,1 to 2,1,3 (kafka.cluster.Partition) [2019-01-18 03:30:26,531] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-e3390259-f48f-4964-8b25-ab04390cf474-474598688-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:26,531] INFO [GroupCoordinator 2]: Loading group metadata for notifier with generation 8 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:26,531] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-0837961a-3bf9-4ef6-abc6-131b66798793-1412175702-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:26,531] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-26e1af8e-9b47-44b3-ae67-2c4b6a1f0cd2--1179013869-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:26,596] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-e3390259-f48f-4964-8b25-ab04390cf474-474598688-driver-0 with old generation 1 (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:26,596] INFO [GroupCoordinator 2]: Group spark-kafka-source-e3390259-f48f-4964-8b25-ab04390cf474-474598688-driver-0 with generation 2 is now empty (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:26,596] INFO Updated PartitionLeaderEpoch. New: {epoch:32, offset:24117087}, Current: {epoch:31, offset24116582} for Partition: __consumer_offsets-16. Cache now contains 29 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:26,599] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-0837961a-3bf9-4ef6-abc6-131b66798793-1412175702-driver-0 with old generation 1 (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:26,599] INFO [GroupCoordinator 2]: Group spark-kafka-source-0837961a-3bf9-4ef6-abc6-131b66798793-1412175702-driver-0 with generation 2 is now empty (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:26,599] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-26e1af8e-9b47-44b3-ae67-2c4b6a1f0cd2--1179013869-driver-0 with old generation 1 (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:26,599] INFO [GroupCoordinator 2]: Group spark-kafka-source-26e1af8e-9b47-44b3-ae67-2c4b6a1f0cd2--1179013869-driver-0 with generation 2 is now empty (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:32,692] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-e3390259-f48f-4964-8b25-ab04390cf474-474598688-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:32,692] INFO [GroupCoordinator 2]: Loading group metadata for notifier with generation 8 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:32,692] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-0837961a-3bf9-4ef6-abc6-131b66798793-1412175702-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:32,692] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-26e1af8e-9b47-44b3-ae67-2c4b6a1f0cd2--1179013869-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:38,839] INFO [GroupCoordinator 2]: Loading group metadata for notifier with generation 8 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:38,839] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-f9b447dc-90f9-4a99-b1ee-59ecc08882c2-1143181345-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:38,839] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-f334301d-312c-4bc9-8eb7-b0d5f6b022d6-28336156-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:38,839] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-b5bdeca6-ae71-420e-9f8f-90915a18bc2d--257668569-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:38,839] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-acbd5c52-7948-4de7-b5e9-70a0303ab0ff--1221257556-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:38,839] INFO [GroupCoordinator 2]: Loading group metadata for spark-kafka-source-2a25ab7f-68f1-4741-b910-5332dd55ada1--601717925-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:38,839] ERROR [Group Metadata Manager on Broker 2]: Error loading offsets from __consumer_offsets-16 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:38,839] INFO [Group Metadata Manager on Broker 2]: Finished unloading __consumer_offsets-25. Removed 0 cached offsets and 0 cached groups. (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:38,840] INFO [Group Metadata Manager on Broker 2]: Finished unloading __consumer_offsets-31. Removed 0 cached offsets and 0 cached groups. (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:38,840] INFO [Group Metadata Manager on Broker 2]: Finished unloading __consumer_offsets-37. Removed 0 cached offsets and 0 cached groups. (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:38,840] INFO [Group Metadata Manager on Broker 2]: Finished unloading __consumer_offsets-43. Removed 0 cached offsets and 0 cached groups. (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:38,840] INFO [Group Metadata Manager on Broker 2]: Finished unloading __consumer_offsets-5. Removed 0 cached offsets and 0 cached groups. (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:38,840] INFO [Group Metadata Manager on Broker 2]: Finished unloading __consumer_offsets-49. Removed 0 cached offsets and 0 cached groups. (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:38,840] INFO [Group Metadata Manager on Broker 2]: Finished unloading __consumer_offsets-11. Removed 0 cached offsets and 0 cached groups. (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:38,840] INFO [Group Metadata Manager on Broker 2]: Finished unloading __consumer_offsets-17. Removed 0 cached offsets and 0 cached groups. (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:38,840] INFO [Group Metadata Manager on Broker 2]: Finished unloading __consumer_offsets-23. Removed 0 cached offsets and 0 cached groups. (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:38,840] INFO [Group Metadata Manager on Broker 2]: Finished unloading __consumer_offsets-29. Removed 0 cached offsets and 0 cached groups. (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:38,840] INFO [Group Metadata Manager on Broker 2]: Finished unloading __consumer_offsets-35. Removed 0 cached offsets and 0 cached groups. (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:38,840] INFO [Group Metadata Manager on Broker 2]: Finished unloading __consumer_offsets-41. Removed 0 cached offsets and 0 cached groups. (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:38,840] INFO [Group Metadata Manager on Broker 2]: Finished unloading __consumer_offsets-47. Removed 0 cached offsets and 0 cached groups. (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:38,840] INFO [Group Metadata Manager on Broker 2]: Finished unloading __consumer_offsets-1. Removed 0 cached offsets and 0 cached groups. (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:38,840] INFO [Group Metadata Manager on Broker 2]: Finished unloading __consumer_offsets-7. Removed 0 cached offsets and 0 cached groups. (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:38,840] INFO [Group Metadata Manager on Broker 2]: Finished unloading __consumer_offsets-13. Removed 0 cached offsets and 0 cached groups. (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:38,840] INFO [Group Metadata Manager on Broker 2]: Finished unloading __consumer_offsets-19. Removed 0 cached offsets and 0 cached groups. (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:42,168] INFO [GroupCoordinator 2]: Preparing to rebalance group notifier with old generation 6 (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:42,168] INFO [GroupCoordinator 2]: Stabilized group notifier generation 7 (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:42,168] INFO [GroupCoordinator 2]: Preparing to rebalance group notifier with old generation 7 (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:42,170] INFO [GroupCoordinator 2]: Stabilized group notifier generation 8 (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:42,177] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-ca0c706e-8083-41d6-80dc-f2d83fac8879--1749244605-driver-0 with old generation 0 (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:42,178] INFO [GroupCoordinator 2]: Stabilized group spark-kafka-source-ca0c706e-8083-41d6-80dc-f2d83fac8879--1749244605-driver-0 generation 1 (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:42,179] INFO [GroupCoordinator 2]: Assignment received from leader for group spark-kafka-source-ca0c706e-8083-41d6-80dc-f2d83fac8879--1749244605-driver-0 for generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:42,643] INFO [GroupCoordinator 2]: Assignment received from leader for group notifier for generation 8 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:42,692] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-e3390259-f48f-4964-8b25-ab04390cf474-474598688-driver-0 with old generation 3 (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:42,692] INFO [GroupCoordinator 2]: Group spark-kafka-source-e3390259-f48f-4964-8b25-ab04390cf474-474598688-driver-0 with generation 4 is now empty (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:42,695] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-0837961a-3bf9-4ef6-abc6-131b66798793-1412175702-driver-0 with old generation 3 (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:42,695] INFO [GroupCoordinator 2]: Group spark-kafka-source-0837961a-3bf9-4ef6-abc6-131b66798793-1412175702-driver-0 with generation 4 is now empty (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:42,695] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-26e1af8e-9b47-44b3-ae67-2c4b6a1f0cd2--1179013869-driver-0 with old generation 3 (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:42,695] INFO [GroupCoordinator 2]: Group spark-kafka-source-26e1af8e-9b47-44b3-ae67-2c4b6a1f0cd2--1179013869-driver-0 with generation 4 is now empty (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:43,967] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.game_questions-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:43,967] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.game_questions-2, initOffset 112 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,008] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_guess_category-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,008] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_guess_category-1, initOffset 3 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,019] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-dmp.gateway.source-dop.fdn.v2.t_rel_party_prop-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,020] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-dmp.gateway.source-dop.fdn.v2.t_rel_party_prop-1, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,031] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_user_address-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,031] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_user_address-0, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,042] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.action_record-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,042] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.action_record-0, initOffset 26104 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,074] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_attend_params-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,074] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_attend_params-0, initOffset 357 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,085] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_moses_id-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,085] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_moses_id-0, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,096] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.chiefpromotedocs-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,096] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.chiefpromotedocs-1, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,111] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_reward_detail-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,112] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_reward_detail-0, initOffset 4375 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,126] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.duobao_support_record-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,126] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.duobao_support_record-1, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,160] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.user_question_record-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,160] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.user_question_record-2, initOffset 107252 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,171] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.users-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,172] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.users-0, initOffset 51696 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,183] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.advertising-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,184] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.advertising-1, initOffset 18 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,195] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.zhongan_records-4 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,195] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.zhongan_records-4, initOffset 5764 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,240] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_guess_template_rel-4 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,240] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_guess_template_rel-4, initOffset 4175 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,252] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_account_record-3 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,252] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_account_record-3, initOffset 1146636 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,263] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_guess_template-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,264] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_guess_template-1, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,274] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.integral_record-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,275] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.integral_record-0, initOffset 156424 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,313] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.duobao_goods-4 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,314] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.duobao_goods-4, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,325] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.documents-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,325] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.documents-2, initOffset 68 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,336] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.user_daily_check_prize-4 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,336] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.user_daily_check_prize-4, initOffset 15 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,347] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-fd.fengdai_riskcontrol.loan_apply_cold_data-4 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,347] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-fd.fengdai_riskcontrol.loan_apply_cold_data-4, initOffset 594858 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,358] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_guess_comment-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,388] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_guess_comment-1, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,399] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_guess_channel-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,399] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_guess_channel-1, initOffset 10 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,411] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.reports-3 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,411] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.reports-3, initOffset 214 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,422] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.share_record-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,422] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.share_record-0, initOffset 225640 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,484] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_real_name_record-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,484] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_real_name_record-1, initOffset 674 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,541] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions __consumer_offsets-14 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,543] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([__consumer_offsets-14, initOffset 86898 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,543] INFO [Group Metadata Manager on Broker 2]: Scheduling unloading of offsets and group metadata from __consumer_offsets-14 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:44,543] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-4d3dd2e4-7fa3-4685-968e-f0b9331acf11-2067501122-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:44,543] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-5ea6ac94-db9c-4c60-86e3-e3db7b56ad94--1411341739-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:44,543] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-d549cffe-bd37-4ca6-8ebd-4e59fa0ce9b5-1352313342-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:44,543] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-b1ae4e24-1bf6-4128-ba9c-db6c17d6c3d5-639607903-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:44,543] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-04e88611-fc57-479e-9dd2-295f9d9d3f1c-494348991-driver-0 with generation 4 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:44,543] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-029882b4-97f4-4173-abb7-bb3453a3d0b5-1138326006-driver-0 with generation 2 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:44,543] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-1bfa9ff4-75ea-4cc8-b238-10d81de87c18--709089482-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:44,543] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-ae043fa5-dab8-48f9-b073-bc3c35589c3d--2066707232-driver-0 with generation 2 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:44,543] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-2e5c2658-37ac-41eb-ad6c-889c5056f650-1926693311-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:44,543] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-f9e2e864-c14e-4875-8e78-6ce1eca85d62--1902395540-driver-0 with generation 4 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:44,543] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-95278ca7-63f3-46aa-b10d-944e3afaaba5-97782934-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:44,543] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-d3d5d442-8346-4980-a9da-50735200a7eb-540830882-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:44,543] INFO [Group Metadata Manager on Broker 2]: Finished unloading __consumer_offsets-14. Removed 0 cached offsets and 12 cached groups. (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:44,553] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_guess_source-3 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,553] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_guess_source-3, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,564] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.prompt_recode-4 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,564] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.prompt_recode-4, initOffset 60141 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,575] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.blocks-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,575] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.blocks-1, initOffset 759896 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,586] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_reward_detail-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,586] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_reward_detail-1, initOffset 21874 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,618] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_reward_record-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,618] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_reward_record-0, initOffset 35 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,629] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_user-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,629] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_user-1, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,640] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-dop.visit.collect_v2-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,640] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-dop.visit.collect_v2-0, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,652] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions __consumer_offsets-26 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,654] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([__consumer_offsets-26, initOffset 364 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,654] INFO [Group Metadata Manager on Broker 2]: Scheduling unloading of offsets and group metadata from __consumer_offsets-26 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:44,655] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-b6e8c3b9-fc88-4c5b-99a0-8c163194f6b7--574963357-driver-0 with generation 5 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:44,655] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-a48c013f-4053-452f-954d-5b11aedb926f--1569432543-driver-0 with generation 6 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:44,655] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-dee5fcb8-d03f-4c89-b8bb-4fc2cec44473--62601551-driver-0 with generation 4 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:44,655] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-da52503a-73ea-471f-9d9c-a8494a2d164c-1743796437-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:44,655] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-6d17ddf0-5b8a-48d3-a803-e2923b186dcf--1979885518-driver-0 with generation 4 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:44,655] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-3948b72b-4163-45d6-8cbb-b377fdc22528-978725811-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:44,655] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-429018f4-6717-47ce-9c92-e23df5e012c6-577233420-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:44,655] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-690f0bc5-bd10-455e-bdeb-2a46d2bdbe3f--126240933-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:44,655] INFO [Group Metadata Manager on Broker 2]: Finished unloading __consumer_offsets-26. Removed 0 cached offsets and 8 cached groups. (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:44,787] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.task_template-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,788] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.task_template-1, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,801] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.tasks-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,802] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.tasks-1, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,814] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_invite_record-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,815] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_invite_record-2, initOffset 47696 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,827] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.share_record-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,828] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.share_record-2, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,860] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_comment_like_record-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,860] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_comment_like_record-0, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,871] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.user_feedbacks-4 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,871] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.user_feedbacks-4, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,882] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-fd.fengdai_riskcontrol.loan_apply_cold_data-4 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,882] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-fd.fengdai_riskcontrol.loan_apply_cold_data-4, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,893] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_withdraw_record-3 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,893] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_withdraw_record-3, initOffset 218 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,905] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.user_daily_check_prize-3 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,905] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.user_daily_check_prize-3, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,938] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.news-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,939] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.news-1, initOffset 17013 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,950] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.user_task_rel-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,950] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.user_task_rel-2, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,961] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_guess_category-4 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,961] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_guess_category-4, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,972] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_banner-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:44,972] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_banner-1, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:45,012] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions __consumer_offsets-20 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:45,014] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([__consumer_offsets-20, initOffset 125904 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:45,014] INFO [Group Metadata Manager on Broker 2]: Scheduling unloading of offsets and group metadata from __consumer_offsets-20 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:45,014] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-57e748fd-3f00-4d45-a8f3-89991bf4a24f--1911592677-driver-0 with generation 4 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:45,014] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-a7bcba6b-db94-491d-8cca-100cd0cc406b--827894915-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:45,014] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-1b0997f8-9607-4306-8aff-3eba96175ad0-778597179-driver-0 with generation 2 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:45,014] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-05d70387-e824-4913-8bae-d830db8377aa--1929411136-driver-0 with generation 5 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:45,014] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-eca0f5e7-664a-4c8f-8f26-5f0896f4272a--270932646-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:45,014] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-26bf4533-3427-4b6f-aa62-c5f7da33c033--976965348-driver-0 with generation 2 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:45,014] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-f6d2207a-e9b1-4198-a13a-607d7738948f--1396718248-driver-0 with generation 2 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:45,014] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-c72a813c-a3f4-442f-a4c6-7da640f6e285-500456321-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:45,014] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-ec6dc5a6-7be4-4f48-9cba-0a868c10ff23--1849773280-driver-0 with generation 2 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:45,014] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-e75e14d7-392a-4263-af37-0c09dea186e1-876116896-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:45,014] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-072ac3f5-cc50-4982-83aa-897b313d5d00-1238180100-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:45,014] INFO [Group Metadata Manager on Broker 2]: Finished unloading __consumer_offsets-20. Removed 0 cached offsets and 11 cached groups. (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:45,024] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_lottery_strategy_template-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:45,025] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_lottery_strategy_template-2, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:45,035] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.user_integral_record-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:45,035] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.user_integral_record-0, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:45,097] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_reward_type-4 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:45,098] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_reward_type-4, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:45,103] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_card_reward_record-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:45,103] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_card_reward_record-2, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:45,143] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_card_reward_record-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:45,143] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_card_reward_record-0, initOffset 5 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,152] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mf.integral_chain_db.documents-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,152] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_comment_like_record-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,152] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_user_address-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,152] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-dop.visit.collect_v2-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,152] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mf.integral_chain_db.user_daily_check_prize-3 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,152] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_card_reward_record-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,152] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_guess_source-3 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,152] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.zhongan_records-4 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,152] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_guess_comment-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,152] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition __consumer_offsets-26 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,152] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_guess_template_rel-4 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,152] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-dmp.gateway.source-dop.fdn.v2.t_rel_party_prop-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,152] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_banner-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,152] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mf.integral_chain_db.chiefpromotedocs-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,152] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mf.integral_chain_db.duobao_support_record-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,152] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mf.integral_chain_db.task_template-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,152] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.prompt_recode-4 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,153] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.user_daily_check_prize-4 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,153] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition __consumer_offsets-20 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,153] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_guess_category-4 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,153] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_guess_category-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,173] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_withdraw_record-3 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,173] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_account_record-3 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,173] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mf.integral_chain_db.user_feedbacks-4 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,173] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.news-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,173] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_attend_params-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,173] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.share_record-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,173] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.users-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,173] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-fd.fengdai_riskcontrol.loan_apply_cold_data-4 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,173] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_reward_detail-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,173] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.integral_record-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,173] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mf.integral_chain_db.duobao_goods-4 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,174] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_reward_detail-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,174] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-fd.fengdai_riskcontrol.loan_apply_cold_data-4 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,174] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.blocks-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,174] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_reward_type-4 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,174] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mf.integral_chain_db.share_record-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,174] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_user-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,174] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition __consumer_offsets-14 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,174] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.user_question_record-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,174] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_moses_id-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,174] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.reports-3 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,174] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.advertising-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,174] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_guess_template-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,174] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_card_reward_record-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,174] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_reward_record-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,174] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_guess_channel-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,174] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_lottery_strategy_template-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,174] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mf.integral_chain_db.user_integral_record-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,174] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.game_questions-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,174] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_real_name_record-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,174] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.action_record-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,174] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_invite_record-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,174] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mf.integral_chain_db.tasks-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,174] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mf.integral_chain_db.user_task_rel-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,177] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_guess-4 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,178] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_guess-4, initOffset 1132 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,179] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_guess-4 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,194] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_guess_template-4 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,194] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_guess_template-4, initOffset 1 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,203] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_card_reward_detail-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,203] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_guess_template-4 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,203] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_card_reward_detail-2, initOffset 22462 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,211] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_card_reward_detail-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,231] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-bf4acada-75a4-4237-adc0-7cae972a127e--2090012888-driver-0 with old generation 0 (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:48,232] INFO [GroupCoordinator 2]: Stabilized group spark-kafka-source-bf4acada-75a4-4237-adc0-7cae972a127e--2090012888-driver-0 generation 1 (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:48,236] INFO [GroupCoordinator 2]: Assignment received from leader for group spark-kafka-source-bf4acada-75a4-4237-adc0-7cae972a127e--2090012888-driver-0 for generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:48,241] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_account_record-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,241] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_account_record-0, initOffset 229328 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,241] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_account_record-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,255] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.page_links-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,256] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.page_links-2, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,266] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_guess_template_rel-3 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,266] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_guess_template_rel-3, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,409] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mf.integral_chain_db.page_links-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,409] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_guess_template_rel-3 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,419] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.certificate_record-4 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,420] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.certificate_record-4, initOffset 18049 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,423] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.certificate_record-4 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,428] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_withdraw_record-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,429] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_withdraw_record-0, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,435] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_withdraw_record-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,439] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.alipayreceipts-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,441] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.alipayreceipts-2, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,446] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mf.integral_chain_db.alipayreceipts-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,479] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_action_record-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,479] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_action_record-0, initOffset 4770 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,485] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_action_record-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,489] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.user_question_record-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,489] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.user_question_record-0, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,494] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mf.integral_chain_db.user_question_record-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,500] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_channel_pop_record-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,502] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_channel_pop_record-2, initOffset 727 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,506] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_channel_pop_record-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,534] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_dict-4 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,536] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_dict-4, initOffset 8 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,544] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_guess_order-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,544] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_guess_order-0, initOffset 384930 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,555] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_block-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,555] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_block-1, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,566] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.duobao_order_code_rel-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,587] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.duobao_order_code_rel-1, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,591] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_block-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,591] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_guess_order-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,591] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_dict-4 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,591] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mf.integral_chain_db.duobao_order_code_rel-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,600] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_card_reward_detail-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,601] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_card_reward_detail-2, initOffset 4492 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,610] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_user_feedback-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,612] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_user_feedback-1, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,621] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_card_reward_detail-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,621] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_user_feedback-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,624] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_activity-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,646] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_activity-0, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,650] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_activity-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,663] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.prompt_recode-3 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,664] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.prompt_recode-3, initOffset 300714 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,672] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 300714 >= the follower's log end offset 300714 in dmp.gateway.source-mf.integral_chain_db.prompt_recode-3. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,672] INFO Truncating dmp.gateway.source-mf.integral_chain_db.prompt_recode-3 to 300714 has no effect as the largest offset in the log is 300713. (kafka.log.Log) [2019-01-18 03:30:48,675] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions __consumer_offsets-8 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,678] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([__consumer_offsets-8, initOffset 153818079 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,678] INFO [Group Metadata Manager on Broker 2]: Scheduling unloading of offsets and group metadata from __consumer_offsets-8 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:48,678] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-706caacf-5155-4ba9-b4c1-f0d9fe87a05e--176149776-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:48,678] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-4bd1463b-277d-428c-9810-25506f913ca8-1050398916-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:48,678] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-4704266e-4c96-4156-8037-d4f4e7c20f83-1856965545-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:48,678] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-09107fcf-628e-4b4b-9350-ebe451c30a2b-768595836-driver-0 with generation 2 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:48,678] INFO [Group Metadata Manager on Broker 2]: Finished unloading __consumer_offsets-8. Removed 0 cached offsets and 4 cached groups. (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:48,686] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 153818079 >= the follower's log end offset 153818079 in __consumer_offsets-8. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,686] INFO Truncating __consumer_offsets-8 to 153818079 has no effect as the largest offset in the log is 153818078. (kafka.log.Log) [2019-01-18 03:30:48,716] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.alipayreceipts-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,717] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.alipayreceipts-1, initOffset 20380 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,719] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 20380 >= the follower's log end offset 20380 in dmp.gateway.formatted-mf.integral_chain_db.alipayreceipts-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,719] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.alipayreceipts-1 to 20380 has no effect as the largest offset in the log is 20379. (kafka.log.Log) [2019-01-18 03:30:48,727] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_user_card-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,728] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_user_card-0, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,743] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_banner-3 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,743] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_banner-3, initOffset 3 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,770] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_comment_like_record-4 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,771] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_comment_like_record-4, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,782] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.game_questions-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,782] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.game_questions-1, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,793] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.action_record-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,793] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.action_record-2, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,804] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.receipts-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,805] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.receipts-1, initOffset 2240 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,838] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.jujibao_goods-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,838] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.jujibao_goods-0, initOffset 3 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,839] INFO [GroupCoordinator 2]: Preparing to rebalance group notifier with old generation 8 (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:48,840] INFO [GroupCoordinator 2]: Group notifier with generation 9 is now empty (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:48,841] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-f334301d-312c-4bc9-8eb7-b0d5f6b022d6-28336156-driver-0 with old generation 1 (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:48,841] INFO [GroupCoordinator 2]: Group spark-kafka-source-f334301d-312c-4bc9-8eb7-b0d5f6b022d6-28336156-driver-0 with generation 2 is now empty (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:48,841] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-b5bdeca6-ae71-420e-9f8f-90915a18bc2d--257668569-driver-0 with old generation 1 (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:48,841] INFO [GroupCoordinator 2]: Group spark-kafka-source-b5bdeca6-ae71-420e-9f8f-90915a18bc2d--257668569-driver-0 with generation 2 is now empty (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:48,841] INFO [GroupCoordinator 2]: Preparing to rebalance group spark-kafka-source-acbd5c52-7948-4de7-b5e9-70a0303ab0ff--1221257556-driver-0 with old generation 1 (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:48,841] INFO [GroupCoordinator 2]: Group spark-kafka-source-acbd5c52-7948-4de7-b5e9-70a0303ab0ff--1221257556-driver-0 with generation 2 is now empty (__consumer_offsets-16) (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:48,849] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.chiefpromotedocs-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,850] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.chiefpromotedocs-2, initOffset 4 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,860] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.dictionaries-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,861] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.dictionaries-0, initOffset 172 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,871] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_block-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,872] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_block-0, initOffset 2194 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,961] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mx.trchain_moses_db.t_user_card-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,961] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_block-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,961] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mf.integral_chain_db.action_record-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,962] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.chiefpromotedocs-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,962] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.jujibao_goods-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,962] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mf.integral_chain_db.receipts-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,962] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_banner-3 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,962] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.dictionaries-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,962] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_comment_like_record-4 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,962] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mf.integral_chain_db.game_questions-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:48,962] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_user_card-0 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:48,975] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_user_address-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,977] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_user_address-1, initOffset 625 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,983] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.reports-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:48,985] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.reports-1, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,025] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_user_address-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,032] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 68 >= the follower's log end offset 68 in dmp.gateway.source-mf.integral_chain_db.documents-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,032] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mx.trchain_moses_db.t_comment_like_record-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,032] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mx.trchain_moses_db.t_block-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,032] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mx.trchain_moses_db.t_user_address-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,032] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.formatted-dop.visit.collect_v2-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,032] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 229328 >= the follower's log end offset 229328 in dmp.gateway.formatted-mx.trchain_moses_db.t_account_record-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,032] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.user_daily_check_prize-3. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,032] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mx.trchain_moses_db.t_card_reward_record-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,032] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.formatted-mx.trchain_moses_db.t_comment_like_record-4. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,032] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 727 >= the follower's log end offset 727 in dmp.gateway.formatted-mx.trchain_moses_db.t_channel_pop_record-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,032] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mx.trchain_moses_db.t_guess_source-3. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 5764 >= the follower's log end offset 5764 in dmp.gateway.formatted-mf.integral_chain_db.zhongan_records-4. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 4492 >= the follower's log end offset 4492 in dmp.gateway.formatted-mx.trchain_moses_db.t_card_reward_detail-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mx.trchain_moses_db.t_guess_comment-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 364 >= the follower's log end offset 364 in __consumer_offsets-26. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 4175 >= the follower's log end offset 4175 in dmp.gateway.formatted-mx.trchain_moses_db.t_guess_template_rel-4. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-dmp.gateway.source-dop.fdn.v2.t_rel_party_prop-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mx.trchain_moses_db.t_banner-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.chiefpromotedocs-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.duobao_support_record-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.task_template-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 60141 >= the follower's log end offset 60141 in dmp.gateway.formatted-mf.integral_chain_db.prompt_recode-4. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 15 >= the follower's log end offset 15 in dmp.gateway.formatted-mf.integral_chain_db.user_daily_check_prize-4. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.reports-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mx.trchain_moses_db.t_guess_template_rel-3. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 18049 >= the follower's log end offset 18049 in dmp.gateway.formatted-mf.integral_chain_db.certificate_record-4. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 125904 >= the follower's log end offset 125904 in __consumer_offsets-20. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mx.trchain_moses_db.t_guess_category-4. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 3 >= the follower's log end offset 3 in dmp.gateway.formatted-mf.integral_chain_db.jujibao_goods-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 3 >= the follower's log end offset 3 in dmp.gateway.formatted-mx.trchain_moses_db.t_guess_category-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 384930 >= the follower's log end offset 384930 in dmp.gateway.source-mx.trchain_moses_db.t_guess_order-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mx.trchain_moses_db.t_withdraw_record-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 218 >= the follower's log end offset 218 in dmp.gateway.formatted-mx.trchain_moses_db.t_withdraw_record-3. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 1146636 >= the follower's log end offset 1146636 in dmp.gateway.source-mx.trchain_moses_db.t_account_record-3. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.user_feedbacks-4. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 17013 >= the follower's log end offset 17013 in dmp.gateway.formatted-mf.integral_chain_db.news-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.game_questions-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.action_record-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 357 >= the follower's log end offset 357 in dmp.gateway.formatted-mx.trchain_moses_db.t_attend_params-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 225640 >= the follower's log end offset 225640 in dmp.gateway.formatted-mf.integral_chain_db.share_record-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 51696 >= the follower's log end offset 51696 in dmp.gateway.formatted-mf.integral_chain_db.users-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 8 >= the follower's log end offset 8 in dmp.gateway.formatted-mx.trchain_moses_db.t_dict-4. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 594858 >= the follower's log end offset 594858 in dmp.gateway.formatted-fd.fengdai_riskcontrol.loan_apply_cold_data-4. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 4375 >= the follower's log end offset 4375 in dmp.gateway.formatted-mx.trchain_moses_db.t_reward_detail-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 156424 >= the follower's log end offset 156424 in dmp.gateway.formatted-mf.integral_chain_db.integral_record-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.duobao_goods-4. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 21874 >= the follower's log end offset 21874 in dmp.gateway.source-mx.trchain_moses_db.t_reward_detail-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-fd.fengdai_riskcontrol.loan_apply_cold_data-4. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 4 >= the follower's log end offset 4 in dmp.gateway.formatted-mf.integral_chain_db.chiefpromotedocs-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 2240 >= the follower's log end offset 2240 in dmp.gateway.source-mf.integral_chain_db.receipts-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 1 >= the follower's log end offset 1 in dmp.gateway.source-mx.trchain_moses_db.t_guess_template-4. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 3 >= the follower's log end offset 3 in dmp.gateway.formatted-mx.trchain_moses_db.t_banner-3. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mx.trchain_moses_db.t_activity-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.duobao_order_code_rel-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 759896 >= the follower's log end offset 759896 in dmp.gateway.formatted-mf.integral_chain_db.blocks-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mx.trchain_moses_db.t_reward_type-4. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.share_record-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mx.trchain_moses_db.t_user-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 86898 >= the follower's log end offset 86898 in __consumer_offsets-14. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.user_question_record-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 22462 >= the follower's log end offset 22462 in dmp.gateway.source-mx.trchain_moses_db.t_card_reward_detail-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 107252 >= the follower's log end offset 107252 in dmp.gateway.formatted-mf.integral_chain_db.user_question_record-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mx.trchain_moses_db.t_moses_id-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 214 >= the follower's log end offset 214 in dmp.gateway.formatted-mf.integral_chain_db.reports-3. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 18 >= the follower's log end offset 18 in dmp.gateway.formatted-mf.integral_chain_db.advertising-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.formatted-mx.trchain_moses_db.t_guess_template-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 5 >= the follower's log end offset 5 in dmp.gateway.formatted-mx.trchain_moses_db.t_card_reward_record-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 4770 >= the follower's log end offset 4770 in dmp.gateway.formatted-mx.trchain_moses_db.t_action_record-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.alipayreceipts-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 35 >= the follower's log end offset 35 in dmp.gateway.formatted-mx.trchain_moses_db.t_reward_record-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 10 >= the follower's log end offset 10 in dmp.gateway.formatted-mx.trchain_moses_db.t_guess_channel-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 2194 >= the follower's log end offset 2194 in dmp.gateway.formatted-mx.trchain_moses_db.t_block-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mx.trchain_moses_db.t_lottery_strategy_template-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.user_integral_record-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.page_links-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 112 >= the follower's log end offset 112 in dmp.gateway.formatted-mf.integral_chain_db.game_questions-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 674 >= the follower's log end offset 674 in dmp.gateway.formatted-mx.trchain_moses_db.t_real_name_record-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,054] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 26104 >= the follower's log end offset 26104 in dmp.gateway.formatted-mf.integral_chain_db.action_record-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,055] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.formatted-mx.trchain_moses_db.t_user_feedback-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,055] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 47696 >= the follower's log end offset 47696 in dmp.gateway.formatted-mx.trchain_moses_db.t_invite_record-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,055] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 172 >= the follower's log end offset 172 in dmp.gateway.formatted-mf.integral_chain_db.dictionaries-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,055] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 1132 >= the follower's log end offset 1132 in dmp.gateway.formatted-mx.trchain_moses_db.t_guess-4. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,055] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.tasks-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,055] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.user_task_rel-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_withdraw_record-3 to 218 has no effect as the largest offset in the log is 217. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_card_reward_record-0 to 5 has no effect as the largest offset in the log is 4. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.formatted-dop.visit.collect_v2-0 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.blocks-1 to 759896 has no effect as the largest offset in the log is 759895. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mf.integral_chain_db.user_integral_record-0 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-dmp.gateway.source-dop.fdn.v2.t_rel_party_prop-1 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mf.integral_chain_db.tasks-1 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_invite_record-2 to 47696 has no effect as the largest offset in the log is 47695. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mf.integral_chain_db.share_record-2 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mf.integral_chain_db.receipts-1 to 2240 has no effect as the largest offset in the log is 2239. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mf.integral_chain_db.user_daily_check_prize-3 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_activity-0 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_banner-3 to 3 has no effect as the largest offset in the log is 2. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.share_record-0 to 225640 has no effect as the largest offset in the log is 225639. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.game_questions-2 to 112 has no effect as the largest offset in the log is 111. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_guess_category-1 to 3 has no effect as the largest offset in the log is 2. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.advertising-1 to 18 has no effect as the largest offset in the log is 17. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_user_address-0 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_card_reward_record-2 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_reward_type-4 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_guess_category-4 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_guess_order-0 to 384930 has no effect as the largest offset in the log is 384929. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mf.integral_chain_db.user_task_rel-2 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mf.integral_chain_db.duobao_goods-4 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mf.integral_chain_db.page_links-2 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mf.integral_chain_db.chiefpromotedocs-1 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_card_reward_detail-2 to 22462 has no effect as the largest offset in the log is 22461. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_card_reward_detail-2 to 4492 has no effect as the largest offset in the log is 4491. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.reports-3 to 214 has no effect as the largest offset in the log is 213. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mf.integral_chain_db.duobao_support_record-1 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_withdraw_record-0 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mf.integral_chain_db.task_template-1 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_guess_template_rel-4 to 4175 has no effect as the largest offset in the log is 4174. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_comment_like_record-0 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_action_record-0 to 4770 has no effect as the largest offset in the log is 4769. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_channel_pop_record-2 to 727 has no effect as the largest offset in the log is 726. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mf.integral_chain_db.documents-2 to 68 has no effect as the largest offset in the log is 67. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_moses_id-0 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mf.integral_chain_db.user_feedbacks-4 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mf.integral_chain_db.duobao_order_code_rel-1 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating __consumer_offsets-26 to 364 has no effect as the largest offset in the log is 363. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_guess_comment-1 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_guess_source-3 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_reward_record-0 to 35 has no effect as the largest offset in the log is 34. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mf.integral_chain_db.user_question_record-0 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,055] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_lottery_strategy_template-2 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating __consumer_offsets-20 to 125904 has no effect as the largest offset in the log is 125903. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.zhongan_records-4 to 5764 has no effect as the largest offset in the log is 5763. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.user_question_record-2 to 107252 has no effect as the largest offset in the log is 107251. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_banner-1 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_attend_params-0 to 357 has no effect as the largest offset in the log is 356. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.users-0 to 51696 has no effect as the largest offset in the log is 51695. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.chiefpromotedocs-2 to 4 has no effect as the largest offset in the log is 3. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_guess_template-4 to 1 has no effect as the largest offset in the log is 0. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_user-1 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_reward_detail-0 to 4375 has no effect as the largest offset in the log is 4374. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_comment_like_record-4 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_guess_template-1 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.source-fd.fengdai_riskcontrol.loan_apply_cold_data-4 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.source-mf.integral_chain_db.action_record-2 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_user_feedback-1 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_account_record-0 to 229328 has no effect as the largest offset in the log is 229327. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.dictionaries-0 to 172 has no effect as the largest offset in the log is 171. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_guess_template_rel-3 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_dict-4 to 8 has no effect as the largest offset in the log is 7. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_reward_detail-1 to 21874 has no effect as the largest offset in the log is 21873. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.user_daily_check_prize-4 to 15 has no effect as the largest offset in the log is 14. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating __consumer_offsets-14 to 86898 has no effect as the largest offset in the log is 86897. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.certificate_record-4 to 18049 has no effect as the largest offset in the log is 18048. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.formatted-fd.fengdai_riskcontrol.loan_apply_cold_data-4 to 594858 has no effect as the largest offset in the log is 594857. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.integral_record-0 to 156424 has no effect as the largest offset in the log is 156423. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_guess_channel-1 to 10 has no effect as the largest offset in the log is 9. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_account_record-3 to 1146636 has no effect as the largest offset in the log is 1146635. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.source-mf.integral_chain_db.alipayreceipts-2 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.source-mf.integral_chain_db.reports-1 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_block-1 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.jujibao_goods-0 to 3 has no effect as the largest offset in the log is 2. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.action_record-0 to 26104 has no effect as the largest offset in the log is 26103. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_block-0 to 2194 has no effect as the largest offset in the log is 2193. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.source-mf.integral_chain_db.game_questions-1 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_real_name_record-1 to 674 has no effect as the largest offset in the log is 673. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_guess-4 to 1132 has no effect as the largest offset in the log is 1131. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.prompt_recode-4 to 60141 has no effect as the largest offset in the log is 60140. (kafka.log.Log) [2019-01-18 03:30:52,056] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.news-1 to 17013 has no effect as the largest offset in the log is 17012. (kafka.log.Log) [2019-01-18 03:30:52,059] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.certificate_record-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,060] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.certificate_record-2, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,062] INFO Updated PartitionLeaderEpoch. New: {epoch:35, offset:86898}, Current: {epoch:34, offset86886} for Partition: __consumer_offsets-14. Cache now contains 7 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:52,063] INFO Updated PartitionLeaderEpoch. New: {epoch:35, offset:125904}, Current: {epoch:34, offset125892} for Partition: __consumer_offsets-20. Cache now contains 8 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:52,069] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.certificate_record-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,069] INFO Truncating dmp.gateway.source-mf.integral_chain_db.certificate_record-2 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,072] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.user_factor_time_record-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,073] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.user_factor_time_record-1, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,075] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.user_factor_time_record-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,076] INFO Truncating dmp.gateway.source-mf.integral_chain_db.user_factor_time_record-1 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,082] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.user_factor_record-4 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,083] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.user_factor_record-4, initOffset 1358081 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,086] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 1358081 >= the follower's log end offset 1358081 in dmp.gateway.formatted-mf.integral_chain_db.user_factor_record-4. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,086] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.user_factor_record-4 to 1358081 has no effect as the largest offset in the log is 1358080. (kafka.log.Log) [2019-01-18 03:30:52,113] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.prompt_conf-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,115] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.prompt_conf-1, initOffset 8 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,118] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 8 >= the follower's log end offset 8 in dmp.gateway.formatted-mf.integral_chain_db.prompt_conf-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,118] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.prompt_conf-1 to 8 has no effect as the largest offset in the log is 7. (kafka.log.Log) [2019-01-18 03:30:52,126] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.zhongan_records-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,128] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.zhongan_records-2, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,133] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.zhongan_records-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,133] INFO Truncating dmp.gateway.source-mf.integral_chain_db.zhongan_records-2 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,142] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.user_daily_record-4 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,143] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.user_daily_record-4, initOffset 466872 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,289] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 466872 >= the follower's log end offset 466872 in dmp.gateway.formatted-mf.integral_chain_db.user_daily_record-4. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,289] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.user_daily_record-4 to 466872 has no effect as the largest offset in the log is 466871. (kafka.log.Log) [2019-01-18 03:30:52,301] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.documents-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,303] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.documents-2, initOffset 13 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,314] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.duobao_order_code_rel-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,314] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.duobao_order_code_rel-2, initOffset 54148 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,326] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_action_record-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,327] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_action_record-2, initOffset 23849 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,330] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.duobao_order_code_rel-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,330] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 13 >= the follower's log end offset 13 in dmp.gateway.formatted-mf.integral_chain_db.documents-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,330] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.documents-2 to 13 has no effect as the largest offset in the log is 12. (kafka.log.Log) [2019-01-18 03:30:52,359] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 23849 >= the follower's log end offset 23849 in dmp.gateway.source-mx.trchain_moses_db.t_action_record-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,359] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_action_record-2 to 23849 has no effect as the largest offset in the log is 23848. (kafka.log.Log) [2019-01-18 03:30:52,362] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.ads-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,363] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.ads-1, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,366] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.ads-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,367] INFO Truncating dmp.gateway.source-mf.integral_chain_db.ads-1 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,372] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_user_feedback-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,374] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_user_feedback-2, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,381] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mx.trchain_moses_db.t_user_feedback-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,381] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_user_feedback-2 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,407] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.dictionaries-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,408] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.dictionaries-1, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,411] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.dictionaries-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,411] INFO Truncating dmp.gateway.source-mf.integral_chain_db.dictionaries-1 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,416] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-fk.fd.fengdai_riskcontrol.loan_apply_cold_data-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,418] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-fk.fd.fengdai_riskcontrol.loan_apply_cold_data-0, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,419] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-fk.fd.fengdai_riskcontrol.loan_apply_cold_data-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,419] INFO Truncating dmp.gateway.source-fk.fd.fengdai_riskcontrol.loan_apply_cold_data-0 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:52,427] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_card-4 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,429] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_card-4, initOffset 1 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,434] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 1 >= the follower's log end offset 1 in dmp.gateway.formatted-mx.trchain_moses_db.t_card-4. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,435] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_card-4 to 1 has no effect as the largest offset in the log is 0. (kafka.log.Log) [2019-01-18 03:30:52,463] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_activity-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,464] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_activity-0, initOffset 1 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,470] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 1 >= the follower's log end offset 1 in dmp.gateway.formatted-mx.trchain_moses_db.t_activity-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,470] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_activity-0 to 1 has no effect as the largest offset in the log is 0. (kafka.log.Log) [2019-01-18 03:30:52,473] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_zhongan_record-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,474] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_zhongan_record-2, initOffset 1590 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,479] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 1590 >= the follower's log end offset 1590 in dmp.gateway.formatted-mx.trchain_moses_db.t_zhongan_record-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,480] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_zhongan_record-2 to 1590 has no effect as the largest offset in the log is 1589. (kafka.log.Log) [2019-01-18 03:30:52,483] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_lottery_strategy-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,484] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_lottery_strategy-0, initOffset 2 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,487] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 2 >= the follower's log end offset 2 in dmp.gateway.formatted-mx.trchain_moses_db.t_lottery_strategy-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:52,487] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_lottery_strategy-0 to 2 has no effect as the largest offset in the log is 1. (kafka.log.Log) [2019-01-18 03:30:52,520] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.user_factor_record-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,521] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.user_factor_record-0, initOffset 6790409 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,534] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.jujibao_goods-3 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,535] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.jujibao_goods-3, initOffset 12 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,545] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.withdrawal_reocrd-3 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,546] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.withdrawal_reocrd-3, initOffset 11488 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,630] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_guess_order-3 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,631] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_guess_order-3, initOffset 76987 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,667] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions __consumer_offsets-44 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,668] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([__consumer_offsets-44, initOffset 555 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:52,668] INFO [Group Metadata Manager on Broker 2]: Scheduling unloading of offsets and group metadata from __consumer_offsets-44 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:52,668] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-26c4ab70-c0bd-4428-be27-0e9fff867d12--2087617462-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:52,668] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-b7b0bc51-b98b-411c-9d40-005c9e143555--1441648160-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:52,668] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-15944fd2-6eb8-48af-9ac0-31f93792044b-28336156-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:52,668] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-921d2f48-5e87-46ac-b248-4d026a6ee56b-1901791911-driver-0 with generation 2 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:52,668] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-b851e39e-8e70-4335-82ac-ffba8c09cca0-700691772-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:52,668] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-34f413c3-4ccb-4fee-a195-9e1c1f87a779--1887923495-driver-0 with generation 2 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:52,668] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-476d6c4a-0009-4e88-8fa8-3d16f710a026-474598688-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:52,668] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-0be69731-ddc9-478d-aab4-d5981c1e7450--819319583-driver-0 with generation 5 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:52,668] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-238785f3-911d-4aed-bead-826521b848e0--248226313-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:52,668] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-a6a533bd-0ec7-41a4-a02b-e493a3aafe02--1236027371-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:52,668] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-7816ca20-338c-45c9-99a6-8b025abbbd51-1200207168-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:52,668] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-b582ac76-a89a-433c-93dc-4b1fbb621f50-1012125394-driver-0 with generation 2 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:52,668] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-8f0e0b7c-02be-47e3-8500-35055a10222a--2111530553-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:52,668] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-0077e461-810b-4d2a-8068-50cf95cdd6ba-206118916-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:52,668] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-6379b9e4-1f14-410e-8afe-5a9a2caedabf--1517733762-driver-0 with generation 2 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:52,669] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-25ada92e-409e-4665-8214-9e16bc0214c0-1943940070-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:52,669] INFO [Group Metadata Manager on Broker 2]: Finished unloading __consumer_offsets-44. Removed 0 cached offsets and 16 cached groups. (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:55,619] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_channel_pop_record-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,620] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_channel_pop_record-2, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,630] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.ads-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,630] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.ads-2, initOffset 19 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,641] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.receipts-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,642] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.receipts-2, initOffset 448 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,652] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_lottery_strategy_template-3 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,653] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_lottery_strategy_template-3, initOffset 2 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,664] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_reward_type-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,664] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_reward_type-0, initOffset 5 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,692] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.user_integral_record-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,693] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.user_integral_record-2, initOffset 16878454 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,703] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.duobao_orders-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,704] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.duobao_orders-0, initOffset 17328 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,714] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_guess_comment-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,714] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_guess_comment-0, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,726] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.reward_records-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,726] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.reward_records-0, initOffset 17618 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,851] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 6790409 >= the follower's log end offset 6790409 in dmp.gateway.source-mf.integral_chain_db.user_factor_record-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:55,851] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mf.integral_chain_db.jujibao_goods-3 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:55,851] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mf.integral_chain_db.withdrawal_reocrd-3 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:55,851] INFO Truncating dmp.gateway.source-mf.integral_chain_db.user_factor_record-0 to 6790409 has no effect as the largest offset in the log is 6790408. (kafka.log.Log) [2019-01-18 03:30:55,866] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_moses_id-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,867] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_moses_id-0, initOffset 5743 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,871] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.blocks-4 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,871] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.blocks-4, initOffset 3799486 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,884] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.jujibao_order-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,885] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.jujibao_order-0, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,891] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.receipts-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:55,891] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.user_integral_record-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:55,891] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 555 >= the follower's log end offset 555 in __consumer_offsets-44. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:55,891] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.duobao_orders-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:55,891] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_channel_pop_record-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:55,891] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.ads-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:55,891] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 625 >= the follower's log end offset 625 in dmp.gateway.formatted-mx.trchain_moses_db.t_user_address-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:55,891] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mf.integral_chain_db.blocks-4 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:55,891] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mf.integral_chain_db.jujibao_order-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:55,891] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.reward_records-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:55,891] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 54148 >= the follower's log end offset 54148 in dmp.gateway.formatted-mf.integral_chain_db.duobao_order_code_rel-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:55,891] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_reward_type-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:55,891] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_lottery_strategy_template-3 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:55,891] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 76987 >= the follower's log end offset 76987 in dmp.gateway.formatted-mx.trchain_moses_db.t_guess_order-3. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:55,891] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_moses_id-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:55,891] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_guess_comment-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:55,891] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_user_address-1 to 625 has no effect as the largest offset in the log is 624. (kafka.log.Log) [2019-01-18 03:30:55,891] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_guess_order-3 to 76987 has no effect as the largest offset in the log is 76986. (kafka.log.Log) [2019-01-18 03:30:55,891] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.duobao_order_code_rel-2 to 54148 has no effect as the largest offset in the log is 54147. (kafka.log.Log) [2019-01-18 03:30:55,891] INFO Truncating __consumer_offsets-44 to 555 has no effect as the largest offset in the log is 554. (kafka.log.Log) [2019-01-18 03:30:55,926] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_guess-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,927] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_guess-1, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,929] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_guess-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:55,933] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.duobao_orders-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,934] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.duobao_orders-0, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,942] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.duobao_orders-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:55,942] INFO Truncating dmp.gateway.source-mf.integral_chain_db.duobao_orders-0 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:55,946] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.user_factor_time_record-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,947] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.user_factor_time_record-0, initOffset 517444 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,951] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 517444 >= the follower's log end offset 517444 in dmp.gateway.formatted-mf.integral_chain_db.user_factor_time_record-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:55,951] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.user_factor_time_record-0 to 517444 has no effect as the largest offset in the log is 517443. (kafka.log.Log) [2019-01-18 03:30:55,982] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_token_recycle_record-3 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,983] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_token_recycle_record-3, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,989] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mx.trchain_moses_db.t_token_recycle_record-3. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:55,989] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_token_recycle_record-3 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:55,993] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_zhongan_record-4 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,995] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_zhongan_record-4, initOffset 7950 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:55,998] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 7950 >= the follower's log end offset 7950 in dmp.gateway.source-mx.trchain_moses_db.t_zhongan_record-4. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:55,998] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_zhongan_record-4 to 7950 has no effect as the largest offset in the log is 7949. (kafka.log.Log) [2019-01-18 03:30:56,003] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_guess_channel-3 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:56,005] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_guess_channel-3, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:56,009] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mx.trchain_moses_db.t_guess_channel-3. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:56,009] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_guess_channel-3 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:56,036] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.prompt_conf-3 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:56,037] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.prompt_conf-3, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:56,048] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.page_links-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:56,050] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.page_links-0, initOffset 12 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:56,058] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions __consumer_offsets-32 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:56,060] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([__consumer_offsets-32, initOffset 14085 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:56,060] INFO [Group Metadata Manager on Broker 2]: Scheduling unloading of offsets and group metadata from __consumer_offsets-32 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:56,060] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-8069a163-a9a9-4c66-bd4f-c1f9ec820297-197692969-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:56,060] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-660f6a69-4512-4424-865b-15ecb4d03b03--2037239424-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:56,060] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-bec6eb20-50df-42ad-8514-51eac7ef4182-2039577763-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:56,060] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-05ca9f20-1beb-4de2-8647-549a99acf711--1708792140-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:56,060] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-2b313860-dbdf-4332-9c01-b621a46c1152-199510799-driver-0 with generation 5 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:56,060] INFO [Group Metadata Manager on Broker 2]: Finished unloading __consumer_offsets-32. Removed 0 cached offsets and 5 cached groups. (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:56,094] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_attend_params-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:56,094] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_attend_params-1, initOffset 1789 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:56,105] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.users-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:56,105] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.users-2, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:56,116] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_real_name_record-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:56,116] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_real_name_record-1, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:56,127] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_invite_record-4 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:56,128] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_invite_record-4, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:56,201] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions __consumer_offsets-38 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:56,203] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([__consumer_offsets-38, initOffset 37464925 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:56,203] INFO [Group Metadata Manager on Broker 2]: Scheduling unloading of offsets and group metadata from __consumer_offsets-38 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:56,203] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-87997dbd-75ab-45c7-ab3e-ec71d07fe1ea-1503566138-driver-0 with generation 5 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:56,203] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-1b7e1fe6-d7a6-4e10-af1e-17f1a2994f33-1642761939-driver-0 with generation 2 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:56,203] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-5640eead-369b-482e-8cd3-aa4f0435ca51-897073650-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:56,203] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-4b0512dd-c787-474f-8f38-5b79fa2a9889--1625250976-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:56,203] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-68f1cd5f-c983-4079-966a-3cd08905f8ab-791973104-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:56,203] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-9bd74c99-2330-427e-807d-9f8065250f24--941239602-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:56,203] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-0c59ada2-67f7-48bc-b2cb-d33476c221a0--1669254243-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:56,203] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-1720b453-56e4-416b-b6d3-ea3cb3fc895b-1648856769-driver-0 with generation 2 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:56,203] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-94b3ddbf-399b-41f1-a9b0-f0422d3918bf--1329287788-driver-0 with generation 2 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:56,203] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-bbdb470c-40d7-4279-a4f7-e729f7d1e21c--1887923495-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:56,203] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-72e65de1-295b-41e5-8fe7-620ff17a7992-259269953-driver-0 with generation 2 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:56,203] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-a823e38e-9f96-46c8-927d-77e412241033--675479282-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:56,203] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-b1bc2332-ba35-4d08-8848-ee0fc23fe112-117021769-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:56,203] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-60ea3ff9-ed90-4aaa-b7ce-9738869fbe67--1736482288-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:56,203] INFO [Group Metadata Manager on Broker 2]: Finished unloading __consumer_offsets-38. Removed 0 cached offsets and 14 cached groups. (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:59,154] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_guess_option-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,155] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_guess_option-2, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,164] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.jujibao_order-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,164] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.jujibao_order-2, initOffset 478 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,175] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_user-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,176] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_user-2, initOffset 53219 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,187] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.user_task_rel-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,187] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.user_task_rel-1, initOffset 552939 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,198] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_guess_source-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,217] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_guess_source-1, initOffset 6 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,229] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.withdrawal_reocrd-3 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,229] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.prompt_conf-3. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,229] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_invite_record-4 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,229] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 14085 >= the follower's log end offset 14085 in __consumer_offsets-32. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,229] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_real_name_record-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,229] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 12 >= the follower's log end offset 12 in dmp.gateway.formatted-mf.integral_chain_db.page_links-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,229] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mf.integral_chain_db.users-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,229] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_attend_params-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,229] INFO Truncating dmp.gateway.source-mf.integral_chain_db.prompt_conf-3 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:59,230] INFO Truncating __consumer_offsets-32 to 14085 has no effect as the largest offset in the log is 14084. (kafka.log.Log) [2019-01-18 03:30:59,230] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.page_links-0 to 12 has no effect as the largest offset in the log is 11. (kafka.log.Log) [2019-01-18 03:30:59,233] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.withdrawal_reocrd-3, initOffset 2297 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,237] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mx.trchain_moses_db.t_guess-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,237] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 448 >= the follower's log end offset 448 in dmp.gateway.formatted-mf.integral_chain_db.receipts-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,237] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 16878454 >= the follower's log end offset 16878454 in dmp.gateway.formatted-mf.integral_chain_db.user_integral_record-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,237] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 17328 >= the follower's log end offset 17328 in dmp.gateway.formatted-mf.integral_chain_db.duobao_orders-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,237] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.jujibao_order-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,237] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mx.trchain_moses_db.t_channel_pop_record-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,237] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_user-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,237] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 12 >= the follower's log end offset 12 in dmp.gateway.source-mf.integral_chain_db.jujibao_goods-3. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,237] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 11488 >= the follower's log end offset 11488 in dmp.gateway.source-mf.integral_chain_db.withdrawal_reocrd-3. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,237] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 19 >= the follower's log end offset 19 in dmp.gateway.formatted-mf.integral_chain_db.ads-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,237] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_guess_source-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,237] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 3799486 >= the follower's log end offset 3799486 in dmp.gateway.source-mf.integral_chain_db.blocks-4. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,237] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.jujibao_order-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,237] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 17618 >= the follower's log end offset 17618 in dmp.gateway.formatted-mf.integral_chain_db.reward_records-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,237] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_guess_option-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,237] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.withdrawal_reocrd-3 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,237] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 5 >= the follower's log end offset 5 in dmp.gateway.formatted-mx.trchain_moses_db.t_reward_type-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,237] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.user_task_rel-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,237] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 2 >= the follower's log end offset 2 in dmp.gateway.formatted-mx.trchain_moses_db.t_lottery_strategy_template-3. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,237] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 5743 >= the follower's log end offset 5743 in dmp.gateway.formatted-mx.trchain_moses_db.t_moses_id-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,237] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition __consumer_offsets-38 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,237] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.formatted-mx.trchain_moses_db.t_guess_comment-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,237] INFO Truncating dmp.gateway.source-mf.integral_chain_db.withdrawal_reocrd-3 to 11488 has no effect as the largest offset in the log is 11487. (kafka.log.Log) [2019-01-18 03:30:59,237] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_reward_type-0 to 5 has no effect as the largest offset in the log is 4. (kafka.log.Log) [2019-01-18 03:30:59,237] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.duobao_orders-0 to 17328 has no effect as the largest offset in the log is 17327. (kafka.log.Log) [2019-01-18 03:30:59,237] INFO Truncating dmp.gateway.source-mf.integral_chain_db.blocks-4 to 3799486 has no effect as the largest offset in the log is 3799485. (kafka.log.Log) [2019-01-18 03:30:59,237] INFO Truncating dmp.gateway.source-mf.integral_chain_db.jujibao_goods-3 to 12 has no effect as the largest offset in the log is 11. (kafka.log.Log) [2019-01-18 03:30:59,237] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.ads-2 to 19 has no effect as the largest offset in the log is 18. (kafka.log.Log) [2019-01-18 03:30:59,237] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_guess_comment-0 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:59,238] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_guess-1 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:59,238] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_channel_pop_record-2 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:59,238] INFO Truncating dmp.gateway.source-mf.integral_chain_db.jujibao_order-0 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:59,238] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.receipts-2 to 448 has no effect as the largest offset in the log is 447. (kafka.log.Log) [2019-01-18 03:30:59,238] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_moses_id-0 to 5743 has no effect as the largest offset in the log is 5742. (kafka.log.Log) [2019-01-18 03:30:59,238] INFO Truncating dmp.gateway.formatted-mx.trchain_moses_db.t_lottery_strategy_template-3 to 2 has no effect as the largest offset in the log is 1. (kafka.log.Log) [2019-01-18 03:30:59,238] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.reward_records-0 to 17618 has no effect as the largest offset in the log is 17617. (kafka.log.Log) [2019-01-18 03:30:59,238] INFO Truncating dmp.gateway.formatted-mf.integral_chain_db.user_integral_record-2 to 16878454 has no effect as the largest offset in the log is 16878453. (kafka.log.Log) [2019-01-18 03:30:59,241] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.tasks-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,242] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.tasks-0, initOffset 89 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,250] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.tasks-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,253] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_user_card-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,387] INFO Updated PartitionLeaderEpoch. New: {epoch:34, offset:555}, Current: {epoch:33, offset538} for Partition: __consumer_offsets-44. Cache now contains 7 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:59,389] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_user_card-2, initOffset 22643 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,394] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_user_card-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,399] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.integral_record-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,399] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.integral_record-2, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,410] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mf.integral_chain_db.integral_record-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,414] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_dict-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,415] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_dict-2, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,424] INFO Updated PartitionLeaderEpoch. New: {epoch:35, offset:153818079}, Current: {epoch:34, offset153818078} for Partition: __consumer_offsets-8. Cache now contains 16 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:59,425] INFO Updated PartitionLeaderEpoch. New: {epoch:35, offset:364}, Current: {epoch:34, offset357} for Partition: __consumer_offsets-26. Cache now contains 16 entries. (kafka.server.epoch.LeaderEpochFileCache) [2019-01-18 03:30:59,428] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mx.trchain_moses_db.t_dict-2. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,428] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_dict-2 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:59,432] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_reward_record-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,434] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_reward_record-0, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,455] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mx.trchain_moses_db.t_reward_record-0. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,455] INFO Truncating dmp.gateway.source-mx.trchain_moses_db.t_reward_record-0 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:59,466] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.reward_records-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,468] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.reward_records-1, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,481] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.advertising-3 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,481] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.advertising-3, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,492] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mf.integral_chain_db.banners-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,492] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mf.integral_chain_db.banners-1, initOffset 29 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,528] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_lottery_strategy-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,529] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_lottery_strategy-0, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,540] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.formatted-mx.trchain_moses_db.t_token_recycle_record-0 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,540] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.formatted-mx.trchain_moses_db.t_token_recycle_record-0, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,551] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mf.integral_chain_db.rewards-1 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,552] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mf.integral_chain_db.rewards-1, initOffset 0 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,554] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mf.integral_chain_db.advertising-3 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,554] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mf.integral_chain_db.banners-1 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,554] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.reward_records-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,554] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.source-mx.trchain_moses_db.t_lottery_strategy-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,554] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition dmp.gateway.formatted-mx.trchain_moses_db.t_token_recycle_record-0 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,554] INFO Truncating dmp.gateway.source-mf.integral_chain_db.reward_records-1 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:59,562] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions __consumer_offsets-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,564] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([__consumer_offsets-2, initOffset 653 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,564] INFO [Group Metadata Manager on Broker 2]: Scheduling unloading of offsets and group metadata from __consumer_offsets-2 (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:59,564] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-8c863ade-6b11-40da-a3a6-5534afe94a40--2124307122-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:59,564] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-7735bd3f-5c42-4db3-a099-a927b904344b-1705699548-driver-0 with generation 2 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:59,564] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-593357fb-eb08-4781-a066-923fcd480d41-32364653-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:59,564] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-f1d8db37-772e-4b3f-a5c4-70276bd25159--1120656763-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:59,565] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-05003df5-527f-4652-bb9a-34b2b924e6bf-1482310392-driver-0 with generation 2 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:59,565] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-2bd610ea-8eeb-4158-b788-27b7eded71bf-1282958627-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:59,565] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-66e2a912-fa6f-4518-894e-bdf06cdec06a--1095141852-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:59,565] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-8f009b40-ee74-4612-b05b-c4524ca2d825--1044213306-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:59,565] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-2236a8ed-9311-4312-ae19-54799904d499-585853710-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:59,565] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-d3d4e41e-76ab-4578-b768-0f5822f6e5dc--1612096696-driver-0 with generation 1 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:59,565] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-dc642db0-80b9-4af0-a551-e6a599fd42f1-2016975157-driver-0 with generation 2 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:59,565] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-82cc4a74-afb9-4372-800f-edbea73ebf8f--1138975524-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:59,565] INFO [GroupCoordinator 2]: Unloading group metadata for spark-kafka-source-6ac09db2-9201-4d33-8804-924a54ed66df-31592151-driver-0 with generation 3 (kafka.coordinator.group.GroupCoordinator) [2019-01-18 03:30:59,565] INFO [Group Metadata Manager on Broker 2]: Finished unloading __consumer_offsets-2. Removed 0 cached offsets and 13 cached groups. (kafka.coordinator.group.GroupMetadataManager) [2019-01-18 03:30:59,624] INFO [ReplicaFetcherThread-0-1]: Based on follower's leader epoch, leader replied with an offset 0 >= the follower's log end offset 0 in dmp.gateway.source-mf.integral_chain_db.rewards-1. No truncation needed. (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,624] INFO [ReplicaFetcherThread-0-1]: Retrying leaderEpoch request for partition __consumer_offsets-2 as the leader reported an error: NOT_LEADER_FOR_PARTITION (kafka.server.ReplicaFetcherThread) [2019-01-18 03:30:59,624] INFO Truncating dmp.gateway.source-mf.integral_chain_db.rewards-1 to 0 has no effect as the largest offset in the log is -1. (kafka.log.Log) [2019-01-18 03:30:59,633] INFO [ReplicaFetcherManager on broker 2] Removed fetcher for partitions dmp.gateway.source-mx.trchain_moses_db.t_guess_channel_rel-2 (kafka.server.ReplicaFetcherManager) [2019-01-18 03:30:59,634] INFO [ReplicaFetcherManager on broker 2] Added fetcher for partitions List([dmp.gateway.source-mx.trchain_moses_db.t_guess_channel_rel-2, initOffset 244 to broker BrokerEndPoint(1,10.211.6.55,9092)] ) (kafka.server.ReplicaFetcherManager)