# Run 1 - Demonstrates problem

## Connect Stream for topic mytopic

12/01/06 12:00:46 INFO consumer.ZookeeperConsumerConnector: begin registering consumer test_group_1_XXXXX-1325869246757 in ZK
12/01/06 12:00:46 INFO consumer.ZookeeperConsumerConnector: end registering consumer test_group_1_XXXXX-1325869246757 in ZK
12/01/06 12:00:46 INFO consumer.ZookeeperConsumerConnector: begin rebalancing consumer test_group_1_XXXXX-1325869246757 try #0
12/01/06 12:00:47 INFO consumer.ZookeeperConsumerConnector: Committing all offsets
12/01/06 12:00:47 INFO consumer.ZookeeperConsumerConnector: Releasing partition ownership
12/01/06 12:00:47 INFO consumer.ZookeeperConsumerConnector: Consumer test_group_1_XXXXX-1325869246757 rebalancing the following partitions: List(0-0) for topic mytopic with consumers: List(test_group_1_XXXXX-1325869246757-0)
12/01/06 12:00:47 INFO consumer.ZookeeperConsumerConnector: test_group_1_XXXXX-1325869246757-0 attempting to claim partition 0-0
12/01/06 12:00:47 INFO consumer.ZookeeperConsumerConnector: Consumer test_group_1_XXXXX-1325869246757 selected partitions : mytopic:0-0
12/01/06 12:00:47 INFO consumer.ZookeeperConsumerConnector: end rebalancing consumer test_group_1_XXXXX-1325869246757 try #0
12/01/06 12:00:47 INFO consumer.FetcherRunnable: FetchRunnable-0 start fetching topic: mytopic part: 0 offset: 12600000 from 127.0.1.1:9092

## Create consumer thread for topic mytopic
## Connect Stream for topic mytopic1

12/01/06 12:00:47 INFO consumer.ZookeeperConsumerConnector: begin registering consumer test_group_1_XXXXX-1325869247363 in ZK
12/01/06 12:00:47 INFO consumer.ZookeeperConsumerConnector: end registering consumer test_group_1_XXXXX-1325869247363 in ZK
12/01/06 12:00:47 INFO consumer.ZookeeperConsumerConnector: begin rebalancing consumer test_group_1_XXXXX-1325869246757 try #0
12/01/06 12:00:47 INFO consumer.ZookeeperConsumerConnector: Consumer test_group_1_XXXXX-1325869246757 with Map(mytopic1 -> List(test_group_1_XXXXX-1325869247363-0), mytopic -> List(test_group_1_XXXXX-1325869246757-0)) doesn't need to rebalance.
12/01/06 12:00:47 INFO consumer.ZookeeperConsumerConnector: end rebalancing consumer test_group_1_XXXXX-1325869246757 try #0
12/01/06 12:00:47 INFO consumer.ZookeeperConsumerConnector: begin rebalancing consumer test_group_1_XXXXX-1325869247363 try #0
12/01/06 12:00:47 INFO consumer.ZookeeperConsumerConnector: Committing all offsets
12/01/06 12:00:47 INFO consumer.ZookeeperConsumerConnector: Releasing partition ownership
12/01/06 12:00:47 INFO consumer.ZookeeperConsumerConnector: Consumer test_group_1_XXXXX-1325869247363 rebalancing the following partitions: List(0-0) for topic mytopic1 with consumers: List(test_group_1_XXXXX-1325869247363-0)
12/01/06 12:00:47 INFO consumer.ZookeeperConsumerConnector: test_group_1_XXXXX-1325869247363-0 attempting to claim partition 0-0
12/01/06 12:00:47 INFO consumer.ZookeeperConsumerConnector: Consumer test_group_1_XXXXX-1325869247363 selected partitions : mytopic1:0-0,mytopic:0-0
12/01/06 12:00:47 INFO consumer.FetcherRunnable: FecherRunnable Thread[FetchRunnable-0,5,main] interrupted
12/01/06 12:00:47 INFO consumer.FetcherRunnable: stopping fetcher FetchRunnable-0 to host 127.0.1.1

## Create consumer thread for topic mytopic1

12/01/06 12:00:47 INFO consumer.ZookeeperConsumerConnector: end rebalancing consumer test_group_1_XXXXX-1325869247363 try #0
12/01/06 12:00:47 INFO consumer.FetcherRunnable: FetchRunnable-0 start fetching topic: mytopic part: 0 offset: 12907200 from 127.0.1.1:9092
12/01/06 12:00:47 INFO consumer.FetcherRunnable: FetchRunnable-0 start fetching topic: mytopic1 part: 0 offset: 13490019 from 127.0.1.1:9092
12/01/06 12:00:47 ERROR consumer.ConsumerIterator: consumed offset: 12600000 doesn't match fetch offset: 12907200 for mytopic:0-0; consumer may lose data

# Run 2 - Sleep between calls fixes problem

## Connect Stream for topic mytopic

12/01/06 12:16:27 INFO consumer.ZookeeperConsumerConnector: begin registering consumer test_group_1_XXXXX-1325870187898 in ZK
12/01/06 12:16:27 INFO consumer.ZookeeperConsumerConnector: end registering consumer test_group_1_XXXXX-1325870187898 in ZK
12/01/06 12:16:27 INFO consumer.ZookeeperConsumerConnector: begin rebalancing consumer test_group_1_XXXXX-1325870187898 try #0
12/01/06 12:16:28 INFO consumer.ZookeeperConsumerConnector: Committing all offsets
12/01/06 12:16:28 INFO consumer.ZookeeperConsumerConnector: Releasing partition ownership
12/01/06 12:16:28 INFO consumer.ZookeeperConsumerConnector: Consumer test_group_1_XXXXX-1325870187898 rebalancing the following partitions: List(0-0) for topic mytopic with consumers: List(test_group_1_XXXXX-1325870187898-0)
12/01/06 12:16:28 INFO consumer.ZookeeperConsumerConnector: test_group_1_XXXXX-1325870187898-0 attempting to claim partition 0-0
12/01/06 12:16:28 INFO consumer.ZookeeperConsumerConnector: Consumer test_group_1_XXXXX-1325870187898 selected partitions : mytopic:0-0
12/01/06 12:16:28 INFO consumer.ZookeeperConsumerConnector: end rebalancing consumer test_group_1_XXXXX-1325870187898 try #0
12/01/06 12:16:28 INFO consumer.FetcherRunnable: FetchRunnable-0 start fetching topic: mytopic part: 0 offset: 13400000 from 127.0.1.1:9092

## Create consumer thread for topic mytopic

## Sleep for 1 second

## Connect Stream for topic mytopic1

12/01/06 12:16:29 INFO consumer.ZookeeperConsumerConnector: begin registering consumer test_group_1_XXXXX-1325870189419 in ZK
12/01/06 12:16:29 INFO consumer.ZookeeperConsumerConnector: end registering consumer test_group_1_XXXXX-1325870189419 in ZK
12/01/06 12:16:29 INFO consumer.ZookeeperConsumerConnector: begin rebalancing consumer test_group_1_XXXXX-1325870187898 try #0
12/01/06 12:16:29 INFO consumer.ZookeeperConsumerConnector: Consumer test_group_1_XXXXX-1325870187898 with Map(mytopic1 -> List(test_group_1_XXXXX-1325870189419-0), mytopic -> List(test_group_1_XXXXX-1325870187898-0)) doesn't need to rebalance.
12/01/06 12:16:29 INFO consumer.ZookeeperConsumerConnector: end rebalancing consumer test_group_1_XXXXX-1325870187898 try #0
12/01/06 12:16:29 INFO consumer.ZookeeperConsumerConnector: begin rebalancing consumer test_group_1_XXXXX-1325870189419 try #0
12/01/06 12:16:29 INFO consumer.ZookeeperConsumerConnector: Committing all offsets
12/01/06 12:16:29 INFO consumer.ZookeeperConsumerConnector: Releasing partition ownership
12/01/06 12:16:29 INFO consumer.ZookeeperConsumerConnector: Consumer test_group_1_XXXXX-1325870189419 rebalancing the following partitions: List(0-0) for topic mytopic1 with consumers: List(test_group_1_XXXXX-1325870189419-0)
12/01/06 12:16:29 INFO consumer.ZookeeperConsumerConnector: test_group_1_XXXXX-1325870189419-0 attempting to claim partition 0-0
12/01/06 12:16:29 INFO consumer.ZookeeperConsumerConnector: Consumer test_group_1_XXXXX-1325870189419 selected partitions : mytopic1:0-0,mytopic:0-0
12/01/06 12:16:29 INFO consumer.FetcherRunnable: FecherRunnable Thread[FetchRunnable-0,5,main] interrupted
12/01/06 12:16:29 INFO consumer.FetcherRunnable: stopping fetcher FetchRunnable-0 to host 127.0.1.1
12/01/06 12:16:29 INFO consumer.ZookeeperConsumerConnector: end rebalancing consumer test_group_1_XXXXX-1325870189419 try #0

# Create consumer thread for topic mytopic1