[KAFKA-7209] Kafka stream does not rebalance when one node gets down

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Abandoned
• Affects Version/s: 0.11.0.1
• Component/s: streams
• Assignee: Unassigned
• Reporter: Yogesh BG
• Created: 26/Jul/18 17:31
• Updated: 15/May/20 02:52
• Resolved: 15/May/20 02:52

Description

I use kafka streams 0.11.0.1session timeout 60000, retries to be int.max and backoff time default
 
I have 3 nodes running kafka cluster of 3 broker

and i am running the 3 kafka stream with same application.id
each node has one broker one kafka stream application
everything works fine during setup
i bringdown one node, so one kafka broker and one streaming app is down
now i see exceptions in other two streaming apps and it never gets re balanced waited for hours and never comes back to norma
is there anything am missing?
i also tried looking into when one broker is down call stream.close, cleanup and restart this also doesn't help
can anyone help me?
 
 
 
 One thing i observed lately is that kafka topics with partitions one gets reassigned but i have topics of 16 partitions and replication factor 3. It never settles up