[IMPALA-4137] Rolling restart of Impala

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: Impala 2.2.4
• Component/s: Distributed Exec
• Labels: resource-management
• Target Version: Product Backlog
• Assignee: Unassigned
• Reporter: Alan Jackoway
• Created: 15/Sep/16 14:50
• Updated: 05/Oct/18 19:23

Description

Apologies if a jira exists for this. I could not find one.

It would be very helpful to us to be able to rolling restart (and hopefully rolling upgrade) Impala.

Based on my understanding of impala internals, I think this would require:

• Highly available statestore and catalog. Currently catalog's metadata reload is the long pole in our impala restarts.
• Impalads being able to stop without killing queries they are working on. Most of our queries are short so for us it would be sufficient to give the impala daemon a way to stop taking new work, then restart when it completes all work it has assigned.

Issue Links

• is blocked by: IMPALA-1760 Add Impala SQL command to gracefully shut down an Impala daemon
• is related to: IMPALA-7665 Bringing up stopped statestore causes queries to fail

Sub-Tasks

• Play nice with load balancers when shutting down coordinator: Open