[LIVY-729] Livy should not recover the killed session

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.6.0
• Fix Version/s: 0.8.0
• Component/s: Server
• Assignee: Jie Wang
• Reporter: Jie Wang
• Created: 18/Dec/19 00:56
• Updated: 19/Dec/19 02:52
• Resolved: 19/Dec/19 02:52

Description

Follows are steps to reproduce the problem:

1. Set livy.server.recovery.mode=recovery, and create a session: session0 in yarn-cluster
2. kill the yarn application of the session
3. restart livy
4. livy try to recover session0, but application has been killed and driver does not exist, so client can not connect to driver, and exception was thrown as the image.
5. If the ip:port of the driver was reused by session1, client of session0 will try to connect to driver of session1, then driver will throw exception: Unexpected client ID.
6. Both the exception threw by livy and driver will confused the user, and recover a lot of killed sessions will delay the recover of alive session.

Issue Links

• links to: GitHub Pull Request #266