[LIVY-893] Livy pyspark sessions dies after 1 hour

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.0
• Fix Version/s: 0.8.0
• Component/s: API
• Labels: performance
• Environment: livy 0.8.0 ; spark 3.1.3
• Assignee: Unassigned
• Reporter: Dmitry Kravchuk
• Created: 01/Jul/22 10:15
• Updated: 01/Jul/22 13:30
• Resolved: 01/Jul/22 13:30

Description

Hello there.

My livy pyspark sessions alwas die after 1 hour no matter following edited configuraton at livy.conf. Can anybody help me to understad why?

 

livy.spark.master = yarn
livy.spark.deploy-mode = client
livy.spark.session.timeout = 24h
livy.server.session.state-retain.sec = 86400s
livy.server.session.timeout-check = false