[LIVY-751] Livy server should allow to customize LIVY_CLASSPATH

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.7.0
• Fix Version/s: 0.8.0
• Component/s: Server
• Assignee: Shingo Furuyama
• Reporter: Shingo Furuyama
• Created: 27/Feb/20 04:59
• Updated: 26/Mar/20 06:10
• Resolved: 26/Mar/20 06:08

Description

What we want to do is - specify LIVY_CLASSPATH at the time of booting livy server to use the other version of hadoop, which is not included in livy artifact.

The background is - we are trying to use livy 0.7.0-incubating and spark 2.4.5 with YARN HDP2.6.4, but we encountered an error due to the incompatibility of livy included hadoop and HDP2.6.4 hadoop. We came up with a workaround that 1. remove hadoop from livy artifact by building with `mvn -Dhadoop.scope=provided` and 2. add HDP2.6.4 hadoop jars to the classpath for livy server by `hadoop classpath` command at the time of booting livy server. However, bin/livy-server is not allowing change LIVY_CLASSPATH.

Issue Links

• links to: GitHub Pull Request #282