[LIVY-546] Livy-SparkR Auth secret not provided in environment

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.5.0
• Component/s: REPL
• External issue URL: https://stackoverflow.com/questions/53900995/livy-spark-r-issue
• Assignee: Unassigned
• Reporter: Euijun
• Created: 03/Jan/19 07:59
• Updated: 26/Feb/19 07:53

Description

Hi expert,

I tried to use Livy to connect SparkR.

This is related to https://stackoverflow.com/questions/53900995/livy-spark-r-issue

 

Error message is,

Error in sparkR.sparkContext(master, appName, sparkHome, sparkConfigMap, : Auth secret not provided in environment.

 

I think it caused by,

spark-2.3.1/R/pkg/R/sparkR.R

sparkR.sparkContext <- function(
...

    authSecret <- Sys.getenv("SPARKR_BACKEND_AUTH_SECRET")
    if (nchar(authSecret) == 0) {
      stop("Auth secret not provided in environment.")
    }

...
)

 

It seems Livy to need a configuration about connecting SparkR authentication secret key.

Best regard.