[LIVY-323] Spark session dies after creation

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.3
• Fix Version/s: 0.4.0
• Component/s: Core

Environment

I'm using spark 2.0.1 running on EMR in yarn mode.

Livy is 0.3 built with "mvn clean package -DskipTests -Dspark-2.0 -Dscala-2.11"

In conf/livy.conf I've set "livy.spark.master = yarn"

Server was started using this shell script:

{noformat}
#!/bin/sh
. /etc/spark/conf/spark-env.sh
livy/bin/livy-server
{noformat}

• Assignee: Alex Man
• Reporter: Max Lapan
• Created: 28/Feb/17 10:56
• Updated: 12/Apr/17 21:55
• Resolved: 11/Apr/17 00:42

Description

I'm trying to create spark session using curl:
curl -X POST --data '

{"kind": "spark"}

' -H "Content-Type: application/json" localhost:8998/sessions

Output of curl is about session starting:

{"id":0,"appId":null,"owner":null,"proxyUser":null,"state":"starting","kind":"spark","appInfo":{"driverLogUrl":null,"sparkUiUrl":null},"log":[]}

In livy's log (attached) I see messages about spark session creation, but after a while I see a message about spark session successfully created, and immediately it starts shutdown process.

If I check session status using curl command, it's in DEAD state:

$ curl http://localhost:8998/sessions | jq .
{
  "from": 0,
  "total": 1,
  "sessions": [
    {
      "id": 0,
      "appId": "application_1482343367445_0210",
      "owner": null,
      "proxyUser": null,
      "state": "dead",
      "kind": "spark",
      "appInfo": {
        "driverLogUrl": null,
        "sparkUiUrl": "http://ip-10-200-139-129.ec2.internal:20888/proxy/application_1482343367445_0210/"
      },
      "log": []
    }
  ]
}

In yarn tasks list I can see this session in Finished state and there are no errors or exceptions in driver's log or executor's logs (attached).

With the same installation, I can successfully start and use pyspack sessions using the same livy server.