[TOREE-386] spark kernel `--name test` or `--conf spark.app.name=test` parameter to spark_opts is not applied

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Assignee: Jakob Odersky
• Reporter: Sachin Aggarwal
• Created: 15/Feb/17 11:20
• Updated: 02/Mar/17 19:34
• Resolved: 02/Mar/17 19:34

Description

this is my kernel.json

{
  "language": "scala",
  "display_name": "toree_special - Scala",
  "env": {
    "SPARK_OPTS": "--name MyAPP --master yarn --deploy-mode client",
    "SPARK_HOME": "spark_home",
    "__TOREE_OPTS__": "",
    "DEFAULT_INTERPRETER": "Scala",
    "PYTHONPATH": "spark_home/python:spark_home/python/lib/py4j-0.9-src.zip",
    "PYTHON_EXEC": "python"
  },
  "argv": [
    "/root/.local/share/jupyter/kernels/toree_special_scala/bin/run.sh",
    "--profile",
    "{connection_file}"
  ]
}

the parameter that I added --name MyAPP is not applied I still see app name in yarn resource ui as IBM Spark Kernel

update: In new version of toree IBM Spark Kernel is renamed to Apache Toree