[IGNITE-2737] Ignite-Spark documentation is missing some useful informations

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.4
• Component/s: documentation, spark
• Labels: community
• Assignee: Prachi Garg
• Reporter: Luca Rea
• Created: 01/Mar/16 08:27
• Updated: 06/Feb/18 23:51
• Resolved: 06/Feb/18 23:51

Description

Hi,

in my tests I have experienced some configuration issue running spark in local and yarn-client mode, so I want to share them.
In order to let Ignite work correctly I had to customize spark-defaults.conf adding to "spark.driver.extraClassPath" and "spark.executor.extraClassPath" the string

"/opt/ignite/libs/*:/opt/ignite/libs/optional/ignite-spark/*:/opt/ignite/libs/optional/ignite-log4j/*:/opt/ignite/libs/optional/ignite-yarn/*:/opt/ignite/libs/ignite-spring/*"

(opt/ignite is my IGNITE_HOME) and other IGNITE_ useful variables like "spark.executorEnv.IGNITE_WORK_DIR" in order to let them be loaded by executors.