[MRQL-30] Improved run scripts and support for Spark on YARN

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Component/s: Run-Time/Spark
• Assignee: Leonidas Fegaras
• Reporter: Leonidas Fegaras
• Created: 08/Feb/14 15:58
• Updated: 09/Feb/14 16:02
• Resolved: 09/Feb/14 16:02

Description

The following patch contains the following changes:
Changed the run scripts in bin/* to construct an assembly jar instead of using -libjar. This is required for Spark to run on YARN. To run MRQL in Spark mode on YARN, you need to rebuild MRQL with -Pyarn, start the YARN cluster, set SPARK_MASTER to yarn-client in conf/mrql-env.sh, and run a query using bin/mrql.spark.