[SPARK-18391] Openstack deployment scenarios

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 1.0.0, 1.0.1, 1.1.0, 1.1.1, 1.2.0, 1.2.1, 1.2.2, 1.3.0, 1.3.1, 1.4.0, 1.4.1, 1.5.0, 1.5.1, 1.5.2, 1.6.0, 1.6.1, 1.6.2, 2.0.0, 2.0.1
• Fix Version/s: 1.0.0, 1.0.1, 1.1.0, 1.1.1, 1.2.0, 1.2.1, 1.2.2, 1.3.0, 1.3.1, 1.4.0, 1.4.1, 1.5.0, 1.5.1, 1.5.2, 1.6.0, 1.6.1, 1.6.2, 2.0.0, 2.0.1
• Component/s: Deploy

Environment

Openstack

• Assignee: Unassigned
• Reporter: Oleg Borisenko
• Created: 09/Nov/16 23:14
• Updated: 10/Nov/16 01:35
• Resolved: 10/Nov/16 01:35

Description

There is no reliable way to deploy any version of Apache Spark in Openstack cloud except Openstack Sahara at current moment.

Nevertheless Openstack Sahara is very slow and it has a small subset of Spark versions to deploy; support for Spark is limited to current Openstack release etc.

We provide a way to do it on any Openstack cloud since Juno, with any Apache Spark/Hadoop combination since Spark 1.0 and with additional tools (Apache YARN, Apache Ignite, Jupyter, NFS-mount, Ganglia — these optional-tools are on-demand).

We provide our solution with Apache 2.0

(look forward to pool-request soon)

Issue Links

• links to: [Github] Pull Request #15836 (al-indigo)