[HDDS-1090] Add a recipe to the ozone docs about using Spark, OzoneFS, and K8s

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.4.0
• Target Version/s: 0.4.0
• Assignee: Marton Elek
• Reporter: Marton Elek
• Created: 12/Feb/19 12:41
• Updated: 24/Feb/19 22:22
• Resolved: 24/Feb/19 22:09

Description

With the isolated classloader (HDDS-922) it's possible to use the regular spark distribution (which includes hadoop-2.7) and ozonefs (based on hadoop-3.2) together.

In HDDS-846 we started to add 'recipes' to the documentation to provide how-to style pages for different use-cases.

I would add a new page about using the following components together:

• Spark2.4-hadoop-2.7
• Ozonefs (isolated classloader)
• Kubernetes spark executor