[SPARK-6646] Spark 2.0: Rearchitecting Spark for Mobile Platforms

• Type: Improvement
• Status: Resolved
• Priority: Blocker
• Resolution: Later
• Component/s: Project Infra
• Target Version/s: 2.0.0
• Assignee: Reynold Xin
• Reporter: Reynold Xin
• Created: 01/Apr/15 05:34
• Updated: 09/Apr/15 20:37
• Resolved: 04/Apr/15 07:47

Description

Mobile computing is quickly rising to dominance, and by the end of 2017, it is estimated that 90% of CPU cycles will be devoted to mobile hardware. Spark’s project goal can be accomplished only when Spark runs efficiently for the growing population of mobile users.

Designed and optimized for modern data centers and Big Data applications, Spark is unfortunately not a good fit for mobile computing today. In the past few months, we have been prototyping the feasibility of a mobile-first Spark architecture, and today we would like to share with you our findings. This ticket outlines the technical design of Spark’s mobile support, and shares results from several early prototypes.

Mobile friendly version of the design doc: https://databricks.com/blog/2015/04/01/spark-2-rearchitecting-spark-for-mobile.html