[TINKERPOP-1033] Store sideEffects as a persisted RDD

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0-incubating
• Fix Version/s: 3.1.1-incubating
• Component/s: hadoop
• Assignee: Marko A. Rodriguez
• Reporter: Marko A. Rodriguez
• Created: 08/Dec/15 17:28
• Updated: 08/Jan/16 14:20
• Resolved: 08/Jan/16 14:20

Description

I think we can completely get away from HDFS for SparkGraphComputer. We will need something like PesistedSideEffectsRDD. Once we do that, if the user wants to use Spark without Hadoop, its possible.

This would beg the question – do we go all the way and support SparkGraph ?