Uploaded image for project: 'TinkerPop'
  1. TinkerPop
  2. TINKERPOP-868

Allow Spark Gremlin Computer to Reuse Spark Contexts

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.1-incubating
    • Fix Version/s: 3.1.0-incubating
    • Component/s: hadoop
    • Labels:
      None

      Description

      So that users don't have to face the overhead of recreating Spark Contexts between jobs, we can provide an option so that contexts can be saved between jobs in a given JVM. This will also allow for simultaneous use of SparkGraphComputers sharing a single context.

      I propose to enable this via a new property

      gremlin.spark.persistContext , Default: false (old behavior)

        Attachments

          Activity

            People

            • Assignee:
              okram Marko A. Rodriguez
              Reporter:
              rspitzer Russell Spitzer
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: