Uploaded image for project: 'TinkerPop'
  1. TinkerPop
  2. TINKERPOP-868

Allow Spark Gremlin Computer to Reuse Spark Contexts

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.0.1-incubating
    • 3.1.0-incubating
    • hadoop
    • None

    Description

      So that users don't have to face the overhead of recreating Spark Contexts between jobs, we can provide an option so that contexts can be saved between jobs in a given JVM. This will also allow for simultaneous use of SparkGraphComputers sharing a single context.

      I propose to enable this via a new property

      gremlin.spark.persistContext , Default: false (old behavior)

      Attachments

        Activity

          People

            okram Marko A. Rodriguez
            rspitzer Russell Spitzer
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: