Uploaded image for project: 'TinkerPop'
  1. TinkerPop
  2. TINKERPOP-1288

Support gremlin.spark.skipPartitioning configuration.

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Implemented
    • Affects Version/s: 3.2.0-incubating
    • Fix Version/s: 3.2.1
    • Component/s: hadoop, process
    • Labels:
      None

      Description

      If a VertexProgram does not use message passing, then its best to NOT partition after load as its pointless to do so.

      In particular, for TraversalVertexProgram, if the submitted traversal does not contain a VertexStep then partitioning can be avoided. This can be reasoned via a SparkPartitionStrategy, but for now, simply making the configuration and having it do its job is sufficient.

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              okram Marko A. Rodriguez
              Reporter:
              okram Marko A. Rodriguez

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment