Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-5293 Enable Spark user applications to use different versions of Akka
  3. SPARK-5124

Standardize internal RPC interface

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.4.0
    • Spark Core
    • None

    Description

      In Spark we use Akka as the RPC layer. It would be great if we can standardize the internal RPC interface to facilitate testing. This will also provide the foundation to try other RPC implementations in the future.

      Attachments

        1. Pluggable RPC - draft 2.pdf
          47 kB
          Shixiong Zhu
        2. Pluggable RPC - draft 1.pdf
          43 kB
          Shixiong Zhu

        Issue Links

          blocks

          Sub-task - The sub-task of the issue SPARK-6028 Provide an alternative RPC implementation based on the network transport module

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Sub-task - The sub-task of the issue SPARK-6602 Replace direct use of Akka with Spark RPC interface

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          is blocked by

          Sub-task - The sub-task of the issue SPARK-5214 Add EventLoop and change DAGScheduler to an EventLoop

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue SPARK-6280 Remove Akka systemName from Spark

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue SPARK-6490 Deprecate configurations for "askWithReply" and use new configuration names

          • Major - Major loss of function.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-3059 Spark internal module interface design

          • Major - Major loss of function.
          • Closed
          links to

          Pull request #3974 [Github] Pull Request #3974 (zsxwing)

          Pull request #4588 [Github] Pull Request #4588 (zsxwing)

          Pull request #5283 [Github] Pull Request #5283 (zsxwing)

          Activity

            People

              zsxwing Shixiong Zhu
              rxin Reynold Xin
              Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: