Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-29396 Extend Spark plugin interface to driver
  3. SPARK-29398

Allow RPC endpoints to use dedicated thread pools

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0
    • Fix Version/s: 3.0.0
    • Component/s: Spark Core
    • Labels:
      None

      Description

      This is a new feature of the RPC framework so that we can isolate RPC message delivery for plugins from normal Spark RPC needs. This minimizes the impact that plugins can have on normal RPC communication - they'll still fight for CPU, but they wouldn't block the dispatcher threads used by existing Spark RPC endpoints.

      See parent bug for further details.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                vanzin Marcelo Masiero Vanzin
                Reporter:
                vanzin Marcelo Masiero Vanzin
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: