Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-43754

Spark Connect Session & Query lifecycle

    XMLWordPrintableJSON

Details

    • Epic
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.5.0, 4.0.0
    • None
    • Connect
    • None
    • connect-query-lifecycle

    Description

      Currently, queries in Spark Connect are executed within the RPC handler.

      We want to detach the RPC interface from actual sessions and execution, so that we can make the interface more flexible

      • maintain long running sessions, independent of unbroken GRPC channel
      • be able to cancel queries
      • have different interfaces to query results than push from server

      Attachments

        Activity

          People

            Unassigned Unassigned
            juliuszsompolski Juliusz Sompolski
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: