Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-42186

Make SparkR able to stop properly when the connection is timed-out

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.5.0
    • 3.4.0
    • SparkR
    • None

    Description

      ./bin/sparkR --conf spark.r.backendConnectionTimeout=10
      

      wait 10 secs.

      
      Welcome to
            ____              __
           / __/__  ___ _____/ /__
          _\ \/ _ \/ _ `/ __/  '_/
         /___/ .__/\_,_/_/ /_/\_\   version 3.4.0-SNAPSHOT
            /_/
      
      
      SparkSession Web UI available at http://192.168.35.219:4040
      SparkSession available as 'spark'(master = local[*], app id = local-1674649482367).
      > 23/01/25 21:24:53 WARN RBackendHandler: Ignoring read timeout in RBackendHandler
      spark.session()
      Error in spark.session() : could not find function "spark.session"
      > spark.session.stop()
      Error in spark.session.stop() :
        could not find function "spark.session.stop"
      

      Attachments

        Activity

          People

            gurwls223 Hyukjin Kwon
            gurwls223 Hyukjin Kwon
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: