Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-38074

RuntimeError: Java gateway process exited before sending its port number

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Invalid
    • 3.2.1
    • None
    • None

    Description

      I am getting 

      RuntimeError: Java gateway process exited before sending its port number when running python tests in  Docker.  

       

      I am using spark_home as /usr/lib/python3.9/site-packages/pyspark

       

      sc = SparkContext() File "/usr/lib/python3.9/site-packages/pyspark/context.py", line 144, in _init_ SparkContext._ensure_initialized(self, gateway=gateway, conf=conf) File

      "/usr/lib/python3.9/site-packages/pyspark/context.py", line 339, in _ensure_initialized

      SparkContext._gateway = gateway or launch_gateway(conf)

      File "/usr/lib/python3.9/site-packages/pyspark/java_gateway.py", line 136, in launch_gateway raise RuntimeError("Java gateway process exited before sending its port number")

      RuntimeError: Java gateway process exited before sending its port number

       

      I can provide additional details. Any Help is appreciated

      Attachments

        Activity

          People

            Unassigned Unassigned
            malla4699 Malla
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: