Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-32812

Run tests script for Python fails in certain environments

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.1.0
    • 2.4.7, 3.0.2, 3.1.0
    • PySpark, Tests
    • None

    Description

      When running PySpark test in the local environment with "python/run-tests" command, the following error could occur.

       

      
      Traceback (most recent call last):
       File "<string>", line 1, in <module>
      ...
      
      raise RuntimeError('''
      RuntimeError:
       An attempt has been made to start a new process before the
       current process has finished its bootstrapping phase.
      
      This probably means that you are not using fork to start your
       child processes and you have forgotten to use the proper idiom
       in the main module:
      
      if __name__ == '__main__':
       freeze_support()
       ...
      
      The "freeze_support()" line can be omitted if the program
       is not going to be frozen to produce an executable.
      Traceback (most recent call last):
      ...
       raise EOFError
      EOFError
      
       

      Attachments

        Activity

          People

            itholic Haejoon Lee
            itholic Haejoon Lee
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: