[SPARK-37498] test_reuse_worker_of_parallelize_range is flaky

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0, 3.2.2
• Component/s: PySpark, Tests
• Assignee: Yikun Jiang
• Reporter: Yikun Jiang
• Created: 30/Nov/21 06:22
• Updated: 12/Dec/22 18:11
• Resolved: 17/Jan/22 23:47

Description

 

ERROR [2.132s]: test_reuse_worker_of_parallelize_range (pyspark.tests.test_worker.WorkerReuseTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/__w/spark/spark/python/pyspark/tests/test_worker.py", line 195, in test_reuse_worker_of_parallelize_range
    self.assertTrue(pid in previous_pids)
AssertionError: False is not true
----------------------------------------------------------------------
Ran 12 tests in 22.589s

 

 

[1] https://github.com/apache/spark/runs/1182154542?check_suite_focus=true
[2] https://github.com/apache/spark/pull/33657#issuecomment-893969310
[3] https://github.com/Yikun/spark/runs/4362783540?check_suite_focus=true

Issue Links

• links to: [Github] Pull Request #35228 (Yikun)
• links to: [Github] Pull Request #35228 (Yikun)