[SPARK-32506] flaky test: pyspark.mllib.tests.test_streaming_algorithms.StreamingLinearRegressionWithTests

• Type: Test
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.0.1, 3.1.0
• Component/s: MLlib
• Assignee: Huaxin Gao
• Reporter: Wenchen Fan
• Created: 31/Jul/20 08:40
• Updated: 06/Aug/20 20:55
• Resolved: 06/Aug/20 20:55

Description

FAIL: test_train_prediction (pyspark.mllib.tests.test_streaming_algorithms.StreamingLinearRegressionWithTests)
Test that error on test data improves as model is trained.
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/runner/work/spark/spark/python/pyspark/mllib/tests/test_streaming_algorithms.py", line 466, in test_train_prediction
    eventually(condition, timeout=180.0)
  File "/home/runner/work/spark/spark/python/pyspark/testing/utils.py", line 81, in eventually
    lastValue = condition()
  File "/home/runner/work/spark/spark/python/pyspark/mllib/tests/test_streaming_algorithms.py", line 461, in condition
    self.assertGreater(errors[1] - errors[-1], 2)
AssertionError: 1.672640157855923 not greater than 2

Issue Links

• links to: [Github] Pull Request #29380 (huaxingao)
• links to: [Github] Pull Request #29380 (huaxingao)