[SPARK-24995] Flaky tests: FlatMapGroupsWithStateSuite.flatMapGroupsWithState - streaming with processing time timeout

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 2.4.0
• Component/s: Structured Streaming, Tests
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Jungtaek Lim
• Created: 02/Aug/18 04:34
• Updated: 25/May/21 01:52
• Resolved: 25/May/21 01:43

Description

I've seen CI build failure often, and noticed some of failures came from FlatMapGroupsWithStateSuite.flatMapGroupsWithState - streaming with processing time timeout. For now I'm only having build links for failures with state 2 but I'm sure I saw the failure with state 1, too.

 

https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93906/testReport/org.apache.spark.sql.streaming/FlatMapGroupsWithStateSuite/flatMapGroupsWithState___streaming_with_processing_time_timeout___state_format_version_2/

https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93874/testReport/org.apache.spark.sql.streaming/FlatMapGroupsWithStateSuite/flatMapGroupsWithState___streaming_with_processing_time_timeout___state_format_version_2/