[SPARK-46627] Streaming UI hover-over shows incorrect value

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: Structured Streaming, UI, Web UI
• Labels: pull-request-available
• Assignee: Kent Yao
• Reporter: Wei Liu
• Created: 08/Jan/24 21:58
• Updated: 09/Jan/24 17:15
• Resolved: 09/Jan/24 10:52

Description

Running a simple streaming query:

val df = spark.readStream.format("rate").option("rowsPerSecond", "50000000").load()

val q = df.writeStream.format("noop").start()

 

The hover-over value is incorrect in the streaming ui (shows 321.00 at undefined)

 

Issue Links

• links to: GitHub Pull Request #44633