Details
-
Task
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
4.0.0
Description
The Streaming UI is broken currently at spark master. Running a simple query:
```
q = spark.readStream.format("rate").load().writeStream.format("memory").queryName("test_wei").start()
```
Would make the spark UI shows empty graph for "operation duration":
Here is the error:
I verified the same query runs fine on spark 3.5, as in the following graph.
This should be a problem from the library updates, this could be a potential source of error: https://github.com/apache/spark/pull/42879
Attachments
Issue Links
- links to