Discussed on PR-1663 for
When we click on any of Spark jobs UI from the paragraph links,
link is leading to
and that error shows HTTP ERROR 400
Problem accessing /jobs/job/.
Reason: requirement failed: Missing id parameter
Powered by Jetty://
A little bit more information - the link on paragprah leads to
Spark Driver UI.
Spark Driver web server then redirects to a link like I sent in my previous post,
and it misses job id in the redirected URL, i.e.
To your question on consistency - yes it happens in 100% cases, I never saw this new feature works for us.
Is this Spark version dependent or something? We're running CDH Spark 2.
According to https://github.com/apache/spark/pull/5947 URL format is different in YARN and non-YARN modes? Was PR-1663 for
ZEPPELIN-1692 tested on both of these modes? Not sure what else might break those links.