Details
-
Bug
-
Status: Open
-
P2
-
Resolution: Fixed
-
2.13.0
-
None
Description
Beam metrics shown in Spark history server are not readable. They're rendered as JSON which is created from protobuffer defined in beam_job_api.proto where metric's value is defined as bytes.
Similar issue was already addressed and fixed in BEAM-6062 but was broken by BEAM-4552.
Solution could be using SparkMetricsContainerStepMap instead of MetricsContainerStepMap inside MetricsContainerStepMapAccumulator as in BEAM-6062.
Attachments
Attachments
Issue Links
- relates to
-
BEAM-10719 Show metrics in a (more) human-readable format
- Open
- links to