[BEAM-10681] Spark portable runner should mark metrics supported

• Type: Improvement
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: Not applicable
• Component/s: runner-spark
• Labels: portability-spark
• Assignee: Kyle Weaver
• Reporter: Kyle Weaver
• Created: 12/Aug/20 00:15
• Updated: 13/May/21 22:57
• Resolved: 13/May/21 22:57

Description

For some reason, the Spark portable runner marks metrics as not enabled, even though metrics are actually supported [1]. This field is not widely used, but it does affect whether TestPipeline checks the number of PAsserts that succeeded [2].

[1] https://github.com/apache/beam/blob/56193a66fd17e3d8e40d486ee113201c2661070d/runners/spark/src/main/java/org/apache/beam/runners/spark/SparkPipelineRunner.java#L113

[2] https://github.com/apache/beam/blob/ef533ee9ff2511d37563e01f0430de0ec1e61004/sdks/java/core/src/main/java/org/apache/beam/sdk/testing/TestPipeline.java#L495

Issue Links

• links to: GitHub Pull Request #12538