[SPARK-49241] Add OpenTelemetryPush Sink

• Type: Improvement
• Status: Reopened
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 4.0.0
• Component/s: Spark Core
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: Qi Tan
• Created: 14/Aug/24 22:18
• Updated: 19/Nov/24 20:46

Description

From OpenTelemetry side, they have added the support from a pull model: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/apachesparkreceiver. However, in my case, the internal team only accept the push model. Therefore,  OpenTelemetryPushSink and OpenTelemetryPushReporter will be helpful in such scenarios.

Issue Links

• links to: GitHub Pull Request #47763