Description
trying to monitoring our streaming application using Spark REST interface
and found out that there is no api for streaming.
it let us no choice but to implement one for ourself.
this api should cover exceptly the same amount of information as you can get from the web interface
the implementation is base on the current REST implementation of spark-core
and will be available for running applications only
here is how you can use it:
endpoint root: /streaming/api/v1
| Endpoint | Meaning |
|---|---|
| /statistics | Statistics information of stream |
| /receivers | A list of all receiver streams |
| /receivers/[stream-id] | Details of the given receiver stream |
| /batches | A list of all retained batches |
| /batches/[batch-id] | Details of the given batch |
| /batches/[batch-id]/operations | A list of all output operations of the given batch |
| /batches/[batch-id]/operations/[operation-id] | Details of the given operation, given batch |
Attachments
Issue Links
- is duplicated by
-
SPARK-18470 Provide Spark Streaming Monitor Rest Api
-
- Resolved
-
- links to
