Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-18537

Add a REST api to spark streaming

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.2.0
    • Web UI
    • None

    Description

      trying to monitoring our streaming application using Spark REST interface
      and found out that there is no api for streaming.
      it let us no choice but to implement one for ourself.

      this api should cover exceptly the same amount of information as you can get from the web interface
      the implementation is base on the current REST implementation of spark-core
      and will be available for running applications only

      here is how you can use it:

      endpoint root: /streaming/api/v1

      Endpoint Meaning
      /statistics Statistics information of stream
      /receivers A list of all receiver streams
      /receivers/[stream-id] Details of the given receiver stream
      /batches A list of all retained batches
      /batches/[batch-id] Details of the given batch
      /batches/[batch-id]/operations A list of all output operations of the given batch
      /batches/[batch-id]/operations/[operation-id] Details of the given operation, given batch

      Attachments

        Activity

          People

            saturday_s Xing Shi
            peterccp Peter Chan
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: