Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-4960

Interceptor pattern in receivers

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • None
    • None
    • DStreams

    Description

      Sometimes it is good to intercept a message received through a receiver and modify / do something with the message before it is stored into Spark. This is often referred to as the interceptor pattern. There should be general way to specify an interceptor function that gets applied to all receivers.

      Attachments

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-3146 Improve the flexibility of Spark Streaming Kafka API to offer user the ability to process message before storing into BM

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              tdas Tathagata Das
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: