Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-3449

Akka-based receiver can't find messages defined in uploaded jar

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • 1.0.0, 1.0.2
    • None
    • DStreams
    • None

    Description

      Custom akka-based receiver built after the shipped example doesn't work if custom akka messages are defined in the uploaded jar (ssc.setJars). ClassNotFoundException thrown on the executors side.
      Modified version of example is attached.

      Attachments

        1. customMessage.zip
          5 kB
          Anton B

        Issue Links

          is related to

          Sub-task - The sub-task of the issue SPARK-13843 Move streaming-flume, streaming-mqtt, streaming-zeromq, streaming-akka, streaming-twitter to Spark packages

          • Major - Major loss of function.
          • Resolved
          is superceded by

          Sub-task - The sub-task of the issue SPARK-7799 Move "StreamingContext.actorStream" to a separate project and deprecate it in StreamingContext

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              darkace Anton B
              Tathagata Das Tathagata Das
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: