Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-7038

[Streaming] Spark Sink requires spark assembly in classpath

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • 1.3.1
    • None
    • DStreams

    Description

      In 1.3.0 Spark, we shaded Guava, which meant that the Spark Sink's guava dependency is not standard guava anymore - thus the one from Flume's classpath does not work and can throw a NoClassDefFoundError while using Spark Sink.

      We must pull in the guava dependency into the Spark Sink jar.

      Attachments

        Activity

          People

            hshreedharan Hari Shreedharan
            hshreedharan Hari Shreedharan
            Hari Shreedharan Hari Shreedharan
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: