Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-3962

Mark spark dependency as "provided" in external libraries

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.2.0
    • Component/s: DStreams
    • Labels:
      None
    • Target Version/s:

      Description

      Right now there is not an easy way for users to link against the external streaming libraries and not accidentally pull Spark into their assembly jar. We should mark Spark as "provided" in the external connector pom's so that user applications can simply include those like any other dependency in the user's jar.

      This is also the best format for third-party libraries that depend on Spark (of which there will eventually be many) so it would be nice for our own build to conform to this nicely.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                prashant_ Prashant Sharma
                Reporter:
                pwendell Patrick Wendell
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: