Description
Right now there is not an easy way for users to link against the external streaming libraries and not accidentally pull Spark into their assembly jar. We should mark Spark as "provided" in the external connector pom's so that user applications can simply include those like any other dependency in the user's jar.
This is also the best format for third-party libraries that depend on Spark (of which there will eventually be many) so it would be nice for our own build to conform to this nicely.
Attachments
Issue Links
- is duplicated by
-
SPARK-3951 Make the external-* jars fat jars
- Resolved
- relates to
-
SPARK-3951 Make the external-* jars fat jars
- Resolved
- links to