Details
-
New Feature
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
We currently build source releases (essentially a snapshot of the git repository with a bit of cleanup) and binary artifacts in a Maven repository (SAMZA-199). Source releases are the official Apache releases that we vote on; binary releases are a convenience to save users from having to build from source themselves.
In addition to these, it would be useful to have a binary package which includes Samza and all of its dependencies. The common format for this kind of package, which many JVM-based projects provide, has a bin/ subdirectory for shell scripts, and a lib/ subdirectory with jar files of the project and its dependencies. A user only needs to unpack the package, and then they can run the shell scripts in bin/ right away. This familiar type of package would make it easier for new users to get started with Samza.
In particular, it would simplify:
- Using run-job.sh directly, without the strange assemble-then-unpack-again procedure which hello-samza uses.
- Using CheckpointTool for manipulating checkpoints.
- Allowing us to have a script which performs job packaging and deploys a job to YARN (SAMZA-307).
We'll have to figure out if there are any legal implications to bundling dependencies in a Samza binary release.
Attachments
Issue Links
- is depended upon by
-
SAMZA-307 Simplify YARN deploy procedure
- Open