[SPARK-5669] Spark assembly includes incompatibly licensed libgfortran, libgcc code via JBLAS

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Won't Fix
• Component/s: Build
• Assignee: Sean R. Owen
• Reporter: Sean R. Owen
• Created: 07/Feb/15 20:53
• Updated: 22/Feb/15 09:10
• Resolved: 22/Feb/15 09:10

Description

Sorry for "Blocker", but it's a license issue. The Spark assembly includes the following, from JBLAS:

lib/
lib/static/
lib/static/Mac OS X/
lib/static/Mac OS X/x86_64/
lib/static/Mac OS X/x86_64/libjblas_arch_flavor.jnilib
lib/static/Mac OS X/x86_64/sse3/
lib/static/Mac OS X/x86_64/sse3/libjblas.jnilib
lib/static/Windows/
lib/static/Windows/x86/
lib/static/Windows/x86/libgfortran-3.dll
lib/static/Windows/x86/libgcc_s_dw2-1.dll
lib/static/Windows/x86/jblas_arch_flavor.dll
lib/static/Windows/x86/sse3/
lib/static/Windows/x86/sse3/jblas.dll
lib/static/Windows/amd64/
lib/static/Windows/amd64/libgfortran-3.dll
lib/static/Windows/amd64/jblas.dll
lib/static/Windows/amd64/libgcc_s_sjlj-1.dll
lib/static/Windows/amd64/jblas_arch_flavor.dll
lib/static/Linux/
lib/static/Linux/i386/
lib/static/Linux/i386/sse3/
lib/static/Linux/i386/sse3/libjblas.so
lib/static/Linux/i386/libjblas_arch_flavor.so
lib/static/Linux/amd64/
lib/static/Linux/amd64/sse3/
lib/static/Linux/amd64/sse3/libjblas.so
lib/static/Linux/amd64/libjblas_arch_flavor.so

Unfortunately the libgfortran and libgcc libraries included for Windows are not licensed in a way that's compatible with Spark and the AL2 – LGPL at least.

It's easy to exclude them. I'm not clear what it does to running on Windows; I assume it can still work but the libs would have to be made available locally and put on the shared library path manually. I don't think there's a package manager as in Linux that would make it easily available. I'm not able to test on Windows.

If it doesn't work, the follow-up question is whether that means JBLAS has to be removed on the double, or treated as a known issue for 1.3.0.

Issue Links

• relates to: SPARK-5814 Remove JBLAS from runtime dependencies
• links to: [Github] Pull Request #4453 (srowen)
• links to: [Github] Pull Request #4673 (srowen)
• links to: [Github] Pull Request #4715 (srowen)