[SPARK-4376] Put external modules behind build profiles

• Type: Improvement
• Status: Resolved
• Priority: Blocker
• Resolution: Duplicate
• Component/s: Build
• Target Version/s: 1.3.0
• Assignee: Sandy Ryza
• Reporter: Patrick Wendell
• Created: 13/Nov/14 02:24
• Updated: 26/Nov/14 19:48
• Resolved: 26/Nov/14 19:48

Description

Several people have asked me whether, to speed up the build, we can put the external projects behind build flags similar to the kinesis-asl module. Since these aren't in the assembly there isn't a great reason to build them by default. We can just modify our release script to build them and when we run tests.

This doesn't technically block Spark 1.2 but it is going to be looped into a separate fix that does block Spark 1.2 so I'm upgrading it to blocker.

Issue Links

• duplicates: SPARK-4628 Put external projects and examples behind a build flag