Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-1752

Add Zinc to bigtop_toolchain so that it may be used by Spark builds

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Patch Available
    • Minor
    • Resolution: Unresolved
    • 0.8.0
    • backlog
    • spark, toolchain
    • None

    Description

      The Zinc Nailgun server can be used to speed up compilation of Scala projects (like Spark) considerably. For example, building Spark without Zinc running takes about 26 mins in my experience, but with Zinc running it takes only about 14 mins.

      This patch causes Zinc to be installed in /usr/local/zinc by the bigtop_toolchain, though it must still be started by whatever process (e.g., Jenkins) executes the build by running "/usr/local/zinc/bin/zinc -start" before kicking off the build.

      See https://github.com/typesafehub/zinc and http://spark.apache.org/docs/latest/building-spark.html#speeding-up-compilation-with-zinc for more information about Zinc and using it with a Spark build.

      Attachments

        1. BIGTOP-1752.patch
          4 kB
          Jonathan Kelly
        2. BIGTOP-1752.patch
          4 kB
          Jonathan Kelly

        Activity

          People

            jonathak Jonathan Kelly
            jonathak Jonathan Kelly
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated: