[BIGTOP-2025] Make BOM to be a directional graph

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.0.0
• Fix Version/s: 1.1.0
• Component/s: build
• Assignee: Konstantin I Boudnik
• Reporter: Konstantin I Boudnik
• Created: 09/Sep/15 06:26
• Updated: 18/Sep/15 19:03
• Resolved: 18/Sep/15 19:03

Description

It might be a good idea to be able to set up a dependencies between the components, so the build system is aware which parts should be build first, and the sequentially or in parallel.

With new configuration DSL introduced in BIGTOP-1494 we can have a directional graph like this

    'hadoop' {
      name    = 'hadoop'
      relNotes = 'Apache Hadoop'
      version { base = '2.6.0'; pkg = base; release =1 }
      tarball { destination = "${name}-${version.base}.tar.gz"
                source      = "${name}-${version.base}-src.tar.gz" }
      url     { site = "{apache.APACHE_MIRROR}/${download_path}"
                archive = "{apache.APACHE_ARCHIVE}/${download_path}"
                download_path = "/hadoop/common/$name-${version.base}" }
      dependencies { 'zookeeper'}
    }

which will allow to collect all dependencies information cross components, build the graph and test it for loops. This information can be used by the build system to order the build process: if hadoop-deb is invoked it will automatically tries to build zookeeper; for hbase it will invoke hadoop build first, etc.

Issue Links

• is blocked by: BIGTOP-2051 Get rid of hair-brain environment vars left after make-based build
• is depended upon by: BIGTOP-1882 Move Hive above Pig in bigtop.mk as Pig has a dependency on Hive
• is duplicated by: BIGTOP-1882 Move Hive above Pig in bigtop.mk as Pig has a dependency on Hive
• relates to: BIGTOP-1906 Optimize and enahnce build/CI process to reuse artifacts