[BIGTOP-3162] Define Bigtop 1.4.0 release BOM

• Type: Task
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: backlog
• Fix Version/s: 1.4.0
• Assignee: Evans Ye
• Reporter: Evans Ye
• Created: 13/Feb/19 08:35
• Updated: 18/Jun/19 16:26
• Resolved: 05/May/19 06:11

Description

According to the discussion thread and this, the 1.4.0 release has lots new features as well as bugfixes. The primary goal for the release is to harden the overall quality of Apache Bigtop and provide a solid foundation to move forward in faster pace.

1.4.0 BOM:

• bigtop 1.4.0 includes the following components (changes from 1.3.0)

          alluxio                   1.0.1 ===> 1.8.1
          ambari                    2.6.1
          apex                      3.6.0
          bigtop_groovy             2.4.10
          bigtop_jsvc               1.0.15
          bigtop_tomcat             6.0.45
          bigtop_utils              1.3.0
          crunch                    0.15.0 ===> REMOVED
          flink                     1.4.2 ===> 1.6.4
          flume                     1.8.0
          giraph                    1.1.0
          gpdb                      5.10.0
          hadoop                    2.8.4 ===> 2.8.5
          hama                      0.7.1
          hbase                     1.3.2
          hive                      2.3.3
          ignite_hadoop             1.9.0
          kafka                     0.10.2.2
          mahout                    0.13.0
          oozie                     4.3.0 ===> ENABLED BACK
          phoenix                   4.13.1-HBase-1.3
          qfs                       2.0.0
          solr                      6.6.0
          spark                     2.2.1 ===> 2.2.3
          spark1                    1.6.2 ===> REMOVED
          sqoop                     1.4.6
          sqoop2                    1.99.4
          tajo                      0.11.1
          tez                       0.9.1
          ycsb                      0.12.0
          zeppelin                  0.7.3
          zookeeper                 3.4.6
  

• bigtop 1.4.0 supports following Distro.

  CentOS 7
  Fedora 26
  OpenSuSE 42.3
  Ubuntu 16.04
  Debian 9
  

• supported archs

  x86_64
  aarch64
  ppc64le
  

Sub-Tasks

• Bump Hadoop to 2.8.5: Resolved
• Bump Kafka to 1.1.1: Resolved
• Update Kafka Puppet module for version 1.1.1: Resolved
• Bump Alluxio up to 1.8.1: Resolved
• Zeppelin build failed: Resolved
• Bump Kafka to 2.1.1: Resolved
• Bump Spark to 2.2.3: Resolved
• Bump Flume to 1.9.0: Resolved
• Compatibility issue for Zeppelin with Spark 2.2.3: Resolved
• Old Gradle version causes Kafka 2.1.1 build failed: Resolved
• Remove Spark 1.6 from the stack: Resolved
• Drop Apache Crunch in Bigtop distribution: Resolved
• [Sandbox] Support AARCH64/PPC64LE: Resolved
• [Sandbox] Architecture string is a mess for Distributions: Resolved
• Missing /etc/init.d/functions when deploying Alluxio on Fedora 26: Resolved
• [Provisioner] Do not exit when destroying got no cluster exists: Resolved
• Revert Kafka to 0.10.2.2 and Flume to 1.8.0: Resolved
• Missing /lib/lsb/init-functions when deploying Flink on Fedora 26: Resolved
• Deploy QFS client failed due to no such directory error: Resolved
• Bugs in pom.xml files when releasing Bigtop 1.4.0: Resolved
• Failed to build bigtop/puppet image for OpenSuSE: Resolved