[BIGTOP-1480] Define BOM for 1.0 release of Bigtop

• Type: New Feature
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.8.0
• Fix Version/s: 1.0.0
• Component/s: general
• Assignee: Konstantin I Boudnik
• Reporter: Roman Shaposhnik
• Created: 04/Oct/14 22:42
• Updated: 03/Sep/15 18:55
• Resolved: 29/May/15 09:20

Description

Let's define the scope of the stack in the next release.
Target date - 04/5/2015

Capturing the discussion on the dev list so far:

OS:
  CentOS6, CentOS7, Fedora 20
  SLES 11SP3, SLES12, OpenSUSE 13.2
  Ubuntu 14.04 LTS, Debian 8

Java:
  OpenJDK 7

Components:

  Zookeeper 3.4.6 (or later?)
  Hadoop 2.6.0
  HBase 0.98.10.1 (1.0 has been released, shall we upgrade to the latest?)
  Hive 1.1
    Tez-0.6.0 (as a dependency of Hive)
  Sqoop 1.4.5
  Sqoop2 1.99.4
  Oozie 4.0.1
  Giraph 1.1.0
  Groovy 2.3
  Ignite 1.2
  Hue 3.7.1
  DataFU 1.0.0
  Solr 4.9.0
  Crunch 0.10.0
  Spark 1.3.0
  Phoenix 4.3.1
  Tomcat 6.0.36
  jsvc 1.0.15
  Pig 0.14.0
  Mahout 0.10
  Flume 1.5.2
  Tachyon 0.6.0
  Kafka 0.8.1.1
  What other new stuff do we feel like adding?

To retire:
  Whirr 0.8.2 (seems to be headed to the Attic)

Issue Links

• incorporates: BIGTOP-1649 Upgrade Apache Flume to 1.5.2
• incorporates: BIGTOP-1833 Bump Ignite to 1.1.0
• incorporates: BIGTOP-1179 Add Apache Tez to bigtop
• incorporates: BIGTOP-1598 Update GridGain version to 6.5.6
• incorporates: BIGTOP-1616 Upgrade to Sqoop 1.99.4
• incorporates: BIGTOP-1660 Upgrade to Hive-1.0
• incorporates: BIGTOP-989 Add Apache Kafka to Apache Bigtop
• incorporates: BIGTOP-1741 Upgrade to Apache Phoenix 4.3.1
• incorporates: BIGTOP-1831 Upgrade Mahout to 0.10
• incorporates: BIGTOP-1755 Upgrade to Spark 1.3.0
• incorporates: BIGTOP-1834 Upgrade to Spark 1.3.1
• is blocked by: BIGTOP-1543 hive-0.14 in bigtop
• requires: BIGTOP-1722 upgrade tachyon to 0.6.0
• requires: BIGTOP-1851 Upgrade to HBase 0.98.12

Sub-Tasks

• Include zookeeper 3.4.6: Resolved
• Sqoop 1.99.2 has build bug, preventing build from completion. Bump to 1.99.4: Resolved
• Include Sqoop1 in bigtop 0.9: Resolved
• Upgrade Hue to 3.7: Resolved
• Spark update to 1.1.0: Resolved
• hive-0.14 in bigtop: Resolved
• Remove Whirr from the BOM: Resolved
• Upgrade Pig to 0.14.0: Resolved
• Use openjdk7 for CentOS: Resolved
• Tests dependencies are on old Hadoop versions (2.3.0, 2.4.1): Resolved
• Upgrade Apache Flume to 1.5.2: Resolved
• Upgrade Hadoop to 2.6.0: Resolved
• Update HBase because javadoc broken: Resolved
• Bump the stack version to 1.0: Resolved
• Use openjdk in ubuntu14, Remove references to jdk6: Resolved