[HADOOP-10101] Update guava dependency to the latest version

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0-alpha2
• Fix Version/s: 3.0.0-alpha4
• Labels: BB2015-05-TBR
• Target Version/s: 3.0.0-alpha4
• Hadoop Flags: Incompatible change, Reviewed

Release Note

Guava is updated to version 21.0.

In the background of merging this patch into trunk, there is a work, shaded Hadoop client artifacts and minicluster, on HADOOP-11804. hadoop-client has its own Guava which is shaded, so we can update dependency with minimum effect compare to previous HADOOP-11804.

See also HADOOP-14238 as related problem.

• Assignee: Tsuyoshi Ozawa
• Reporter: Rakesh Radhakrishnan
• Created: 14/Nov/13 14:43
• Updated: 25/Oct/19 20:25
• Resolved: 25/Mar/17 01:17

Description

The existing guava version is 11.0.2 which is quite old. This issue tries to update the version to as latest version as possible.

Issue Links

• breaks: YARN-6414 ATSv2 HBase related tests fail due to guava version upgrade
• breaks: HADOOP-14284 Shade Guava everywhere
• breaks: YARN-6564 RM service is shutting down when ATS v2 is enabled
• breaks: HADOOP-14280 Fix compilation of TestKafkaMetrics
• incorporates: HDFS-5518 HDFS doesn't compile/run against Guava 1.5
• is blocked by: HADOOP-14187 Update ZooKeeper dependency to 3.4.9 and Curator dependency to 2.12.0
• is depended upon by: HADOOP-10961 Use of deprecated Google Guava (v17) Stopwatch constructor in Hadoop FileInputFormat causes an exception
• is depended upon by: HADOOP-11102 Downgrade curator version to 2.4.1
• is depended upon by: HADOOP-9991 Fix up Hadoop POMs, roll up JARs to latest versions
• is duplicated by: HADOOP-11319 Update Guava to 18.0
• is duplicated by: HDFS-7040 HDFS dangerously uses @Beta methods from very old versions of Guava
• is duplicated by: HDFS-9793 upgrade or remove guava dependency
• is related to: HADOOP-14380 Make the Guava version Hadoop which builds with configurable
• is related to: HADOOP-14891 Remove references to Guava Objects.toStringHelper
• is related to: HADOOP-11286 Map/Reduce dangerously adds Guava @Beta class to CryptoUtils
• is related to: HADOOP-11470 Remove some uses of obsolete guava APIs from the hadoop codebase
• is related to: JENA-842 Elephas IO library does not build
• is related to: YARN-3029 FSDownload.unpack() uses local locale for FS case conversion, may not work everywhere
• is related to: HADOOP-14382 Remove usages of MoreObjects.toStringHelper
• is related to: SOLR-11763 Upgrade Guava to 25.1-jre
• is superceded by: HADOOP-15272 Update Guava, see what breaks
• relates to: HADOOP-11319 Update Guava to 18.0
• relates to: HADOOP-14957 ReconfigurationTaskStatus is exposing guava Optional in its public api
• relates to: HADOOP-15960 Update guava to 27.0-jre in hadoop-project
• relates to: BOOKKEEPER-708 Shade protobuf library to avoid incompatible versions
• relates to: HADOOP-11602 Fix toUpperCase/toLowerCase to use Locale.ENGLISH
• relates to: HADOOP-12064 [JDK8] Update guice version to 4.0
• relates to: HADOOP-14238 [Umbrella] Rechecking Guava's object is not exposed to user-facing API
• relates to: HADOOP-11616 Remove workaround for Curator's ChildReaper requiring Guava 15+
• relates to: HBASE-9667 NullOutputStream removed from Guava 15
• relates to: HADOOP-11032 Replace use of Guava's Stopwatch with Hadoop's StopWatch
• relates to: HADOOP-10067 Missing POM dependency on jsr305
• relates to: HADOOP-11612 Workaround for Curator's ChildReaper requiring Guava 15+

Sub-Tasks

• Fix up source codes to be compiled with Guava 17.0: Closed