[FLUME-2717] Add commons-io dependency into hadoop-2 profile to enable Flume 1.5 to support Hadoop 2.7

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.5.0
• Component/s: Sinks+Sources
• Assignee: Xiang Li
• Reporter: sam liu
• Created: 11/Jun/15 06:04
• Updated: 13/Sep/17 16:01
• Resolved: 20/Nov/16 15:51

Description

By default, for branch origin/flume-1.5, the hadoop2.version is 2.4.0. However, if we want to use hadoop-2.7.0 in flume-1.5, some hadoop regarding tests will fail with exception 'java.lang.NoClassDefFoundError: org/apache/commons/io/Charsets'.

The missed class Charsets is a new class in commons-io 2.4 jar file which is invoked by hadoop-2.7.0, however flume-1.5 depends on commons-io 2.1 which does not include the class 'Charsets'.

Therefore the solution to enable flume-1.5 to support hadoop-2.7.0 is to add commons-io 2.4 as a dependency into the hadoop-2 profile.

Issue Links

• duplicates: FLUME-2662 Upgrade to Commons-IO 2.4