[HDDS-1525] Mapreduce failure when using Hadoop 2.7.5

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.4.0
• Fix Version/s: 0.4.1
• Component/s: Ozone Filesystem
• Labels: pull-request-available
• Target Version/s: 0.4.1
• Sprint: Done
• Assignee: Marton Elek
• Reporter: Sammi Chen
• Created: 14/May/19 02:15
• Updated: 05/Aug/19 14:45
• Resolved: 10/Jul/19 13:36

Description

Integrate Ozone(0.4 branch) with Hadoop 2.7.5, "hdfs dfs -ls /" can pass, while teragen failed.

When add -verbose:class to java options, it shows that class KeyProvider is loaded twice by different classloader while it is only loaded once when execute "hdfs dfs -ls /"

All jars under share/ozone/lib are added into hadoop classpath except ozone file system current lib jar.

Issue Links

• contains: HDDS-1446 Grpc channels are leaked in XceiverClientGrpc
• links to: GitHub Pull Request #1065