[DRILL-1160] Need changes to Drill classpath to run Drill on CDH

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Fix Version/s: Future
• Component/s: Tools, Build & Test

Environment

CDH 4 and CDH 5

• Assignee: Unassigned
• Reporter: Amit Katti
• Created: 19/Jul/14 00:46
• Updated: 01/Oct/15 16:38

Description

For Drill to work successfully on CDH, we need to make changes to the classpath. Otherwise while making changes to the storage plugin to point to hdfs on the UI, it simply hangs.

The required jars to be present on the Drill classpath are:
/opt/cloudera/parcels/CDH-4.7.0-1.cdh4.7.0.p0.40/lib/hadoop/hadoop-annotations-2.0.0-cdh4.7.0.jar
/opt/cloudera/parcels/CDH-4.7.0-1.cdh4.7.0.p0.40/lib/hadoop/hadoop-auth-2.0.0-cdh4.7.0.jar
/opt/cloudera/parcels/CDH-4.7.0-1.cdh4.7.0.p0.40/lib/hadoop/hadoop-common-2.0.0-cdh4.7.0.jar
/opt/cloudera/parcels/CDH-4.7.0-1.cdh4.7.0.p0.40/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.7.0.jar

However inside these 2 folders (hadoop & hadoop-hdfs) there are multiple duplicate soft links to these jars, which i believe is causing some kind of classpath ordering issue.

These 2 commands should help us get the required jars from the folders:
ls -all /opt/cloudera/parcels/CDH-4.7.0-1.cdh4.7.0.p0.40/lib/hadoop/.jar | grep -v '^l' | grep -v 'test' | grep -Eo '([^ ]|
)$'

ls -all /opt/cloudera/parcels/CDH-4.7.0-1.cdh4.7.0.p0.40/lib/hadoop-hdfs/.jar | grep -v '^l' | grep -v 'test' | grep -Eo '([^ ]|
)$'

Also the location of these jars can change depending on how/where they are installed