Apache Drill
  1. Apache Drill
  2. DRILL-1160

Need changes to Drill classpath to run Drill on CDH

    Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Minor Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: 1.4.0
    • Component/s: Tools, Build & Test
    • Labels:
      None
    • Environment:

      CDH 4 and CDH 5

      Description

      For Drill to work successfully on CDH, we need to make changes to the classpath. Otherwise while making changes to the storage plugin to point to hdfs on the UI, it simply hangs.

      The required jars to be present on the Drill classpath are:
      /opt/cloudera/parcels/CDH-4.7.0-1.cdh4.7.0.p0.40/lib/hadoop/hadoop-annotations-2.0.0-cdh4.7.0.jar
      /opt/cloudera/parcels/CDH-4.7.0-1.cdh4.7.0.p0.40/lib/hadoop/hadoop-auth-2.0.0-cdh4.7.0.jar
      /opt/cloudera/parcels/CDH-4.7.0-1.cdh4.7.0.p0.40/lib/hadoop/hadoop-common-2.0.0-cdh4.7.0.jar
      /opt/cloudera/parcels/CDH-4.7.0-1.cdh4.7.0.p0.40/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.7.0.jar

      However inside these 2 folders (hadoop & hadoop-hdfs) there are multiple duplicate soft links to these jars, which i believe is causing some kind of classpath ordering issue.

      These 2 commands should help us get the required jars from the folders:
      ls -all /opt/cloudera/parcels/CDH-4.7.0-1.cdh4.7.0.p0.40/lib/hadoop/.jar | grep -v '^l' | grep -v 'test' | grep -Eo '([^ ]|
      )
      $'

      ls -all /opt/cloudera/parcels/CDH-4.7.0-1.cdh4.7.0.p0.40/lib/hadoop-hdfs/.jar | grep -v '^l' | grep -v 'test' | grep -Eo '([^ ]|
      )
      $'

      Also the location of these jars can change depending on how/where they are installed

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Ramana Inukonda Nagaraj
            Reporter:
            Amit Katti
          • Votes:
            1 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:

              Development