Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-2674

hdfs script does not work out of the box.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Cannot Reproduce
    • None
    • None
    • None
    • None

    Description

      As the title says, hadoop-config.sh doesn't add the hadoop-common jars, which makes the hdfs script fail.

      To repro, follow the instructions from http://wiki.apache.org/hadoop/HowToSetupYourDevelopmentEnvironment

      ivank@spokegrown-lm ~/src/hadoop-common Tue Dec 13 19:14:24 [0 jobs] [hist 1889] 
      $ export HADOOP_COMMON_HOME=$(pwd)/$(ls -d hadoop-common-project/hadoop-common/target/hadoop-common-*-SNAPSHOT)
      ivank@spokegrown-lm ~/src/hadoop-common Tue Dec 13 19:14:29 [0 jobs] [hist 1890] 
      $ export HADOOP_HDFS_HOME=$(pwd)/$(ls -d hadoop-hdfs-project/hadoop-hdfs/target/hadoop-hdfs-*-SNAPSHOT)
      ivank@spokegrown-lm ~/src/hadoop-common Tue Dec 13 19:14:36 [0 jobs] [hist 1891] 
      $ export PATH=$HADOOP_COMMON_HOME/bin:$HADOOP_HDFS_HOME/bin:$PATH
      ivank@spokegrown-lm ~/src/hadoop-common Tue Dec 13 19:14:42 [0 jobs] [hist 1892] 
      $ cat > $HADOOP_COMMON_HOME/etc/hadoop/core-site.xml  << EOF
      > <?xml version="1.0"?><!-- core-site.xml -->
      > <configuration>
      >   <property>
      >     <name>fs.default.name</name>
      >     <value>hdfs://localhost/</value>
      >   </property>
      > </configuration>
      > EOF
      ivank@spokegrown-lm ~/src/hadoop-common Tue Dec 13 19:14:51 [0 jobs] [hist 1893] 
      $ hdfs namenode -format
      Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/HadoopIllegalArgumentException
      Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.HadoopIllegalArgumentException
      	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
      	at java.security.AccessController.doPrivileged(Native Method)
      	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
      	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
      	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
      	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
      
      

      Attachments

        1. HDFS-2674.diff
          0.6 kB
          Ivan Kelly

        Activity

          People

            ikelly Ivan Kelly
            ikelly Ivan Kelly
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: