Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-10965

Print fully qualified path in CommandWithDestination error messages

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.4.1
    • 2.8.0, 3.0.0-alpha1
    • None

    Description

      Whenever I try to copy data from local to a cluster, but forget to create the parent directory first, I get a very confusing error message:

      $ whoami
      fs111
      
      $ hadoop fs -ls  /user
      Found 2 items
      drwxr-xr-x   - fs111   supergroup          0 2014-08-11 20:17 /user/hive
      drwxr-xr-x   - vagrant supergroup          0 2014-08-11 19:15 /user/vagrant
      
      $ hadoop fs -copyFromLocal data data
      copyFromLocal: `data': No such file or directory
      

      From the error message, you would say that the local "data" directory is not existing, but that is not the case. What is missing is the "/user/fs111" directory on HDFS. After I created it, the copyFromLocal command works fine.

      I believe the error message is confusing and should at least be fixed. What would be even better, if hadoop could restore the old behaviour in 1.x, where copyFromLocal would just create the directories, if they are missing.

      Attachments

        1. HADOOP-10965.002.patch
          11 kB
          John Zhuge
        2. HADOOP-10965.001.patch
          13 kB
          John Zhuge

        Issue Links

          Activity

            People

              jzhuge John Zhuge
              fs111 André Kelpe
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: