Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-10965

Print fully qualified path in CommandWithDestination error messages

VotersStop watchingWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.4.1
    • 2.8.0, 3.0.0-alpha1
    • None

    Description

      Whenever I try to copy data from local to a cluster, but forget to create the parent directory first, I get a very confusing error message:

      $ whoami
      fs111
      
      $ hadoop fs -ls  /user
      Found 2 items
      drwxr-xr-x   - fs111   supergroup          0 2014-08-11 20:17 /user/hive
      drwxr-xr-x   - vagrant supergroup          0 2014-08-11 19:15 /user/vagrant
      
      $ hadoop fs -copyFromLocal data data
      copyFromLocal: `data': No such file or directory
      

      From the error message, you would say that the local "data" directory is not existing, but that is not the case. What is missing is the "/user/fs111" directory on HDFS. After I created it, the copyFromLocal command works fine.

      I believe the error message is confusing and should at least be fixed. What would be even better, if hadoop could restore the old behaviour in 1.x, where copyFromLocal would just create the directories, if they are missing.

      Attachments

        1. HADOOP-10965.001.patch
          13 kB
          John Zhuge
        2. HADOOP-10965.002.patch
          11 kB
          John Zhuge

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            jzhuge John Zhuge
            fs111 André Kelpe
            Votes:
            0 Vote for this issue
            Watchers:
            10 Stop watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment