Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-3173

inconsistent globbing support for dfs commands

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • None
    • None
    • Hadoop 0.16.1

    Description

      hadoop dfs -mkdir /user//bar creates a directory "/user//bar" and you cant deleted /user/* as -rmr expands the glob

      $ hadoop dfs -mkdir /user/rajive/a/*/foo
      $ hadoop dfs -ls /user/rajive/a
      Found 4 items
      /user/rajive/a/* <dir> 2008-04-04 16:09 rwx------ rajive users
      /user/rajive/a/b <dir> 2008-04-04 16:08 rwx------ rajive users
      /user/rajive/a/c <dir> 2008-04-04 16:08 rwx------ rajive users
      /user/rajive/a/d <dir> 2008-04-04 16:08 rwx------ rajive users

      $ hadoop dfs -ls /user/rajive/a/*
      /user/rajive/a/*/foo <dir> 2008-04-04 16:09 rwx------ rajive users

      $ hadoop dfs -rmr /user/rajive/a/*
      Moved to trash: hdfs://namenode-1:8020/user/rajive/a/*
      Moved to trash: hdfs://namenode-1:8020/user/rajive/a/b
      Moved to trash: hdfs://namenode-1:8020/user/rajive/a/c
      Moved to trash: hdfs://namenode-1:8020/user/rajive/a/d

      I am not able to escape '*' from being expanded.

      $ hadoop dfs -rmr '/user/rajive/a/*'
      Moved to trash: hdfs://namenode-1:8020/user/rajive/a/*
      Moved to trash: hdfs://namenode-1:8020/user/rajive/a/b
      Moved to trash: hdfs://namenode-1:8020/user/rajive/a/c
      Moved to trash: hdfs://namenode-1:8020/user/rajive/a/d

      $ hadoop dfs -rmr '/user/rajive/a/*'
      Moved to trash: hdfs://namenode-1:8020/user/rajive/a/*
      Moved to trash: hdfs://namenode-1:8020/user/rajive/a/b
      Moved to trash: hdfs://namenode-1:8020/user/rajive/a/c
      Moved to trash: hdfs://namenode-1:8020/user/rajive/a/d

      $ hadoop dfs -rmr /user/rajive/a/*
      Moved to trash: hdfs://namenode-1:8020/user/rajive/a/*
      Moved to trash: hdfs://namenode-1:8020/user/rajive/a/b
      Moved to trash: hdfs://namenode-1:8020/user/rajive/a/c
      Moved to trash: hdfs://namenode-1:8020/user/rajive/a/d

      Attachments

        1. 3173-0.patch
          4 kB
          Christopher Douglas

        Issue Links

          Activity

            People

              cdouglas Christopher Douglas
              rajive Rajiv Chittajallu
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: