Hadoop Common
  1. Hadoop Common
  2. HADOOP-2191

dfs du and dus commands differ from POSIX standards

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.15.1, 0.16.0
    • Fix Version/s: 0.17.0
    • Component/s: None
    • Labels:
      None

      Description

      Assuming the dfs commands follow POSIX standards, there are some problems with the DFS du and dus commands. I compared the DFS output with that of RHEL 4u5

      1. du a file/directory that does not exist:
      Linux: du: cannot access `something': No such file or directory
      DFS: Found 0 items

      2. dus a file/directory that does not exist:

      • Linux: du: cannot access `something': No such file or directory
      • DFS: /something 0
      1. Hadoop-2191_4.patch
        3 kB
        Mahadev konar
      2. Hadoop-2191_2.patch
        3 kB
        Mahadev konar
      3. Hadoop-2191_1.patch
        3 kB
        Mahadev konar

        Issue Links

          Activity

          Gavin made changes -
          Link This issue is depended upon by HADOOP-1677 [ HADOOP-1677 ]
          Gavin made changes -
          Link This issue blocks HADOOP-1677 [ HADOOP-1677 ]
          Owen O'Malley made changes -
          Component/s dfs [ 12310710 ]
          Nigel Daley made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Hide
          Hudson added a comment -
          Show
          Hudson added a comment - Integrated in Hadoop-trunk #399 (See http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/399/ )
          dhruba borthakur made changes -
          Resolution Fixed [ 1 ]
          Fix Version/s 0.17.0 [ 12312913 ]
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hide
          dhruba borthakur added a comment -

          I just committed this. Thanks Mahadev!

          Show
          dhruba borthakur added a comment - I just committed this. Thanks Mahadev!
          Hide
          Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12375432/Hadoop-2191_4.patch
          against trunk revision 619744.

          @author +1. The patch does not contain any @author tags.

          tests included +1. The patch appears to include 3 new or modified tests.

          javadoc +1. The javadoc tool did not generate any warning messages.

          javac +1. The applied patch does not generate any new javac compiler warnings.

          release audit +1. The applied patch does not generate any new release audit warnings.

          findbugs +1. The patch does not introduce any new Findbugs warnings.

          core tests +1. The patch passed core unit tests.

          contrib tests +1. The patch passed contrib unit tests.

          Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1786/testReport/
          Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1786/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
          Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1786/artifact/trunk/build/test/checkstyle-errors.html
          Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1786/console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - +1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12375432/Hadoop-2191_4.patch against trunk revision 619744. @author +1. The patch does not contain any @author tags. tests included +1. The patch appears to include 3 new or modified tests. javadoc +1. The javadoc tool did not generate any warning messages. javac +1. The applied patch does not generate any new javac compiler warnings. release audit +1. The applied patch does not generate any new release audit warnings. findbugs +1. The patch does not introduce any new Findbugs warnings. core tests +1. The patch passed core unit tests. contrib tests +1. The patch passed contrib unit tests. Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1786/testReport/ Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1786/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1786/artifact/trunk/build/test/checkstyle-errors.html Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1786/console This message is automatically generated.
          Mahadev konar made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Lohit Vijayarenu added a comment -

          +1 Patch looks good

          Show
          Lohit Vijayarenu added a comment - +1 Patch looks good
          Mahadev konar made changes -
          Attachment Hadoop-2191_4.patch [ 12375432 ]
          Hide
          Mahadev konar added a comment -

          this patch removes some redundant lines.

          Show
          Mahadev konar added a comment - this patch removes some redundant lines.
          Mahadev konar made changes -
          Attachment Hadoop-2191_2.patch [ 12375431 ]
          Hide
          Mahadev konar added a comment -

          uploading new patch which removes deprecated apis used..

          Show
          Mahadev konar added a comment - uploading new patch which removes deprecated apis used..
          Mahadev konar made changes -
          Assignee Mahadev konar [ mahadev ]
          Mahadev konar made changes -
          Attachment Hadoop-2191_1.patch [ 12375423 ]
          Hide
          Mahadev konar added a comment -

          this patch fixes the issue.

          Show
          Mahadev konar added a comment - this patch fixes the issue.
          Nigel Daley made changes -
          Fix Version/s 0.16.0 [ 12312740 ]
          Mukund Madhugiri made changes -
          Link This issue blocks HADOOP-1677 [ HADOOP-1677 ]
          Mukund Madhugiri made changes -
          Description Assuming the dfs commands follow POSIX standards, there are some problems with the DFS ls and lsr commands. I compared the DFS output with that of RHEL 4u5

          1. ls a directory when there are no files/directories in that directory:
          Linux: No output
          DFS: Found 0 items

          2. ls a file/directory that does not exist:
          Linux: ls: /doesnotexist: No such file or directory
          DFS: Found 0 items

          3. lsr a directory that does not exist:
          Linux: ls: /doesnotexist: No such file or directory
          DFS: No output
          Assuming the dfs commands follow POSIX standards, there are some problems with the DFS du and dus commands. I compared the DFS output with that of RHEL 4u5

          1. du a file/directory that does not exist:
          Linux: du: cannot access `something': No such file or directory
          DFS: Found 0 items

          2. dus a file/directory that does not exist:
          - Linux: du: cannot access `something': No such file or directory
          - DFS: /something 0
          Mukund Madhugiri made changes -
          Field Original Value New Value
          Link This issue is a clone of HADOOP-2190 [ HADOOP-2190 ]
          Mukund Madhugiri created issue -

            People

            • Assignee:
              Mahadev konar
              Reporter:
              Mukund Madhugiri
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development