Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.21.1
    • Fix Version/s: 0.20.204.0, 0.21.1, 0.22.0, 0.23.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      hadoop dfs -touchz /tmp/file1 # create file. OK
      hadoop dfs -ls /tmp/file1  # OK
      hadoop dfs -ls hftp://namenode:50070/tmp/file1 # FAILED: not seeing the file
      
      1. h1750_20110314.patch
        5 kB
        Tsz Wo Nicholas Sze
      2. h1750_20110314_0.21.patch
        4 kB
        Tsz Wo Nicholas Sze
      3. h1750_20110314_0.20-security.patch
        4 kB
        Tsz Wo Nicholas Sze

        Issue Links

          Activity

          Hide
          Tsz Wo Nicholas Sze added a comment -

          h1750_20110314.patch: use getFullPath(..) in ListPathsServlet.

          Show
          Tsz Wo Nicholas Sze added a comment - h1750_20110314.patch: use getFullPath(..) in ListPathsServlet.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12473616/h1750_20110314.patch
          against trunk revision 1080836.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 3 new or modified tests.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed these core unit tests:
          org.apache.hadoop.hdfs.TestFileConcurrentReader

          -1 contrib tests. The patch failed contrib unit tests.

          +1 system test framework. The patch passed system test framework compile.

          Test results: https://hudson.apache.org/hudson/job/PreCommit-HDFS-Build/258//testReport/
          Findbugs warnings: https://hudson.apache.org/hudson/job/PreCommit-HDFS-Build/258//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
          Console output: https://hudson.apache.org/hudson/job/PreCommit-HDFS-Build/258//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12473616/h1750_20110314.patch against trunk revision 1080836. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed these core unit tests: org.apache.hadoop.hdfs.TestFileConcurrentReader -1 contrib tests. The patch failed contrib unit tests. +1 system test framework. The patch passed system test framework compile. Test results: https://hudson.apache.org/hudson/job/PreCommit-HDFS-Build/258//testReport/ Findbugs warnings: https://hudson.apache.org/hudson/job/PreCommit-HDFS-Build/258//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Console output: https://hudson.apache.org/hudson/job/PreCommit-HDFS-Build/258//console This message is automatically generated.
          Hide
          Suresh Srinivas added a comment -

          Comments:

          1. Can you add a description why this problem happens and how you are fixing it?
          2. Should we create a bug for access and modification time mismatch between hftp access and direct hdfs access?

          +1 for the patch.

          Show
          Suresh Srinivas added a comment - Comments: Can you add a description why this problem happens and how you are fixing it? Should we create a bug for access and modification time mismatch between hftp access and direct hdfs access? +1 for the patch.
          Hide
          Tsz Wo Nicholas Sze added a comment -

          Suresh, thanks for the review.

          1. Can you add a description why this problem happens and how you are fixing it?

          The problem is that HdfsFileStatus.getLocalName() returns an empty string in some cases; see HDFS-1743.

          The solution here is simply not to use HdfsFileStatus.getLocalName() in ListPathsServlet. We use HdfsFileStatus.getFullPath(..) instead since the full path is required anyway.

          Should we create a bug for access and modification time mismatch between hftp access and direct hdfs access?

          Will do.

          Show
          Tsz Wo Nicholas Sze added a comment - Suresh, thanks for the review. 1. Can you add a description why this problem happens and how you are fixing it? The problem is that HdfsFileStatus.getLocalName() returns an empty string in some cases; see HDFS-1743 . The solution here is simply not to use HdfsFileStatus.getLocalName() in ListPathsServlet . We use HdfsFileStatus.getFullPath(..) instead since the full path is required anyway. Should we create a bug for access and modification time mismatch between hftp access and direct hdfs access? Will do.
          Hide
          Tsz Wo Nicholas Sze added a comment -

          h1750_20110314_0.20-security.patch: for 0.20-security (the changes are the same)

          Show
          Tsz Wo Nicholas Sze added a comment - h1750_20110314_0.20-security.patch: for 0.20-security (the changes are the same)
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12473952/h1750_20110314_0.20-security.patch
          against trunk revision 1082263.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 3 new or modified tests.

          -1 patch. The patch command could not apply the patch.

          Console output: https://hudson.apache.org/hudson/job/PreCommit-HDFS-Build/268//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12473952/h1750_20110314_0.20-security.patch against trunk revision 1082263. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. -1 patch. The patch command could not apply the patch. Console output: https://hudson.apache.org/hudson/job/PreCommit-HDFS-Build/268//console This message is automatically generated.
          Hide
          Jitendra Nath Pandey added a comment -

          +1 for the patch.

          Show
          Jitendra Nath Pandey added a comment - +1 for the patch.
          Hide
          Suresh Srinivas added a comment -

          +1 for the 20.security version of the patch.

          Show
          Suresh Srinivas added a comment - +1 for the 20.security version of the patch.
          Hide
          Tsz Wo Nicholas Sze added a comment -

          h1750_20110314_0.21.patch: for 0.21

          Show
          Tsz Wo Nicholas Sze added a comment - h1750_20110314_0.21.patch: for 0.21
          Hide
          Tsz Wo Nicholas Sze added a comment -

          I have committed this to trunk, 0.22, 0.21.1 and 0.20-security.

          Thanks Suresh and Jitendra for the review.

          Show
          Tsz Wo Nicholas Sze added a comment - I have committed this to trunk, 0.22, 0.21.1 and 0.20-security. Thanks Suresh and Jitendra for the review.
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk-Commit #569 (See https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/569/)

          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #569 (See https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/569/ )
          Hide
          Tsz Wo Nicholas Sze added a comment -

          >> Should we create a bug for access and modification time mismatch between hftp access and direct hdfs access?
          >
          > Will do.

          I filed HDFS-1772 for the access/modification time bug.

          Show
          Tsz Wo Nicholas Sze added a comment - >> Should we create a bug for access and modification time mismatch between hftp access and direct hdfs access? > > Will do. I filed HDFS-1772 for the access/modification time bug.
          Hide
          Philip Zeyliger added a comment -

          I'm traveling and will return to the office on Monday, March 28th.

          For urgent matters, please contact Aparna Ramani.

          Thanks!

          – Philip

          Show
          Philip Zeyliger added a comment - I'm traveling and will return to the office on Monday, March 28th. For urgent matters, please contact Aparna Ramani. Thanks! – Philip
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk #643 (See https://builds.apache.org/hudson/job/Hadoop-Hdfs-trunk/643/)

          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #643 (See https://builds.apache.org/hudson/job/Hadoop-Hdfs-trunk/643/ )
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-22-branch #35 (See https://builds.apache.org/hudson/job/Hadoop-Hdfs-22-branch/35/)

          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-22-branch #35 (See https://builds.apache.org/hudson/job/Hadoop-Hdfs-22-branch/35/ )
          Hide
          Owen O'Malley added a comment -

          Hadoop 0.20.204.0 was released.

          Show
          Owen O'Malley added a comment - Hadoop 0.20.204.0 was released.

            People

            • Assignee:
              Tsz Wo Nicholas Sze
              Reporter:
              Tsz Wo Nicholas Sze
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development