Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-4207

All hadoop fs operations fail if the default fs is down even if a different file system is specified in the command

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 1.0.0
    • Fix Version/s: 1.2.0
    • Component/s: hdfs-client
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      you can't do any hadoop fs commands against any hadoop filesystem (e.g, s3://, a remote hdfs://, webhdfs://) if the default FS of the client is offline. Only operations that need the local fs should be expected to fail in this situation

        Issue Links

          Activity

          Steve Loughran created issue -
          Hide
          Suresh Srinivas added a comment -

          This has been fixed in later releases. I think the change in HADOOP-7207 is related to this.

          Show
          Suresh Srinivas added a comment - This has been fixed in later releases. I think the change in HADOOP-7207 is related to this.
          Hide
          Steve Loughran added a comment -

          looks like it, though there's no version tags in HADOOP-7207; I'll track that down with changes.txt

          Show
          Steve Loughran added a comment - looks like it, though there's no version tags in HADOOP-7207 ; I'll track that down with changes.txt
          Steve Loughran made changes -
          Field Original Value New Value
          Link This issue duplicates HADOOP-7207 [ HADOOP-7207 ]
          Steve Loughran made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Duplicate [ 3 ]
          Hide
          Suresh Srinivas added a comment -

          Steve, I am reopening this. Given this change is useful, lets backport HADOOP-7207 using this jira.

          Show
          Suresh Srinivas added a comment - Steve, I am reopening this. Given this change is useful, lets backport HADOOP-7207 using this jira.
          Suresh Srinivas made changes -
          Resolution Duplicate [ 3 ]
          Status Resolved [ 5 ] Reopened [ 4 ]
          Hide
          Jing Zhao added a comment -

          Initial patch backport HADOOP-7207 and HDFS-1824. Will run ant test and testpatch for it and post results later.

          Show
          Jing Zhao added a comment - Initial patch backport HADOOP-7207 and HDFS-1824 . Will run ant test and testpatch for it and post results later.
          Jing Zhao made changes -
          Attachment HDFS-4207.b1.001.patch [ 12554419 ]
          Jing Zhao made changes -
          Assignee Jing Zhao [ jingzhao ]
          Hide
          Jing Zhao added a comment -

          All the unit testcases passed except TestNNThroughputBenchmark which is reported in HDFS-4204. The results of the test-patch:

          -1 overall.  
              +1 @author.  The patch does not contain any @author tags.
              +1 tests included.  The patch appears to include 6 new or modified tests.
              +1 javadoc.  The javadoc tool did not generate any warning messages.
              +1 javac.  The applied patch does not increase the total number of javac compiler warnings.
              -1 findbugs.  The patch appears to introduce 225 new Findbugs (version 2.0.1) warnings.
          
          Show
          Jing Zhao added a comment - All the unit testcases passed except TestNNThroughputBenchmark which is reported in HDFS-4204 . The results of the test-patch: -1 overall. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 6 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. -1 findbugs. The patch appears to introduce 225 new Findbugs (version 2.0.1) warnings.
          Hide
          Suresh Srinivas added a comment -

          +1 for the patch. Thanks for porting it.

          Show
          Suresh Srinivas added a comment - +1 for the patch. Thanks for porting it.
          Suresh Srinivas made changes -
          Summary all hadoop fs operations fail if the default fs is down -even if they don't go near it. All hadoop fs operations fail if the default fs is down even if a different file system specified in the command
          Affects Version/s 1.0.0 [ 12318243 ]
          Affects Version/s 1.0.4 [ 12322463 ]
          Suresh Srinivas made changes -
          Summary All hadoop fs operations fail if the default fs is down even if a different file system specified in the command All hadoop fs operations fail if the default fs is down even if a different file system is specified in the command
          Hide
          Suresh Srinivas added a comment -

          I committed the patch to branch-1. Thank you Jing.

          Show
          Suresh Srinivas added a comment - I committed the patch to branch-1. Thank you Jing.
          Suresh Srinivas made changes -
          Status Reopened [ 4 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Fix Version/s 1.2.0 [ 12321657 ]
          Resolution Fixed [ 1 ]
          Hide
          Matt Foley added a comment -

          Closed upon release of Hadoop 1.2.0.

          Show
          Matt Foley added a comment - Closed upon release of Hadoop 1.2.0.
          Matt Foley made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Jing Zhao
              Reporter:
              Steve Loughran
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development