Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      java.net.MalformedURLException: unknown protocol: hdfs
      	at java.net.URL.<init>(URL.java:395)
      	at java.net.URL.<init>(URL.java:283)
      	at org.apache.hadoop.fs.TestUrlStreamHandler.testDfsUrls(TestUrlStreamHandler.java:78)
      	...
      
      1. HDFS-3323.patch
        2 kB
        Alejandro Abdelnur

        Activity

        Hide
        Alejandro Abdelnur added a comment -

        Attached patch works from my IDE (IntelliJ) but it fails from Maven, it seems that when running from Maven the custom URLStreamHandler is not being invoked.

        Thoughts?

        Wonder how this worked before, also, when running the testcases locally before committing I have not seen the error (odd).

        Show
        Alejandro Abdelnur added a comment - Attached patch works from my IDE (IntelliJ) but it fails from Maven, it seems that when running from Maven the custom URLStreamHandler is not being invoked. Thoughts? Wonder how this worked before, also, when running the testcases locally before committing I have not seen the error (odd).
        Hide
        Daryn Sharp added a comment -

        I looked into this problem a bit yesterday. The loaded config contains keys for fs.AbstractFileSystem.$scheme.impl instead of the expected fs.$scheme.impl. I looked at some of the earlier commits but did not see anything that would appear to cause this issue.

        Show
        Daryn Sharp added a comment - I looked into this problem a bit yesterday. The loaded config contains keys for fs.AbstractFileSystem.$scheme.impl instead of the expected fs.$scheme.impl . I looked at some of the earlier commits but did not see anything that would appear to cause this issue.
        Hide
        Alejandro Abdelnur added a comment -

        correction my patch works correctly when running the testcase from maven. I made a mistake when testing it that i was running the test from hadoop-hdfs/ but I did not push hadoop-common to the m2 cache (where the fix actually is), thus maven was picking up a JAR from m2 without the fix. From the IDE was working because I have whole Hadoop source in it and it was picking up the fix.

        Show
        Alejandro Abdelnur added a comment - correction my patch works correctly when running the testcase from maven. I made a mistake when testing it that i was running the test from hadoop-hdfs/ but I did not push hadoop-common to the m2 cache (where the fix actually is), thus maven was picking up a JAR from m2 without the fix. From the IDE was working because I have whole Hadoop source in it and it was picking up the fix.
        Hide
        Alejandro Abdelnur added a comment -

        BTW, test-patch wont run the offending testcase because the changes are in common and testcase is in hdfs.

        The reviewer should apply the patch locally and run the testcase from trunk/

        Show
        Alejandro Abdelnur added a comment - BTW, test-patch wont run the offending testcase because the changes are in common and testcase is in hdfs. The reviewer should apply the patch locally and run the testcase from trunk/
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12524395/HDFS-3323.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        -1 patch. The patch command could not apply the patch.

        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/2334//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12524395/HDFS-3323.patch against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. -1 patch. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/2334//console This message is automatically generated.
        Hide
        Tsz Wo Nicholas Sze added a comment -

        +1 patch looks good.

        Show
        Tsz Wo Nicholas Sze added a comment - +1 patch looks good.
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12524395/HDFS-3323.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in .

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/892//testReport/
        Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/892//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12524395/HDFS-3323.patch against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/892//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/892//console This message is automatically generated.
        Hide
        Alejandro Abdelnur added a comment -

        committed to trunk and branch-2

        Show
        Alejandro Abdelnur added a comment - committed to trunk and branch-2
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk-Commit #2158 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2158/)
        HADOOP-8321. TestUrlStreamHandler fails. (tucu) (Revision 1331073)

        Result = SUCCESS
        tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1331073
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FsUrlStreamHandlerFactory.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #2158 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2158/ ) HADOOP-8321 . TestUrlStreamHandler fails. (tucu) (Revision 1331073) Result = SUCCESS tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1331073 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FsUrlStreamHandlerFactory.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk-Commit #2215 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2215/)
        HADOOP-8321. TestUrlStreamHandler fails. (tucu) (Revision 1331073)

        Result = SUCCESS
        tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1331073
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FsUrlStreamHandlerFactory.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #2215 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2215/ ) HADOOP-8321 . TestUrlStreamHandler fails. (tucu) (Revision 1331073) Result = SUCCESS tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1331073 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FsUrlStreamHandlerFactory.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-trunk-Commit #2141 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2141/)
        HADOOP-8321. TestUrlStreamHandler fails. (tucu) (Revision 1331073)

        Result = SUCCESS
        tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1331073
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FsUrlStreamHandlerFactory.java
        Show
        Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #2141 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2141/ ) HADOOP-8321 . TestUrlStreamHandler fails. (tucu) (Revision 1331073) Result = SUCCESS tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1331073 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FsUrlStreamHandlerFactory.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk #1027 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1027/)
        HADOOP-8321. TestUrlStreamHandler fails. (tucu) (Revision 1331073)

        Result = FAILURE
        tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1331073
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FsUrlStreamHandlerFactory.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #1027 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1027/ ) HADOOP-8321 . TestUrlStreamHandler fails. (tucu) (Revision 1331073) Result = FAILURE tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1331073 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FsUrlStreamHandlerFactory.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk #1062 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1062/)
        HADOOP-8321. TestUrlStreamHandler fails. (tucu) (Revision 1331073)

        Result = FAILURE
        tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1331073
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FsUrlStreamHandlerFactory.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #1062 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1062/ ) HADOOP-8321 . TestUrlStreamHandler fails. (tucu) (Revision 1331073) Result = FAILURE tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1331073 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FsUrlStreamHandlerFactory.java

          People

          • Assignee:
            Alejandro Abdelnur
            Reporter:
            Tsz Wo Nicholas Sze
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development