Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12304

Applications using FileContext fail with the default file system configured to be wasb/s3/etc.

    Details

    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      HADOOP-11618 fixed a bug with DelegateToFileSystem using the wrong default port. As a side effect of this patch, file path URLs that previously had no port now insert :0 for the port, as per the default implementation of FileSystem#getDefaultPort. At runtime, this can cause an application to erroneously try contacting port 0 for a remote blob store service. The connection fails. Ultimately, this renders wasb, s3, and probably custom file system implementations outside the Hadoop source tree completely unusable as the default file system.

        Issue Links

          Activity

          Hide
          cnauroth Chris Nauroth added a comment -

          The problem is that FileSystem#getDefaultPort is coded to return 0 to indicate undefined, and wasb, s3, etc. do not override it. However, the logic of AbstractFileSystem#getUri expects -1 as the sentinel value to indicate undefined. This is more in line with the contract of java.net.URI#getPort. The test cases for HADOOP-11618 didn't catch this, because they were focused on the positive case of a file system that requires specifying an authority (including port), specifically FtpFs.

          Here is a sample stack trace from the MapReduce application master with wasb as the default file system.

          2015-08-04 12:17:57,326 ERROR [main] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Failed while checking for/creating  history staging path: [wasb://cnauroth.blob.core.windows.net:0/tmp/hadoop-yarn/staging/chris/.staging/job_1438715383283_0002]
          org.apache.hadoop.fs.azure.AzureException: org.apache.hadoop.fs.azure.AzureException: Unable to access container $root in account cnauroth.blob.core.windows.net:0 using anonymous credentials, and no credentials found for them  in the configuration.
          	at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.createAzureStorageSession(AzureNativeFileSystemStore.java:943)
          	at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.initialize(AzureNativeFileSystemStore.java:440)
          	at org.apache.hadoop.fs.azure.NativeAzureFileSystem.initialize(NativeAzureFileSystem.java:1048)
          	at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2653)
          	at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:92)
          	at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2687)
          	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2669)
          	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:371)
          	at org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler.serviceInit(JobHistoryEventHandler.java:165)
          	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
          	at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
          	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceInit(MRAppMaster.java:450)
          	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
          	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1518)
          	at java.security.AccessController.doPrivileged(Native Method)
          	at javax.security.auth.Subject.doAs(Subject.java:415)
          	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
          	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1515)
          	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1448)
          Caused by: org.apache.hadoop.fs.azure.AzureException: Unable to access container $root in account cnauroth.blob.core.windows.net:0 using anonymous credentials, and no credentials found for them  in the configuration.
          	at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.connectUsingAnonymousCredentials(AzureNativeFileSystemStore.java:740)
          	at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.createAzureStorageSession(AzureNativeFileSystemStore.java:938)
          	... 18 more
          Caused by: com.microsoft.azure.storage.StorageException: An unknown failure occurred : Can't assign requested address
          	at com.microsoft.azure.storage.StorageException.translateException(StorageException.java:66)
          	at com.microsoft.azure.storage.core.ExecutionEngine.executeWithRetry(ExecutionEngine.java:219)
          	at com.microsoft.azure.storage.blob.CloudBlobContainer.exists(CloudBlobContainer.java:749)
          	at com.microsoft.azure.storage.blob.CloudBlobContainer.exists(CloudBlobContainer.java:736)
          	at org.apache.hadoop.fs.azure.StorageInterfaceImpl$CloudBlobContainerWrapperImpl.exists(StorageInterfaceImpl.java:213)
          	at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.connectUsingAnonymousCredentials(AzureNativeFileSystemStore.java:734)
          	... 19 more
          Caused by: java.net.NoRouteToHostException: Can't assign requested address
          	at java.net.PlainSocketImpl.socketConnect(Native Method)
          	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
          	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
          	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
          	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
          	at java.net.Socket.connect(Socket.java:579)
          	at java.net.Socket.connect(Socket.java:528)
          	at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
          	at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
          	at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
          	at sun.net.www.http.HttpClient.<init>(HttpClient.java:211)
          	at sun.net.www.http.HttpClient.New(HttpClient.java:308)
          	at sun.net.www.http.HttpClient.New(HttpClient.java:326)
          	at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:996)
          	at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:932)
          	at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:850)
          	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1300)
          	at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:468)
          	at com.microsoft.azure.storage.core.ExecutionEngine.executeWithRetry(ExecutionEngine.java:126)
          	... 23 more
          2015-08-04 12:17:57,328 INFO [main] org.apache.hadoop.service.AbstractService: Service JobHistoryEventHandler failed in state INITED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: org.apache.hadoop.fs.azure.AzureException: org.apache.hadoop.fs.azure.AzureException: Unable to access container $root in account cnauroth.blob.core.windows.net:0 using anonymous credentials, and no credentials found for them  in the configuration.
          org.apache.hadoop.yarn.exceptions.YarnRuntimeException: org.apache.hadoop.fs.azure.AzureException: org.apache.hadoop.fs.azure.AzureException: Unable to access container $root in account cnauroth.blob.core.windows.net:0 using anonymous credentials, and no credentials found for them  in the configuration.
          	at org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler.serviceInit(JobHistoryEventHandler.java:171)
          	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
          	at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
          	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceInit(MRAppMaster.java:450)
          	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
          	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1518)
          	at java.security.AccessController.doPrivileged(Native Method)
          	at javax.security.auth.Subject.doAs(Subject.java:415)
          	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
          	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1515)
          	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1448)
          Caused by: org.apache.hadoop.fs.azure.AzureException: org.apache.hadoop.fs.azure.AzureException: Unable to access container $root in account cnauroth.blob.core.windows.net:0 using anonymous credentials, and no credentials found for them  in the configuration.
          	at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.createAzureStorageSession(AzureNativeFileSystemStore.java:943)
          	at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.initialize(AzureNativeFileSystemStore.java:440)
          	at org.apache.hadoop.fs.azure.NativeAzureFileSystem.initialize(NativeAzureFileSystem.java:1048)
          	at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2653)
          	at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:92)
          	at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2687)
          	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2669)
          	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:371)
          	at org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler.serviceInit(JobHistoryEventHandler.java:165)
          	... 10 more
          Caused by: org.apache.hadoop.fs.azure.AzureException: Unable to access container $root in account cnauroth.blob.core.windows.net:0 using anonymous credentials, and no credentials found for them  in the configuration.
          	at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.connectUsingAnonymousCredentials(AzureNativeFileSystemStore.java:740)
          	at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.createAzureStorageSession(AzureNativeFileSystemStore.java:938)
          	... 18 more
          Caused by: com.microsoft.azure.storage.StorageException: An unknown failure occurred : Can't assign requested address
          	at com.microsoft.azure.storage.StorageException.translateException(StorageException.java:66)
          	at com.microsoft.azure.storage.core.ExecutionEngine.executeWithRetry(ExecutionEngine.java:219)
          	at com.microsoft.azure.storage.blob.CloudBlobContainer.exists(CloudBlobContainer.java:749)
          	at com.microsoft.azure.storage.blob.CloudBlobContainer.exists(CloudBlobContainer.java:736)
          	at org.apache.hadoop.fs.azure.StorageInterfaceImpl$CloudBlobContainerWrapperImpl.exists(StorageInterfaceImpl.java:213)
          	at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.connectUsingAnonymousCredentials(AzureNativeFileSystemStore.java:734)
          	... 19 more
          Caused by: java.net.NoRouteToHostException: Can't assign requested address
          	at java.net.PlainSocketImpl.socketConnect(Native Method)
          	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
          	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
          	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
          	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
          	at java.net.Socket.connect(Socket.java:579)
          	at java.net.Socket.connect(Socket.java:528)
          	at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
          	at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
          	at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
          	at sun.net.www.http.HttpClient.<init>(HttpClient.java:211)
          	at sun.net.www.http.HttpClient.New(HttpClient.java:308)
          	at sun.net.www.http.HttpClient.New(HttpClient.java:326)
          	at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:996)
          	at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:932)
          	at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:850)
          	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1300)
          	at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:468)
          	at com.microsoft.azure.storage.core.ExecutionEngine.executeWithRetry(ExecutionEngine.java:126)
          	... 23 more
          2015-08-04 12:17:57,329 INFO [main] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping JobHistoryEventHandler. Size of the outstanding queue size is 0
          2015-08-04 12:17:57,329 INFO [main] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped JobHistoryEventHandler. super.stop()
          2015-08-04 12:17:57,329 INFO [main] org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state INITED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: org.apache.hadoop.fs.azure.AzureException: org.apache.hadoop.fs.azure.AzureException: Unable to access container $root in account cnauroth.blob.core.windows.net:0 using anonymous credentials, and no credentials found for them  in the configuration.
          org.apache.hadoop.yarn.exceptions.YarnRuntimeException: org.apache.hadoop.fs.azure.AzureException: org.apache.hadoop.fs.azure.AzureException: Unable to access container $root in account cnauroth.blob.core.windows.net:0 using anonymous credentials, and no credentials found for them  in the configuration.
          	at org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler.serviceInit(JobHistoryEventHandler.java:171)
          	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
          	at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
          	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceInit(MRAppMaster.java:450)
          	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
          	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1518)
          	at java.security.AccessController.doPrivileged(Native Method)
          	at javax.security.auth.Subject.doAs(Subject.java:415)
          	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
          	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1515)
          	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1448)
          Caused by: org.apache.hadoop.fs.azure.AzureException: org.apache.hadoop.fs.azure.AzureException: Unable to access container $root in account cnauroth.blob.core.windows.net:0 using anonymous credentials, and no credentials found for them  in the configuration.
          	at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.createAzureStorageSession(AzureNativeFileSystemStore.java:943)
          	at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.initialize(AzureNativeFileSystemStore.java:440)
          	at org.apache.hadoop.fs.azure.NativeAzureFileSystem.initialize(NativeAzureFileSystem.java:1048)
          	at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2653)
          	at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:92)
          	at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2687)
          	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2669)
          	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:371)
          	at org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler.serviceInit(JobHistoryEventHandler.java:165)
          	... 10 more
          Caused by: org.apache.hadoop.fs.azure.AzureException: Unable to access container $root in account cnauroth.blob.core.windows.net:0 using anonymous credentials, and no credentials found for them  in the configuration.
          	at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.connectUsingAnonymousCredentials(AzureNativeFileSystemStore.java:740)
          	at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.createAzureStorageSession(AzureNativeFileSystemStore.java:938)
          	... 18 more
          Caused by: com.microsoft.azure.storage.StorageException: An unknown failure occurred : Can't assign requested address
          	at com.microsoft.azure.storage.StorageException.translateException(StorageException.java:66)
          	at com.microsoft.azure.storage.core.ExecutionEngine.executeWithRetry(ExecutionEngine.java:219)
          	at com.microsoft.azure.storage.blob.CloudBlobContainer.exists(CloudBlobContainer.java:749)
          	at com.microsoft.azure.storage.blob.CloudBlobContainer.exists(CloudBlobContainer.java:736)
          	at org.apache.hadoop.fs.azure.StorageInterfaceImpl$CloudBlobContainerWrapperImpl.exists(StorageInterfaceImpl.java:213)
          	at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.connectUsingAnonymousCredentials(AzureNativeFileSystemStore.java:734)
          	... 19 more
          Caused by: java.net.NoRouteToHostException: Can't assign requested address
          	at java.net.PlainSocketImpl.socketConnect(Native Method)
          	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
          	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
          	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
          	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
          	at java.net.Socket.connect(Socket.java:579)
          	at java.net.Socket.connect(Socket.java:528)
          	at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
          	at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
          	at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
          	at sun.net.www.http.HttpClient.<init>(HttpClient.java:211)
          	at sun.net.www.http.HttpClient.New(HttpClient.java:308)
          	at sun.net.www.http.HttpClient.New(HttpClient.java:326)
          	at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:996)
          	at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:932)
          	at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:850)
          	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1300)
          	at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:468)
          	at com.microsoft.azure.storage.core.ExecutionEngine.executeWithRetry(ExecutionEngine.java:126)
          	... 23 more
          2015-08-04 12:17:57,329 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Skipping cleaning up the staging dir. assuming AM will be retried.
          
          Show
          cnauroth Chris Nauroth added a comment - The problem is that FileSystem#getDefaultPort is coded to return 0 to indicate undefined, and wasb, s3, etc. do not override it. However, the logic of AbstractFileSystem#getUri expects -1 as the sentinel value to indicate undefined. This is more in line with the contract of java.net.URI#getPort . The test cases for HADOOP-11618 didn't catch this, because they were focused on the positive case of a file system that requires specifying an authority (including port), specifically FtpFs . Here is a sample stack trace from the MapReduce application master with wasb as the default file system. 2015-08-04 12:17:57,326 ERROR [main] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Failed while checking for /creating history staging path: [wasb: //cnauroth.blob.core.windows.net:0/tmp/hadoop-yarn/staging/chris/.staging/job_1438715383283_0002] org.apache.hadoop.fs.azure.AzureException: org.apache.hadoop.fs.azure.AzureException: Unable to access container $root in account cnauroth.blob.core.windows.net:0 using anonymous credentials, and no credentials found for them in the configuration. at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.createAzureStorageSession(AzureNativeFileSystemStore.java:943) at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.initialize(AzureNativeFileSystemStore.java:440) at org.apache.hadoop.fs.azure.NativeAzureFileSystem.initialize(NativeAzureFileSystem.java:1048) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2653) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:92) at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2687) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2669) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:371) at org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler.serviceInit(JobHistoryEventHandler.java:165) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceInit(MRAppMaster.java:450) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1518) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1515) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1448) Caused by: org.apache.hadoop.fs.azure.AzureException: Unable to access container $root in account cnauroth.blob.core.windows.net:0 using anonymous credentials, and no credentials found for them in the configuration. at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.connectUsingAnonymousCredentials(AzureNativeFileSystemStore.java:740) at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.createAzureStorageSession(AzureNativeFileSystemStore.java:938) ... 18 more Caused by: com.microsoft.azure.storage.StorageException: An unknown failure occurred : Can't assign requested address at com.microsoft.azure.storage.StorageException.translateException(StorageException.java:66) at com.microsoft.azure.storage.core.ExecutionEngine.executeWithRetry(ExecutionEngine.java:219) at com.microsoft.azure.storage.blob.CloudBlobContainer.exists(CloudBlobContainer.java:749) at com.microsoft.azure.storage.blob.CloudBlobContainer.exists(CloudBlobContainer.java:736) at org.apache.hadoop.fs.azure.StorageInterfaceImpl$CloudBlobContainerWrapperImpl.exists(StorageInterfaceImpl.java:213) at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.connectUsingAnonymousCredentials(AzureNativeFileSystemStore.java:734) ... 19 more Caused by: java.net.NoRouteToHostException: Can't assign requested address at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:579) at java.net.Socket.connect(Socket.java:528) at sun.net.NetworkClient.doConnect(NetworkClient.java:180) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.<init>(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:996) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:932) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:850) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1300) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:468) at com.microsoft.azure.storage.core.ExecutionEngine.executeWithRetry(ExecutionEngine.java:126) ... 23 more 2015-08-04 12:17:57,328 INFO [main] org.apache.hadoop.service.AbstractService: Service JobHistoryEventHandler failed in state INITED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: org.apache.hadoop.fs.azure.AzureException: org.apache.hadoop.fs.azure.AzureException: Unable to access container $root in account cnauroth.blob.core.windows.net:0 using anonymous credentials, and no credentials found for them in the configuration. org.apache.hadoop.yarn.exceptions.YarnRuntimeException: org.apache.hadoop.fs.azure.AzureException: org.apache.hadoop.fs.azure.AzureException: Unable to access container $root in account cnauroth.blob.core.windows.net:0 using anonymous credentials, and no credentials found for them in the configuration. at org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler.serviceInit(JobHistoryEventHandler.java:171) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceInit(MRAppMaster.java:450) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1518) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1515) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1448) Caused by: org.apache.hadoop.fs.azure.AzureException: org.apache.hadoop.fs.azure.AzureException: Unable to access container $root in account cnauroth.blob.core.windows.net:0 using anonymous credentials, and no credentials found for them in the configuration. at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.createAzureStorageSession(AzureNativeFileSystemStore.java:943) at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.initialize(AzureNativeFileSystemStore.java:440) at org.apache.hadoop.fs.azure.NativeAzureFileSystem.initialize(NativeAzureFileSystem.java:1048) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2653) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:92) at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2687) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2669) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:371) at org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler.serviceInit(JobHistoryEventHandler.java:165) ... 10 more Caused by: org.apache.hadoop.fs.azure.AzureException: Unable to access container $root in account cnauroth.blob.core.windows.net:0 using anonymous credentials, and no credentials found for them in the configuration. at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.connectUsingAnonymousCredentials(AzureNativeFileSystemStore.java:740) at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.createAzureStorageSession(AzureNativeFileSystemStore.java:938) ... 18 more Caused by: com.microsoft.azure.storage.StorageException: An unknown failure occurred : Can't assign requested address at com.microsoft.azure.storage.StorageException.translateException(StorageException.java:66) at com.microsoft.azure.storage.core.ExecutionEngine.executeWithRetry(ExecutionEngine.java:219) at com.microsoft.azure.storage.blob.CloudBlobContainer.exists(CloudBlobContainer.java:749) at com.microsoft.azure.storage.blob.CloudBlobContainer.exists(CloudBlobContainer.java:736) at org.apache.hadoop.fs.azure.StorageInterfaceImpl$CloudBlobContainerWrapperImpl.exists(StorageInterfaceImpl.java:213) at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.connectUsingAnonymousCredentials(AzureNativeFileSystemStore.java:734) ... 19 more Caused by: java.net.NoRouteToHostException: Can't assign requested address at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:579) at java.net.Socket.connect(Socket.java:528) at sun.net.NetworkClient.doConnect(NetworkClient.java:180) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.<init>(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:996) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:932) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:850) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1300) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:468) at com.microsoft.azure.storage.core.ExecutionEngine.executeWithRetry(ExecutionEngine.java:126) ... 23 more 2015-08-04 12:17:57,329 INFO [main] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping JobHistoryEventHandler. Size of the outstanding queue size is 0 2015-08-04 12:17:57,329 INFO [main] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped JobHistoryEventHandler. super .stop() 2015-08-04 12:17:57,329 INFO [main] org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state INITED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: org.apache.hadoop.fs.azure.AzureException: org.apache.hadoop.fs.azure.AzureException: Unable to access container $root in account cnauroth.blob.core.windows.net:0 using anonymous credentials, and no credentials found for them in the configuration. org.apache.hadoop.yarn.exceptions.YarnRuntimeException: org.apache.hadoop.fs.azure.AzureException: org.apache.hadoop.fs.azure.AzureException: Unable to access container $root in account cnauroth.blob.core.windows.net:0 using anonymous credentials, and no credentials found for them in the configuration. at org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler.serviceInit(JobHistoryEventHandler.java:171) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceInit(MRAppMaster.java:450) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1518) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1515) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1448) Caused by: org.apache.hadoop.fs.azure.AzureException: org.apache.hadoop.fs.azure.AzureException: Unable to access container $root in account cnauroth.blob.core.windows.net:0 using anonymous credentials, and no credentials found for them in the configuration. at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.createAzureStorageSession(AzureNativeFileSystemStore.java:943) at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.initialize(AzureNativeFileSystemStore.java:440) at org.apache.hadoop.fs.azure.NativeAzureFileSystem.initialize(NativeAzureFileSystem.java:1048) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2653) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:92) at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2687) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2669) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:371) at org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler.serviceInit(JobHistoryEventHandler.java:165) ... 10 more Caused by: org.apache.hadoop.fs.azure.AzureException: Unable to access container $root in account cnauroth.blob.core.windows.net:0 using anonymous credentials, and no credentials found for them in the configuration. at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.connectUsingAnonymousCredentials(AzureNativeFileSystemStore.java:740) at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.createAzureStorageSession(AzureNativeFileSystemStore.java:938) ... 18 more Caused by: com.microsoft.azure.storage.StorageException: An unknown failure occurred : Can't assign requested address at com.microsoft.azure.storage.StorageException.translateException(StorageException.java:66) at com.microsoft.azure.storage.core.ExecutionEngine.executeWithRetry(ExecutionEngine.java:219) at com.microsoft.azure.storage.blob.CloudBlobContainer.exists(CloudBlobContainer.java:749) at com.microsoft.azure.storage.blob.CloudBlobContainer.exists(CloudBlobContainer.java:736) at org.apache.hadoop.fs.azure.StorageInterfaceImpl$CloudBlobContainerWrapperImpl.exists(StorageInterfaceImpl.java:213) at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.connectUsingAnonymousCredentials(AzureNativeFileSystemStore.java:734) ... 19 more Caused by: java.net.NoRouteToHostException: Can't assign requested address at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:579) at java.net.Socket.connect(Socket.java:528) at sun.net.NetworkClient.doConnect(NetworkClient.java:180) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.<init>(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:996) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:932) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:850) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1300) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:468) at com.microsoft.azure.storage.core.ExecutionEngine.executeWithRetry(ExecutionEngine.java:126) ... 23 more 2015-08-04 12:17:57,329 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Skipping cleaning up the staging dir. assuming AM will be retried.
          Hide
          cnauroth Chris Nauroth added a comment -

          The attached patch changes DelegateToFileSystem to translate the 0 returned from FileSystem#getDefaultPort to the -1 expected by AbstractFileSystem#getUri. I verified that the tests written for HADOOP-11618 still pass. I also added a new test to confirm that using wasb as the default file system uses a correct URL (without port :0) when accessed through FileContext. I also have done manual testing to confirm that I can run MapReduce jobs with wasb as the default file system after this change.

          Show
          cnauroth Chris Nauroth added a comment - The attached patch changes DelegateToFileSystem to translate the 0 returned from FileSystem#getDefaultPort to the -1 expected by AbstractFileSystem#getUri . I verified that the tests written for HADOOP-11618 still pass. I also added a new test to confirm that using wasb as the default file system uses a correct URL (without port :0) when accessed through FileContext . I also have done manual testing to confirm that I can run MapReduce jobs with wasb as the default file system after this change.
          Hide
          jingzhao Jing Zhao added a comment -

          +1. Thanks for the fix, Chris.

          Show
          jingzhao Jing Zhao added a comment - +1. Thanks for the fix, Chris.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 18m 5s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 2 new or modified test files.
          +1 javac 7m 57s There were no new javac warning messages.
          +1 javadoc 10m 7s There were no new javadoc warning messages.
          +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
          +1 checkstyle 1m 30s There were no new checkstyle issues.
          -1 whitespace 0m 1s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix.
          +1 install 1m 21s mvn install still works.
          +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse.
          +1 findbugs 2m 40s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 common tests 23m 0s Tests passed in hadoop-common.
          +1 tools/hadoop tests 1m 14s Tests passed in hadoop-azure.
              66m 55s  



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12748910/HADOOP-12304.001.patch
          Optional Tests javadoc javac unit findbugs checkstyle
          git revision trunk / f271d37
          whitespace https://builds.apache.org/job/PreCommit-HADOOP-Build/7416/artifact/patchprocess/whitespace.txt
          hadoop-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7416/artifact/patchprocess/testrun_hadoop-common.txt
          hadoop-azure test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7416/artifact/patchprocess/testrun_hadoop-azure.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7416/testReport/
          Java 1.7.0_55
          uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7416/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 18m 5s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 2 new or modified test files. +1 javac 7m 57s There were no new javac warning messages. +1 javadoc 10m 7s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 1m 30s There were no new checkstyle issues. -1 whitespace 0m 1s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix. +1 install 1m 21s mvn install still works. +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse. +1 findbugs 2m 40s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 common tests 23m 0s Tests passed in hadoop-common. +1 tools/hadoop tests 1m 14s Tests passed in hadoop-azure.     66m 55s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12748910/HADOOP-12304.001.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / f271d37 whitespace https://builds.apache.org/job/PreCommit-HADOOP-Build/7416/artifact/patchprocess/whitespace.txt hadoop-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7416/artifact/patchprocess/testrun_hadoop-common.txt hadoop-azure test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7416/artifact/patchprocess/testrun_hadoop-azure.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7416/testReport/ Java 1.7.0_55 uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7416/console This message was automatically generated.
          Hide
          cnauroth Chris Nauroth added a comment -

          The Jenkins -1 was just for whitespace, which I can fix on check-in. I'll commit this soon.

          Show
          cnauroth Chris Nauroth added a comment - The Jenkins -1 was just for whitespace, which I can fix on check-in. I'll commit this soon.
          Hide
          cnauroth Chris Nauroth added a comment -

          I have committed this to trunk, branch-2 and branch-2.7. Thank you to Jing for the code review.

          Show
          cnauroth Chris Nauroth added a comment - I have committed this to trunk, branch-2 and branch-2.7. Thank you to Jing for the code review.
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #8267 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8267/)
          HADOOP-12304. Applications using FileContext fail with the default file system configured to be wasb/s3/etc. Contributed by Chris Nauroth. (cnauroth: rev 3da0bedaec38714a62c3b7244e84bc4f981ddf45)

          • hadoop-tools/hadoop-azure/src/test/resources/azure-test.xml
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azure/TestWasbUriAndConfiguration.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/DelegateToFileSystem.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #8267 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8267/ ) HADOOP-12304 . Applications using FileContext fail with the default file system configured to be wasb/s3/etc. Contributed by Chris Nauroth. (cnauroth: rev 3da0bedaec38714a62c3b7244e84bc4f981ddf45) hadoop-tools/hadoop-azure/src/test/resources/azure-test.xml hadoop-common-project/hadoop-common/CHANGES.txt hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azure/TestWasbUriAndConfiguration.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/DelegateToFileSystem.java
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Yarn-trunk #1009 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1009/)
          HADOOP-12304. Applications using FileContext fail with the default file system configured to be wasb/s3/etc. Contributed by Chris Nauroth. (cnauroth: rev 3da0bedaec38714a62c3b7244e84bc4f981ddf45)

          • hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azure/TestWasbUriAndConfiguration.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/DelegateToFileSystem.java
          • hadoop-tools/hadoop-azure/src/test/resources/azure-test.xml
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk #1009 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1009/ ) HADOOP-12304 . Applications using FileContext fail with the default file system configured to be wasb/s3/etc. Contributed by Chris Nauroth. (cnauroth: rev 3da0bedaec38714a62c3b7244e84bc4f981ddf45) hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azure/TestWasbUriAndConfiguration.java hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/DelegateToFileSystem.java hadoop-tools/hadoop-azure/src/test/resources/azure-test.xml
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #279 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/279/)
          HADOOP-12304. Applications using FileContext fail with the default file system configured to be wasb/s3/etc. Contributed by Chris Nauroth. (cnauroth: rev 3da0bedaec38714a62c3b7244e84bc4f981ddf45)

          • hadoop-tools/hadoop-azure/src/test/resources/azure-test.xml
          • hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azure/TestWasbUriAndConfiguration.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/DelegateToFileSystem.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #279 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/279/ ) HADOOP-12304 . Applications using FileContext fail with the default file system configured to be wasb/s3/etc. Contributed by Chris Nauroth. (cnauroth: rev 3da0bedaec38714a62c3b7244e84bc4f981ddf45) hadoop-tools/hadoop-azure/src/test/resources/azure-test.xml hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azure/TestWasbUriAndConfiguration.java hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/DelegateToFileSystem.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2206 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2206/)
          HADOOP-12304. Applications using FileContext fail with the default file system configured to be wasb/s3/etc. Contributed by Chris Nauroth. (cnauroth: rev 3da0bedaec38714a62c3b7244e84bc4f981ddf45)

          • hadoop-tools/hadoop-azure/src/test/resources/azure-test.xml
          • hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azure/TestWasbUriAndConfiguration.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/DelegateToFileSystem.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2206 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2206/ ) HADOOP-12304 . Applications using FileContext fail with the default file system configured to be wasb/s3/etc. Contributed by Chris Nauroth. (cnauroth: rev 3da0bedaec38714a62c3b7244e84bc4f981ddf45) hadoop-tools/hadoop-azure/src/test/resources/azure-test.xml hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azure/TestWasbUriAndConfiguration.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/DelegateToFileSystem.java hadoop-common-project/hadoop-common/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #268 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/268/)
          HADOOP-12304. Applications using FileContext fail with the default file system configured to be wasb/s3/etc. Contributed by Chris Nauroth. (cnauroth: rev 3da0bedaec38714a62c3b7244e84bc4f981ddf45)

          • hadoop-tools/hadoop-azure/src/test/resources/azure-test.xml
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azure/TestWasbUriAndConfiguration.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/DelegateToFileSystem.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #268 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/268/ ) HADOOP-12304 . Applications using FileContext fail with the default file system configured to be wasb/s3/etc. Contributed by Chris Nauroth. (cnauroth: rev 3da0bedaec38714a62c3b7244e84bc4f981ddf45) hadoop-tools/hadoop-azure/src/test/resources/azure-test.xml hadoop-common-project/hadoop-common/CHANGES.txt hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azure/TestWasbUriAndConfiguration.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/DelegateToFileSystem.java
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #276 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/276/)
          HADOOP-12304. Applications using FileContext fail with the default file system configured to be wasb/s3/etc. Contributed by Chris Nauroth. (cnauroth: rev 3da0bedaec38714a62c3b7244e84bc4f981ddf45)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-tools/hadoop-azure/src/test/resources/azure-test.xml
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/DelegateToFileSystem.java
          • hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azure/TestWasbUriAndConfiguration.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #276 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/276/ ) HADOOP-12304 . Applications using FileContext fail with the default file system configured to be wasb/s3/etc. Contributed by Chris Nauroth. (cnauroth: rev 3da0bedaec38714a62c3b7244e84bc4f981ddf45) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-tools/hadoop-azure/src/test/resources/azure-test.xml hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/DelegateToFileSystem.java hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azure/TestWasbUriAndConfiguration.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #2225 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2225/)
          HADOOP-12304. Applications using FileContext fail with the default file system configured to be wasb/s3/etc. Contributed by Chris Nauroth. (cnauroth: rev 3da0bedaec38714a62c3b7244e84bc4f981ddf45)

          • hadoop-tools/hadoop-azure/src/test/resources/azure-test.xml
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/DelegateToFileSystem.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azure/TestWasbUriAndConfiguration.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2225 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2225/ ) HADOOP-12304 . Applications using FileContext fail with the default file system configured to be wasb/s3/etc. Contributed by Chris Nauroth. (cnauroth: rev 3da0bedaec38714a62c3b7244e84bc4f981ddf45) hadoop-tools/hadoop-azure/src/test/resources/azure-test.xml hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/DelegateToFileSystem.java hadoop-common-project/hadoop-common/CHANGES.txt hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azure/TestWasbUriAndConfiguration.java

            People

            • Assignee:
              cnauroth Chris Nauroth
              Reporter:
              cnauroth Chris Nauroth
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development