[HADOOP-14598] Blacklist Http/HttpsFileSystem in FsUrlStreamHandlerFactory

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.9.0, 3.0.0-alpha4
• Fix Version/s: 2.9.0, 3.0.0-beta1
• Component/s: fs/azure, test
• Target Version/s: 2.9.0, 3.0.0-beta1
• Hadoop Flags: Reviewed
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 27/Jun/17 19:05
• Updated: 01/Nov/19 19:14
• Resolved: 08/Aug/17 23:36

Description

my downstream-of-spark cloud integration tests (where I haven't been running the azure ones for a while) now have a few of the tests failing

 org.apache.hadoop.fs.azure.AzureException: com.microsoft.azure.storage.StorageException: org.apache.hadoop.fs.FsUrlConnection cannot be cast to java.net.HttpURLConnection

No obvious cause, and it's only apparently happening in some of the (scalatest) tests.

Issue Links

• is broken by: HADOOP-14383 Implement FileSystem that reads from HTTP / HTTPS endpoints
• is depended upon by: HADOOP-14552 Über-jira: WASB client phase II: performance and testing
• is related to: SPARK-12868 ADD JAR via sparkSQL JDBC will fail when using a HDFS URL
• is related to: SPARK-25694 URL.setURLStreamHandlerFactory causing incompatible HttpURLConnection issue