[HADOOP-17736] Über-JIRA: abfs phase III: Hadoop 3.3.2 features & fixes

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Done
• Affects Version/s: 3.3.1
• Fix Version/s: 3.3.2
• Component/s: fs/azure
• Target Version/s: 3.4.0
• Assignee: Sneha Vijayarajan
• Reporter: Steve Loughran
• Created: 27/May/21 13:16
• Updated: 07/Jan/22 14:25
• Resolved: 07/Jan/22 14:25

Description

Wrap up JIRA for Hadoop 3.4/3.3.2 changes - successor to HADOOP-15763

Issue Links

• supercedes: HADOOP-15763 Über-JIRA: abfs phase II: Hadoop 3.3 features & fixes

Sub-Tasks

• ABFS: Test failure ITestAbfsNetworkStatistics#testAbfsHttpResponseStatistics: Resolved
• ABFS: Random read perf improvement: Resolved
• ABFS: Append blob tests with non HNS accounts fail: Resolved
• Intermittent OutOfMemory error while performing hdfs CopyFromLocal to abfs: Resolved
• Clear abfs readahead requests on stream close: Resolved
• ABFS: testBlobBackCompatibility, testRandomRead & WasbAbfsCompatibility tests fail when triggered with default configs: Resolved
• ABFS: Change default Readahead Queue Depth from num(processors) to const: Resolved
• Distcp contract test is really slow with ABFS and S3A; timing out: Resolved
• ABFS: Add Identifiers to Client Request Header: Resolved
• ABFS: Partially obfuscate SAS object IDs in Logs: Resolved
• abfs test failure ITestSmallWriteOptimization.testSmallWriteOptimization: Resolved
• ABFS: Fix compiler deprecation warning in TextFileBasedIdentityHandler: Resolved