[HDFS-15680] Disable Broken Azure Junits

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 3.3.1
• Fix Version/s: 3.3.1
• Component/s: fs/azure
• Labels: pull-request-available
• Target Version/s: 3.2.2, 3.3.1, 3.4.0, 3.2.3
• Assignee: Ahmed Hussein
• Reporter: Ahmed Hussein
• Created: 10/Nov/20 22:57
• Updated: 27/Jan/24 02:58
• Resolved: 26/Nov/20 21:09

Description

There are 6 test classes have been failing on Yetus for several months.
They contributed to more than 41 failing tests which makes reviewing Yetus reports every a pain in the neck. Another point is to save the resources and avoiding utilization of ports, memory, and CPU.

Over the last month, there was some effort to bring the Yetus back to a stable state. However, there is no progress in addressing Azure failures.
Generally, I do not like to disable failing tests, but for this specific case, I do not assume that it makes any sense to have 41 failing tests from one module for several months. Whenever someone finds that those tests are useful, then they can re-enable the tests on Yetus After the test is fixed.

Following a PR, I have to review that my patch does not cause any failures (include changing error messages in existing tests). A thorough review takes a considerable amount of time browsing the nightly builds and Github reports.
So, please consider how much time is being spent to review those stack trace over the last months.
Finally, this is one of the reasons developers tend to ignore the reports, because it would take too much time to review; and by default, the errors are considered irrelevant.

CC: aajisaka, elgoiri, weichiu, ayushtkn

      hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked 
       hadoop.fs.azure.TestNativeAzureFileSystemMocked 
       hadoop.fs.azure.TestBlobMetadata 
       hadoop.fs.azure.TestNativeAzureFileSystemConcurrency 
       hadoop.fs.azure.TestNativeAzureFileSystemFileNameCheck 
       hadoop.fs.azure.TestNativeAzureFileSystemContractMocked 
       hadoop.fs.azure.TestWasbFsck 
       hadoop.fs.azure.TestOutOfBandAzureBlobOperations 

org.apache.hadoop.fs.azure.TestBlobMetadata.testFolderMetadata
org.apache.hadoop.fs.azure.TestBlobMetadata.testFirstContainerVersionMetadata
org.apache.hadoop.fs.azure.TestBlobMetadata.testPermissionMetadata
org.apache.hadoop.fs.azure.TestBlobMetadata.testOldPermissionMetadata
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemConcurrency.testNoTempBlobsVisible
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemConcurrency.testLinkBlobs
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemContractMocked.testListStatusRootDir
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemContractMocked.testRenameDirectoryMoveToExistingDirectory
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemContractMocked.testListStatus
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemContractMocked.testRenameDirectoryAsExistingDirectory
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemContractMocked.testRenameToDirWithSamePrefixAllowed
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemContractMocked.testLSRootDir
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemContractMocked.testDeleteRecursively
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemFileNameCheck.testWasbFsck
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testChineseCharactersFolderRename
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testRedoRenameFolderInFolderListingWithZeroByteRenameMetadata
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testRedoRenameFolderInFolderListing
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testUriEncoding
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testDeepFileCreation
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testListDirectory
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testRedoRenameFolderRenameInProgress
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testRenameFolder
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testRenameImplicitFolder
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testRedoRenameFolder
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testStoreDeleteFolder
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testRename
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked.testListStatus
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked.testRenameDirectoryAsEmptyDirectory
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked.testListStatusFilterWithSomeMatches
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked.testRenameDirectoryAsNonExistentDirectory
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked.testGlobStatusSomeMatchesInDirectories
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked.testGlobStatusWithMultipleWildCardMatches
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked.testDeleteRecursively
org.apache.hadoop.fs.azure.TestOutOfBandAzureBlobOperations.testImplicitFolderDeleted
org.apache.hadoop.fs.azure.TestOutOfBandAzureBlobOperations.testFileAndImplicitFolderSameName
org.apache.hadoop.fs.azure.TestOutOfBandAzureBlobOperations.testSetOwnerOnImplicitFolder
org.apache.hadoop.fs.azure.TestOutOfBandAzureBlobOperations.testFileInImplicitFolderDeleted
org.apache.hadoop.fs.azure.TestOutOfBandAzureBlobOperations.testImplicitFolderListed
org.apache.hadoop.fs.azure.TestOutOfBandAzureBlobOperations.testCreatingDeepFileCreatesExplicitFolder
org.apache.hadoop.fs.azure.TestOutOfBandAzureBlobOperations.testSetPermissionOnImplicitFolder
org.apache.hadoop.fs.azure.TestWasbFsck.testDelete

Issue Links

• is broken by: HADOOP-17223 update org.apache.httpcomponents:httpclient to 4.5.13 and httpcore to 4.4.13
• relates to: HADOOP-17325 WASB: Test failures
• links to: GitHub Pull Request #2457
• links to: PR 2480