Details

    Description

      There are 6 test classes have been failing on Yetus for several months.
      They contributed to more than 41 failing tests which makes reviewing Yetus reports every a pain in the neck. Another point is to save the resources and avoiding utilization of ports, memory, and CPU.

      Over the last month, there was some effort to bring the Yetus back to a stable state. However, there is no progress in addressing Azure failures.
      Generally, I do not like to disable failing tests, but for this specific case, I do not assume that it makes any sense to have 41 failing tests from one module for several months. Whenever someone finds that those tests are useful, then they can re-enable the tests on Yetus After the test is fixed.

      Following a PR, I have to review that my patch does not cause any failures (include changing error messages in existing tests). A thorough review takes a considerable amount of time browsing the nightly builds and Github reports.
      So, please consider how much time is being spent to review those stack trace over the last months.
      Finally, this is one of the reasons developers tend to ignore the reports, because it would take too much time to review; and by default, the errors are considered irrelevant.

      CC: aajisaka, elgoiri, weichiu, ayushtkn

            hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked 
             hadoop.fs.azure.TestNativeAzureFileSystemMocked 
             hadoop.fs.azure.TestBlobMetadata 
             hadoop.fs.azure.TestNativeAzureFileSystemConcurrency 
             hadoop.fs.azure.TestNativeAzureFileSystemFileNameCheck 
             hadoop.fs.azure.TestNativeAzureFileSystemContractMocked 
             hadoop.fs.azure.TestWasbFsck 
             hadoop.fs.azure.TestOutOfBandAzureBlobOperations 
      
      org.apache.hadoop.fs.azure.TestBlobMetadata.testFolderMetadata
      org.apache.hadoop.fs.azure.TestBlobMetadata.testFirstContainerVersionMetadata
      org.apache.hadoop.fs.azure.TestBlobMetadata.testPermissionMetadata
      org.apache.hadoop.fs.azure.TestBlobMetadata.testOldPermissionMetadata
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemConcurrency.testNoTempBlobsVisible
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemConcurrency.testLinkBlobs
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemContractMocked.testListStatusRootDir
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemContractMocked.testRenameDirectoryMoveToExistingDirectory
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemContractMocked.testListStatus
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemContractMocked.testRenameDirectoryAsExistingDirectory
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemContractMocked.testRenameToDirWithSamePrefixAllowed
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemContractMocked.testLSRootDir
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemContractMocked.testDeleteRecursively
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemFileNameCheck.testWasbFsck
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testChineseCharactersFolderRename
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testRedoRenameFolderInFolderListingWithZeroByteRenameMetadata
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testRedoRenameFolderInFolderListing
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testUriEncoding
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testDeepFileCreation
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testListDirectory
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testRedoRenameFolderRenameInProgress
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testRenameFolder
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testRenameImplicitFolder
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testRedoRenameFolder
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testStoreDeleteFolder
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testRename
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked.testListStatus
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked.testRenameDirectoryAsEmptyDirectory
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked.testListStatusFilterWithSomeMatches
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked.testRenameDirectoryAsNonExistentDirectory
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked.testGlobStatusSomeMatchesInDirectories
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked.testGlobStatusWithMultipleWildCardMatches
      org.apache.hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked.testDeleteRecursively
      org.apache.hadoop.fs.azure.TestOutOfBandAzureBlobOperations.testImplicitFolderDeleted
      org.apache.hadoop.fs.azure.TestOutOfBandAzureBlobOperations.testFileAndImplicitFolderSameName
      org.apache.hadoop.fs.azure.TestOutOfBandAzureBlobOperations.testSetOwnerOnImplicitFolder
      org.apache.hadoop.fs.azure.TestOutOfBandAzureBlobOperations.testFileInImplicitFolderDeleted
      org.apache.hadoop.fs.azure.TestOutOfBandAzureBlobOperations.testImplicitFolderListed
      org.apache.hadoop.fs.azure.TestOutOfBandAzureBlobOperations.testCreatingDeepFileCreatesExplicitFolder
      org.apache.hadoop.fs.azure.TestOutOfBandAzureBlobOperations.testSetPermissionOnImplicitFolder
      org.apache.hadoop.fs.azure.TestWasbFsck.testDelete
      

      Attachments

        Issue Links

          Activity

            People

              ahussein Ahmed Hussein
              ahussein Ahmed Hussein
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m