Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-23746

[Flakey Tests] Caused by: org.apache.hadoop.hbase.util.CommonFSUtils$StreamLacksCapabilityException: hflush and hsync

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Test
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0-alpha-1, 2.3.0
    • None
    • None

    Description

      Tests that use the new RegionProcedureStoreTestBase utility fail in branch-2 nightlies complaining...

      Error Message
      
      cannot get log writer
      
      Stacktrace
      
      java.io.IOException: cannot get log writer
      Caused by: org.apache.hadoop.hbase.util.CommonFSUtils$StreamLacksCapabilityException: hflush and hsync
      
      

      They are using local fs which doesn't have support for above. Only shows when you run the tests with hadoop3 profile. Let me do for these tests what was done over in HBASE-19289

      It has been going on for a while now, probably since the move to region procedure store (the old wal procedure store had turned off the checks for sync/hflush).

      health checks / yetus jdk8 hadoop3 checks / org.apache.hadoop.hbase.procedure2.store.region.TestHFileProcedurePrettyPrinter.test
      health checks / yetus jdk8 hadoop3 checks / org.apache.hadoop.hbase.procedure2.store.region.TestRegionProcedureStore.testLoad
      health checks / yetus jdk8 hadoop3 checks / org.apache.hadoop.hbase.procedure2.store.region.TestRegionProcedureStore.testCleanup
      health checks / yetus jdk8 hadoop3 checks / org.apache.hadoop.hbase.procedure2.store.region.TestRegionProcedureStoreCompaction.test
      health checks / yetus jdk8 hadoop3 checks / org.apache.hadoop.hbase.procedure2.store.region.TestRegionProcedureStoreMigration.testMigrateWithUnsupportedProcedures
      health checks / yetus jdk8 hadoop3 checks / org.apache.hadoop.hbase.procedure2.store.region.TestRegionProcedureStoreMigration.test
      health checks / yetus jdk8 hadoop3 checks / org.apache.hadoop.hbase.procedure2.store.region.TestRegionProcedureStoreWALCleaner.test
      health checks / yetus jdk8 hadoop3 checks / org.apache.hadoop.hbase.procedure2.store.region.TestWALProcedurePrettyPrinter.test
      

      Attachments

        1. 23746.patch
          5 kB
          Michael Stack

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            stack Michael Stack
            stack Michael Stack
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment