MOB file compaction and flush still relies on renames even when SFT is enabled.
My proposed changes are:
- when requireWritingToTmpDirFirst is false during mob flush/compact instead of using the temp writer we should create a different writer using a StoreFileWriterCreationTracker that writes directly to the mob store folder
- these StoreFileWriterCreationTracker should be stored in the MobStore. This would requires us to extend MobStore with a createWriter and a finalizeWriter method to handle this
- refactor MobFileCleanerChore to run on the RS instead on Master to allow access to the StoreFileWriterCreationTrackers to make sure the currently written files are not cleaned up