[HBASE-7806] Isolate the FileSystem calls - ASF JIRA

XML

Word

Printable

JSON

Motivations:

No way to change the fs layout without touching all the code (and breaking stuff)
Each test create is own mocked fs layout: mkdir(region), mkdir(new Path(region, family))
new Path(table, region, family, hfile) is everywhere
DIR_NAME constants are not in a single place
lots of code does a the same for (region.listStatus()) for (family.listStatus()) ...

Goals:

Central point for all the fs operations
- Make easier the file creation
- Make easier the store files retrival (with proper reference, link handling)
Removing all the new Path() from the code
Removing all the fs.listStatus() from the code
Cleanup the tests to use the new classes of creating mocks object
Reduce the code (in theory there should be less line than before once this refactor is complete)

Since the fs operations are all over the code, the refactor must be gradual, and step by step limiting the internal fs layout visibility.

is related to

HBASE-14090 Redo FS layout; let go of tables/regions/stores directory hierarchy in DFS

HBASE-14887 Use Orientated Abstractions

1.	Introduce HRegionFileSystem and move region fs related code	Closed	Matteo Bertozzi
2.	Refactor Store to use HRegionFileSystem	Closed	Matteo Bertozzi
3.	Refactor Split/Merge to use HRegionFileSystem	Closed	Matteo Bertozzi
4.	Refactor MasterFileSystem to be inline with HRegionFileSystem philosophy	Closed	Unassigned
5.	Cleanup code to use HRegionFileSystem, remove getDir and fs operations	Closed	Unassigned
6.	Improve file descriptor usage: currently, there are two file descriptors per storefile	Closed	Sergey Shelukhin
7.	use FSUtils to get/set hbase.rootdir	Closed	Matteo Bertozzi
8.	Support for Namenode HA for non-idempotent operations	Closed	Himanshu Vashishtha
9.	Removed unused fs code	Closed	Matteo Bertozzi
10.	Isolate Wal related stuff from MasterFileSystem	Closed	Matteo Bertozzi