[HBASE-6532] With HFile v2, the region server will perform an extra copy of source files. - ASF JIRA

XML

Word

Printable

JSON

Type: Bug
Status: Closed
Priority: Major
Resolution: Duplicate
Affects Version/s: 0.94.0, 0.95.2
Fix Version/s: None
Component/s: Performance, regionserver
Labels:
None
Environment:

Hide

With HFile v2 implementation in HBase 0.94 & 0.96, the region server will use HFileSystem as its fs. When it performs bulk load in Store.bulkLoadHFile(), it checks if its fs is the same as srcFs, which however will be DistributedFileSystem. Consequently, it will always perform an extra copy of source files.

Show
With HFile v2 implementation in HBase 0.94 & 0.96, the region server will use HFileSystem as its fs. When it performs bulk load in Store.bulkLoadHFile(), it checks if its fs is the same as srcFs, which however will be DistributedFileSystem. Consequently, it will always perform an extra copy of source files.