[HDFS-10782] Decrease memory frequent exchange of Centralized Cache Management when run balancer - ASF JIRA

Add vote

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Patch Available
Priority: Major
Resolution: Unresolved
Affects Version/s: 2.7.1
Fix Version/s: None
Component/s: balancer & mover, caching
Labels:
- patch

Description

CachedBlocks currently are transparent for Balancer when active feature of centralized cache management. This makes DataNode exchange memory frequently, because Balancer does not Distinguish CachedBlock from blocks, so it may trigger mount of cached/uncached ops.

I think namenode should avoid return CacheBlocks as much as possible when Balanacer#getblocks.