Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10782

Decrease memory frequent exchange of Centralized Cache Management when run balancer

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.7.1
    • Fix Version/s: None
    • Component/s: balancer & mover, caching
    • Labels:

      Description

      CachedBlocks currently are transparent for Balancer when active feature of centralized cache management. This makes DataNode exchange memory frequently, because Balancer does not Distinguish CachedBlock from blocks, so it may trigger mount of cached/uncached ops.

      I think namenode should avoid return CacheBlocks as much as possible when Balanacer#getblocks.

        Attachments

        1. HDFS-10782-branch-2.001.patch
          3 kB
          Xiaoqiao He

          Activity

            People

            • Assignee:
              hexiaoqiao Xiaoqiao He
              Reporter:
              hexiaoqiao Xiaoqiao He
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated: