Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10782

Decrease memory frequent exchange of Centralized Cache Management when run balancer

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 2.7.1
    • None
    • balancer & mover, caching

    Description

      CachedBlocks currently are transparent for Balancer when active feature of centralized cache management. This makes DataNode exchange memory frequently, because Balancer does not Distinguish CachedBlock from blocks, so it may trigger mount of cached/uncached ops.

      I think namenode should avoid return CacheBlocks as much as possible when Balanacer#getblocks.

      Attachments

        1. HDFS-10782-branch-2.001.patch
          3 kB
          Xiaoqiao He

        Activity

          People

            hexiaoqiao Xiaoqiao He
            hexiaoqiao Xiaoqiao He
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated: