Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11401

Reduce verbosity of logs with favored nodes and block pinning enabled

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Patch Available
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 2.8.0
    • Fix Version/s: None
    • Component/s: balancer & mover, datanode
    • Labels:
      None

      Description

      I am working on enabling favored nodes for HBase (HBASE-15531). Was trying out what happens if favored nodes is used and HDFS balancer is enabled. Ran the unit test TestBalancer#testBalancerWithPinnedBlocks from branch-2.8. There were too many exceptions and error messages with this (output attached) since pinned blocks can't be moved.

      Is there any way to reduce this logging since block pinning is intentional? On a real cluster, this could be too much. HDFS-6133 enabled block pinning.

        Attachments

        1. testBalancerWithPinnedBlocks.output.txt
          515 kB
          Thiruvel Thirumoolan
        2. HDFS-11401.03.patch
          3 kB
          Weiwei Yang
        3. HDFS-11401.02.patch
          3 kB
          Weiwei Yang
        4. HDFS-11401.01.patch
          3 kB
          Weiwei Yang

          Issue Links

            Activity

              People

              • Assignee:
                cheersyang Weiwei Yang
                Reporter:
                thiruvel Thiruvel Thirumoolan
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated: