Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-1332

When unable to place replicas, BlockPlacementPolicy should log reasons nodes were excluded

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.23.0
    • Component/s: namenode
    • Labels:
    • Hadoop Flags:
      Reviewed

      Description

      Whenever the block placement policy determines that a node is not a "good target" it could add the reason for exclusion to a list, and then when we log "Not able to place enough replicas" we could say why each node was refused. This would help new users who are having issues on pseudo-distributed (eg because their data dir is on /tmp and /tmp is full). Right now it's very difficult to figure out the issue.

        Issue Links

          Activity

          Todd Lipcon created issue -
          Todd Lipcon made changes -
          Field Original Value New Value
          Labels newbie
          Ted Yu made changes -
          Assignee Ted Yu [ yuzhihong@gmail.com ]
          Ted Yu made changes -
          Attachment HDFS-1332.patch [ 12478872 ]
          Ted Yu made changes -
          Attachment HDFS-1332.patch [ 12478872 ]
          Ted Yu made changes -
          Attachment HDFS-1332.patch [ 12478894 ]
          Ted Yu made changes -
          Attachment HDFS-1332.patch [ 12478894 ]
          Ted Yu made changes -
          Attachment HDFS-1332.patch [ 12478909 ]
          Ted Yu made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Fix Version/s 0.23.0 [ 12315571 ]
          Ted Yu made changes -
          Attachment HDFS-1332.patch [ 12478909 ]
          Ted Yu made changes -
          Attachment HDFS-1332.patch [ 12478925 ]
          Ted Yu made changes -
          Attachment HDFS-1332.patch [ 12478925 ]
          Ted Yu made changes -
          Attachment HDFS-1332.patch [ 12478995 ]
          Ted Yu made changes -
          Attachment HDFS-1332.patch [ 12478995 ]
          Ted Yu made changes -
          Attachment HDFS-1332.patch [ 12479188 ]
          Ted Yu made changes -
          Attachment HDFS-1332.patch [ 12479188 ]
          Ted Yu made changes -
          Attachment HDFS-1332.patch [ 12479192 ]
          Ted Yu made changes -
          Attachment HDFS-1332-concise.patch [ 12479209 ]
          Ted Yu made changes -
          Attachment HDFS-1332-concise.patch [ 12479209 ]
          Ted Yu made changes -
          Attachment HDFS-1332-concise.patch [ 12479214 ]
          Ted Yu made changes -
          Attachment HDFS-1332-concise.patch [ 12479214 ]
          Ted Yu made changes -
          Attachment HDFS-1332-concise.patch [ 12479363 ]
          Ted Yu made changes -
          Attachment HDFS-1332.patch [ 12479192 ]
          Ted Yu made changes -
          Attachment HDFS-1332-concise.patch [ 12479363 ]
          Ted Yu made changes -
          Attachment HDFS-1332-concise.patch [ 12479403 ]
          Ted Yu made changes -
          Attachment HDFS-1332-concise.patch [ 12479403 ]
          Ted Yu made changes -
          Attachment HDFS-1332-concise.patch [ 12479425 ]
          Ted Yu made changes -
          Attachment HDFS-1332-concise.patch [ 12479425 ]
          Ted Yu made changes -
          Attachment HDFS-1332-concise.patch [ 12479524 ]
          Ted Yu made changes -
          Attachment HDFS-1332-concise.patch [ 12479524 ]
          Ted Yu made changes -
          Attachment HDFS-1332-concise.patch [ 12479534 ]
          Tsz Wo Nicholas Sze made changes -
          Hadoop Flags [Reviewed]
          Tsz Wo Nicholas Sze made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue breaks HDFS-2245 [ HDFS-2245 ]

            People

            • Assignee:
              Ted Yu
              Reporter:
              Todd Lipcon
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development