Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-10434

Is it possible to use "df" to calculate the dfs usage instead of "du"

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Duplicate
    • Affects Version/s: 2.3.0
    • Fix Version/s: None
    • Component/s: fs
    • Labels:

      Description

      When we run datanode from the machine with big disk volume, it's found du operations from org.apache.hadoop.fs.DU's DURefreshThread cost lots of disk performance.

      As we use the whole disk for hdfs storage, it is possible calculate volume usage via "df" command. Is it necessary adding the "df" option for usage calculation in hdfs (org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.BlockPoolSlice)?

        Attachments

        1. HADOOP-10434-1.patch
          5 kB
          MaoYuan Xian

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                kennethxian MaoYuan Xian
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: