Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-6857

FsShell should report raw disk usage including replication factor

          Details

          • Type: Improvement
          • Status: Closed
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: None
          • Fix Version/s: 3.0.0-alpha1
          • Component/s: fs
          • Labels:
            None
          • Target Version/s:
          • Hadoop Flags:
            Incompatible change, Reviewed
          • Release Note:
            The output format of hadoop fs -du has been changed. It shows not only the file size but also the raw disk usage including the replication factor.

            Description

            Currently FsShell report HDFS usage with "hadoop fs -dus <path>" command. Since replication level is per file level, it would be nice to add raw disk usage including the replication factor (maybe "hadoop fs -dus -raw <path>"?). This will allow to assess resource usage more accurately. – Alex K

              Attachments

              1. show-space-consumed.txt
                4 kB
                Aaron T. Myers
              2. HADOOP-6857.patch
                3 kB
                Byron Wong
              3. HADOOP-6857.patch
                11 kB
                Byron Wong
              4. HADOOP-6857.patch
                40 kB
                Byron Wong
              5. revert-HADOOP-6857-from-branch-2.patch
                42 kB
                Akira Ajisaka
              6. HADOOP-6857-revert.patch
                35 kB
                Byron Wong

                Issue Links

                duplicates

                Improvement - An improvement or enhancement to an existing feature or task. HADOOP-8497 Shell needs a way to list amount of physical consumed space in a directory

                • Major - Major loss of function.
                • Resolved
                relates to

                Bug - A problem which impairs or prevents the functions of the product. MESOS-4283 Accept 3-field version of HDFS du output

                • Major - Major loss of function.
                • Resolved

                Bug - A problem which impairs or prevents the functions of the product. HADOOP-11666 Revert the format change of du output introduced by HADOOP-6857

                • Major - Major loss of function.
                • Closed

                  Activity

                    People

                    • Assignee:
                      Byron Wong Byron Wong
                      Reporter:
                      alexvk Alex Kozlov
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      12 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: