Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10778

Add -format option to make the output of FileDistribution processor human-readable in OfflineImageViewer

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.7.1
    • Fix Version/s: 2.9.0, 3.0.0-alpha2
    • Component/s: tools
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Now It's not directly to understand the output result of the FileDistribution processor that in hdfs oiv command for users. For example, this is a original output:

      Size    NumFiles
      0       22556
      1048576 404971
      2097152 29259
      3145728 16937
      4194304 9197
      5242880 6889
      6291456 4930
      7340032 4070
      8388608 299384
      9437184 274623
      

      Two aspects make that hard to understand for users.

      First, the size column just showed as the number in byte, it's not readable here. The better way is showed with a binary prefix.
      Second, the size column would be better to showed as a size range. It will let users know the value in NumFiles column was counted from A size to B size.

      The expected output result should be this:

      Size Range   NumFiles
      (0 B, 0 B]  1666332
      (0 B, 1 M]        778473
      (1 M, 2 M]      35125
      (2 M, 3 M]      13978
      (3 M, 4 M]      10158
      (4 M, 5 M]      6970
      

        Attachments

        1. HDFS-10778.001.patch
          3 kB
          Yiqun Lin
        2. HDFS-10778.002.patch
          17 kB
          Yiqun Lin
        3. HDFS-10778.003.patch
          17 kB
          Yiqun Lin
        4. HDFS-10778.004.patch
          23 kB
          Yiqun Lin
        5. HDFS-10778.005.patch
          23 kB
          Yiqun Lin
        6. HDFS-10778.006.patch
          23 kB
          Yiqun Lin

          Issue Links

            Activity

              People

              • Assignee:
                linyiqun Yiqun Lin
                Reporter:
                linyiqun Yiqun Lin
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: