[HDFS-10778] Add -format option to make the output of FileDistribution processor human-readable in OfflineImageViewer

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.7.1
• Fix Version/s: 2.9.0, 3.0.0-alpha2
• Component/s: tools
• Hadoop Flags: Reviewed
• Assignee: Yiqun Lin
• Reporter: Yiqun Lin
• Created: 19/Aug/16 03:30
• Updated: 08/Sep/16 16:36
• Resolved: 08/Sep/16 06:19

Description

Now It's not directly to understand the output result of the FileDistribution processor that in hdfs oiv command for users. For example, this is a original output:

Size    NumFiles
0       22556
1048576 404971
2097152 29259
3145728 16937
4194304 9197
5242880 6889
6291456 4930
7340032 4070
8388608 299384
9437184 274623

Two aspects make that hard to understand for users.

First, the size column just showed as the number in byte, it's not readable here. The better way is showed with a binary prefix.
Second, the size column would be better to showed as a size range. It will let users know the value in NumFiles column was counted from A size to B size.

The expected output result should be this:

Size Range   NumFiles
(0 B, 0 B]  1666332
(0 B, 1 M]        778473
(1 M, 2 M]      35125
(2 M, 3 M]      13978
(3 M, 4 M]      10158
(4 M, 5 M]      6970

Issue Links

• is related to: HDFS-10847 Complete the document for FileDistribution processor in OfflineImageViewer
• relates to: HDFS-10783 The option '-maxSize' and '-step' fail in OfflineImageViewer