[HDFS-11060] make DEFAULT_MAX_CORRUPT_FILEBLOCKS_RETURNED configurable

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.7.3, 2.8.1, 3.0.0-alpha3
• Fix Version/s: 2.10.0, 3.2.0, 2.9.2, 3.0.4, 3.1.2
• Component/s: hdfs
• Assignee: Lantao Jin
• Reporter: Lantao Jin
• Created: 26/Oct/16 06:56
• Updated: 02/Oct/19 17:14
• Resolved: 25/Jul/18 18:28

Description

Current, the easiest way to determine which blocks is missing is using NN web UI or JMX. Unfortunately, because the DEFAULT_MAX_CORRUPT_FILEBLOCKS_RETURNED=100 is hard code in FSNamesystem, only 100 missing blocks can be return by UI and JMX. Even the result of URL "https://nn:50070/fsck?listcorruptfileblocks=1&path=%2F" is limited by this hard code value too.
I did know FSCK can return more than 100 result but due to the security reason(with kerberos), it is very hard to involve to costumer programs and scripts.

So I think it should add a configurable var "maxCorruptFileBlocksReturned" to fix above case.
If community also think it's worth to do, I will patch this. If not, please feel free to tell me the reason.

Issue Links

• links to: GitHub Pull Request #148