[HDFS-5463] NameNode should limit the number of blocks per file

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Assignee: Vinayakumar B
• Reporter: Vinayakumar B
• Created: 05/Nov/13 13:11
• Updated: 05/Nov/13 18:44
• Resolved: 05/Nov/13 18:44

Description

Currently there is no limit to number of blocks user can write to a file.

And blocksize also can be set to minimum possible.

User can write any number of blocks continously, which may create problems in NameNodes performance and service as the number of blocks of file increases.
Because each time new block allocated, all blocks of the file will be persisted, and this can cause serious performance degradation

So proposal is to limit the number of maximum blocks a user can write to a file.

May be 1024 blocks(if 128*MB is block size then 128 GB can be max file size)

Issue Links

• duplicates: HDFS-4305 Add a configurable limit on number of blocks per file, and min block size