[HDFS-6151] HDFS should refuse to cache blocks >=2GB

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.4.0
• Component/s: caching, datanode
• Assignee: Andrew Wang
• Reporter: Andrew Wang
• Created: 24/Mar/14 20:46
• Updated: 06/Jan/17 22:06

Description

If you try to cache a block that's >=2GB, the DN will silently fail to cache it since MappedByteBuffer uses a signed int to represent size. Blocks this large are rare, but we should log or alert the user somehow.