[HADOOP-18569] NFS Gateway may release buffer too early

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 3.4.0, 3.3.5, 3.2.5, 3.3.9
• Fix Version/s: 3.4.0, 3.3.5, 3.2.5, 3.3.9
• Component/s: nfs
• Labels: pull-request-available
• Target Version/s: 3.4.0, 3.3.5, 3.2.5, 3.3.9
• Hadoop Flags: Reviewed
• Assignee: Attila Doroszlai
• Reporter: Attila Doroszlai
• Created: 12/Dec/22 09:53
• Updated: 27/Jan/24 08:54
• Resolved: 14/Dec/22 15:00

Description

After upgrading Netty from 4.1.68 to 4.1.77 (HADOOP-18079), NFS Gateway started crashing when writing data (can be easily reproduced by a few 10MB+ files). The problem was triggered by reduced default chunk size in PooledByteBufAllocator (in 4.1.75), but it turned out to be caused by a buffer released too early in NFS Gateway.

Issue Links

• is related to: HADOOP-11245 Update NFS gateway to use Netty4
• is related to: HADOOP-18079 Upgrade Netty to 4.1.77.Final
• links to: GitHub Pull Request #5207
• links to: GitHub Pull Request #5210
• links to: GitHub Pull Request #5211
• links to: GitHub Pull Request #5212