[AVRO-2179] Malformed data, the BinaryDecoder allocates large arrays

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.8.2
• Fix Version/s: 1.9.0
• Component/s: java
• Assignee: Daniel Kulp
• Reporter: Jonny
• Created: 17/May/18 12:34
• Updated: 22/Feb/21 22:11
• Resolved: 08/Nov/18 19:17

Description

Recentlly I use avro find it has this problem:The memory suddenly explode and trigger the fullgc, So I dump the memory file. And then I use jvisualvm tool to analysis I found a org.apache.avro.util.Utf8 object and the bytes array length was over 1610470037.

The method of readInt() shouldn't over limit, So I think it should be restricted.

Issue Links

• is related to: AVRO-3049 Java: BinaryDecoder lacks checks on bytes array length
• links to: GitHub Pull Request #311