[IGNITE-14687] BinaryHeapOutputStream BinaryOffheapOutputStream corrupt memory in case of overflow and cause JVM crash

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.10
• Fix Version/s: 2.11
• Component/s: binary
• Release Note: Fixed potential JVM crash due to integer overflow in binary streams.
• Ignite Flags: Release Notes Required
• Assignee: Sergey Kosarev
• Reporter: Sergey Kosarev
• Created: 06/May/21 10:05
• Updated: 01/Jul/21 09:14
• Resolved: 07/May/21 10:54

Description

Reproducer is easy:

while (true) out.writeByteArray(bytes);

---

#

1. A fatal error has been detected by the Java Runtime Environment:
   #
2. EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x0000000002742b26, pid=17128, tid=0x00000000000024e4
   #

---

 

Actually It happened to me occassionally when by mistake a compute job tried to return too many results. JVM crashed on the job result serialization.

See link to full reproducers below.

 

Issue Links

• links to: GitHub Pull Request #9083
• links to: Github pull request #9083
• links to: Reproducer