[ARROW-11223] [Java] BaseVariableWidthVector/BaseLargeVariableWidthVector setNull and getBufferSizeFor is buggy

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 4.0.0
• Component/s: Java
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/27127
• Assignee: Weichen Xu
• Reporter: Weichen Xu
• Created: 12/Jan/21 14:23
• Updated: 11/Jan/23 08:18
• Resolved: 22/Feb/21 23:52

Description

We may get error java.lang.IndexOutOfBoundsException: index: 15880, length: 4 (expected: range(0, 15880)).

I test on arrow 2.0.0

Reproduce code in scala:

import org.apache.arrow.vector.VarCharVector
import org.apache.arrow.memory.RootAllocator
val rootAllocator = new RootAllocator(Long.MaxValue)
val v1 = new VarCharVector("var1", rootAllocator)
v1.allocateNew()

val valueCount = 3970 // use any number >= 3970 will get similar error

for (idx <- 0 until valueCount) {
  v1.setNull(idx)
}
v1.getBufferSizeFor(valueCount) # failed, get error java.lang.IndexOutOfBoundsException: index: 15880, length: 4 (expected: range(0, 15880))

Issue Links

• links to: GitHub Pull Request #9187