[ARROW-8202] [Rust] SIGSEGV when using StringBuilder with jemalloc

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 0.16.0
• Component/s: Rust
• Environment: Mac OSX 10.14.6
• External issue URL: https://github.com/apache/arrow/issues/24400
• Assignee: Unassigned
• Reporter: Evan Chan
• Created: 24/Mar/20 22:56
• Updated: 11/Jan/23 07:58
• Resolved: 26/Apr/21 12:29

Description

I have a Rust app which is just appending strings into many StringBuilders.  I tried using jemalloc and the app crashes with SIGSEGV (Address boundary error)

 

rust-lldb backtrace:

```

* frame #0: 0x00000001004073f1 memoird`_rjem_mallocx at sz.h:158:18 [opt]
{{ frame #1: 0x00000001004073e3 memoird`_rjem_mallocx [inlined] sz_s2u_lookup(size=<unavailable>) at sz.h:238 [opt]}}
{{ frame #2: 0x00000001004073e3 memoird`_rjem_mallocx [inlined] sz_s2u(size=<unavailable>) at sz.h:252 [opt]}}
{{ frame #3: 0x00000001004073d6 memoird`_rjem_mallocx [inlined] sz_sa2u(size=<unavailable>, alignment=64) at sz.h:283 [opt]}}
{{ frame #4: 0x00000001004073ac memoird`_rjem_mallocx [inlined] imalloc_body at jemalloc.c:1841 [opt]}}
{{ frame #5: 0x0000000100407394 memoird`_rjem_mallocx [inlined] imalloc(sopts=<unavailable>, dopts=<unavailable>) at jemalloc.c:2005 [opt]}}
{{ frame #6: 0x0000000100407345 memoird`_rjem_mallocx(size=<unavailable>, flags=<unavailable>) at jemalloc.c:2588 [opt]}}
{{ frame #7: 0x0000000100370187 memoird`arrow::array::builder::ListBuilder$LT$T$GT$::new::h16819112466ced47 [inlined] alloc::alloc::alloc_zeroed::hc53d8d0d6ed944ef(layout=<unavailable>) at alloc.rs:165:4 [opt]}}
{{ frame #8: 0x000000010037017a memoird`arrow::array::builder::ListBuilder$LT$T$GT$::new::h16819112466ced47 at memory.rs:29 [opt]}}
{{ frame #9: 0x000000010037017a memoird`arrow::array::builder::ListBuilder$LT$T$GT$::new::h16819112466ced47 at buffer.rs:419 [opt]}}
{{ frame #10: 0x000000010037017a memoird`arrow::array::builder::ListBuilder$LT$T$GT$::new::h16819112466ced47 at builder.rs:138 [opt]}}
{{ frame #11: 0x0000000100370169 memoird`arrow::array::builder::ListBuilder$LT$T$GT$::new::h16819112466ced47(values_builder=PrimitiveBuilder<arrow::datatypes::UInt8Type> {}}
values_builder: BufferBuilder<arrow::datatypes::UInt8Type> {
buffer: MutableBuffer {
data: &0x100b96000,
len: 0,
capacity: 8192
},
len: 0,
_marker: PhantomData<arrow::datatypes::UInt8Type> {

}
},
bitmap_builder: BufferBuilder<arrow::datatypes::BooleanType> {
buffer: MutableBuffer {
data: &0x100be3000,
len: 0,
capacity: 1024
},
len: 0,
_marker: PhantomData<arrow::datatypes::BooleanType> {

}
}
}) at builder.rs:368 [opt]
{{ frame #12: 0x0000000100370d4c memoird`arrow::array::builder::BinaryBuilder::new::h8f11851f0863e756(capacity=<unavailable>) at builder.rs:670:21 [opt]}}

```