[ARROW-18309] [Go] delta_bit_packing Decode may panic

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 9.0.0
• Fix Version/s: 11.0.0
• Component/s: Go, Parquet
• Labels: pull-request-available
• Environment: all release version
• External issue URL: https://github.com/apache/arrow/issues/33483

Language

Go

• Assignee: Matthew Topol
• Reporter: jun wang
• Created: 11/Nov/22 04:06
• Updated: 11/Jan/23 11:59
• Resolved: 16/Nov/22 15:39

Description

https://github.com/apache/arrow/blob/master/go/parquet/internal/encoding/delta_bit_packing.go

The  DeltaBitPackInt32 and DeltaBitPackInt64 Decode method did not use d.nvals subtract decoded number at end, which lead streaming decode panic. 

Also, when copy the decoded value to out, the end value should be 
shared_utils.MinInt(int(d.valsPerMini), start + len(out))

When encode 68610 timestamp data, and decode 1024 value a batch, we encounter the panic

Issue Links

• links to: GitHub Pull Request #14649