[ARROW-6681] [C#] Record Batches in reverse order?

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 0.14.1
• Component/s: C#
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/5475
• Assignee: Unassigned
• Reporter: Anthony Abate
• Created: 25/Sep/19 03:32
• Updated: 11/Jan/23 07:48

Description

Are 'RecordBatches' being in C# being written in reverse order?

I made a simple test which creates a single row per record batch of 0 to 99 and attempted to read this in R. To my surprise batch(0) in R had the value 99 not 0

This may not seem like a big deal, however when dealing with 'huge' files, its more efficient to use Record Batches / index lookup than attempting to load the entire file into memory.

Having the order consistent within the different language / API seems only to make sense - for now I can work around this by reversing the order before writing.

 

https://github.com/apache/arrow/issues/5475

 

Issue Links

• links to: GitHub Pull Request #5412