[ARROW-11629] [C++] Writing float32 values with "Dictionary Encoding" makes parquet files not readable for some tools

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Cannot Reproduce
• Affects Version/s: 3.0.0
• Component/s: C++, Python
• Flags: Important
• External issue URL: https://github.com/apache/arrow/issues/18518
• Assignee: Unassigned
• Reporter: Matthias Rosenthaler
• Created: 15/Feb/21 11:49
• Updated: 11/Jan/23 08:21
• Resolved: 02/Apr/21 06:57

Description

If I try to read the attached csv file with pyarrow, changing the float64 columns to float32 and export it to parquet, the parquet file gets corrupted. It is not readable for apache drill or Parquet.Net any longer.

 

Update: Bug in "Dictionary Encoding" feature. If I switch it off for float32 columns, everything works as expected.