[ARROW-5410] [C++] Crash at arrow::internal::FileWrite

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Not A Problem
• Component/s: C++
• Labels: parquet
• Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
• External issue URL: https://github.com/apache/arrow/issues/16743
• Assignee: Unassigned
• Reporter: Tham
• Created: 24/May/19 04:25
• Updated: 11/Jan/23 07:40
• Resolved: 02/Jul/19 10:29

Description

My application is writing a bunch of parquet files and it often crashes. Most of the time it crashes when writing the first file, sometimes it can write the first file and crashing at the 2nd file. The file can always be opened. It only crashes at writeTable.

As I tested, my application crashes when build with release mode, but don't crash with debug mode. It crashed only on one Windows machine, not others.

Here is stack trace from dump file:

STACK_TEXT:  
0000001e`10efd840 00007ffc`0333d53f : 00000000`00000000 0000001e`10efe230 00000000`00000033 00007ffc`032dbe21 : CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
0000001e`10efe170 00007ffc`0333d559 : 00000000`ffffff02 00007ffc`032da63d 00000000`00000033 00000000`00000033 : ucrtbase!invalid_parameter+0x13f
0000001e`10efe1b0 00007ffc`03318664 : 00007ff7`7f7c8489 00000000`ffffff02 0000001e`10efe230 00000000`00000033 : ucrtbase!invalid_parameter_noinfo+0x9
0000001e`10efe1f0 00007ffc`032d926d : 00000000`ffffffff 00000000`00000140 00000000`00000005 00000122`bbe61e30 : ucrtbase!_acrt_uninitialize_command_line+0x6fd4
0000001e`10efe250 00007ff7`7f66585e : 00000010`00000005 00000000`00000000 0000001e`10efe560 00000122`b2337b88 : ucrtbase!write+0x8d
0000001e`10efe2a0 00007ff7`7f632785 : 00007ff7`00000000 00007ff7`7f7bb153 00000122`bbe890e0 0000001e`10efe634 : CortexSync!arrow::internal::FileWrite+0x5e
0000001e`10efe360 00007ff7`7f632442 : 00000000`0000348a 00000000`00000004 0000733f`5e86f38c 00000122`bbe14c40 : CortexSync!arrow::io::OSFile::Write+0x1d5
0000001e`10efe510 00007ff7`7f71c1b9 : 0000001e`10efe738 00007ff7`7f665522 00000122`bbffe6e0 00000000`ffffffff : CortexSync!arrow::io::FileOutputStream::Write+0x12
0000001e`10efe540 00007ff7`7f79cb2f : 00000122`bbe61e30 00000122`bbffe6e0 00000000`00000013 0000001e`10efe730 : CortexSync!parquet::ArrowOutputStream::Write+0x39
0000001e`10efe6e0 00007ff7`7f7abbaf : 00007ff7`7fd75b78 00007ff7`7fd75b78 0000001e`10efe9c0 00000000`00000000 : CortexSync!parquet::ThriftSerializer::Serialize<parquet::format::PageHeader>+0x11f
0000001e`10efe8c0 00007ff7`7f7aaf93 : 00000000`00000000 00000122`bbe3f450 00000000`00000002 00000122`bc0218d0 : CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f
0000001e`10efee20 00007ff7`7f7a3707 : 00000122`bbe3f450 0000001e`10eff250 00000000`00000000 00000122`b1680000 : CortexSync!parquet::TypedColumnWriterImpl<parquet::DataType<5> >::WriteDictionaryPage+0x143
0000001e`10efeed0 00007ff7`7f710480 : 0000001e`10eff1c0 00000000`00000000 00000122`bbe3f540 00000122`b2439998 : CortexSync!parquet::ColumnWriterImpl::Close+0x47
0000001e`10efef60 00007ff7`7f7154da : 00000122`bbec3cd0 0000001e`10eff1c0 00000122`bbec4bb0 00000122`b2439998 : CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting destructor'+0x100
0000001e`10efefa0 00007ff7`7f71619c : 00000000`00000000 0000001e`10eff1c0 00000122`bbe89390 00000000`00000000 : CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa
0000001e`10eff150 00007ff7`7f202de9 : 00000000`00000001 0000001e`10eff430 00000000`0000000f 00000000`00000000 : CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc
0000001e`10eff410 00007ff7`7f18baf3 : 00000122`bbec39b0 00000122`b24c53f8 00000000`3f800000 00000000`00000000 : CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49

I tried a lot of ways to find out the root cause, but failed. Can anyone here give me some information/advice please, so that I can investigate more? Thanks!

Issue Links

• is duplicated by: ARROW-5700 [C++] Failed to open local file: Bad file descriptor