Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-7273

[Python] Non-nullable null field is allowed / crashes when writing to parquet

    XMLWordPrintableJSON

Details

    Description

      It seems to be possible to create a "non-nullable null field". While this does not make any sense (so already a reason to disallow this I think), this can also lead to crashed in further operations, such as writing to parquet:

      In [18]: table = pa.table([pa.array([None, None], pa.null())], schema=pa.schema([pa.field('a', pa.null(), nullable=False)]))
      
      In [19]: table
      Out[19]:
      pyarrow.Table
      a: null not null
      
      In [20]: pq.write_table(table, "test_null.parquet")
      WARNING: Logging before InitGoogleLogging() is written to STDERR
      F1128 14:08:30.267439 27560 column_writer.cc:837]  Check failed: (nullptr) != (values)
      *** Check failure stack trace: ***
      Aborted (core dumped)
      

      Attachments

        Issue Links

          Activity

            People

              wesm Wes McKinney
              jorisvandenbossche Joris Van den Bossche
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 40m
                  40m