Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-4267

[Python/C++][Parquet] Segfault when reading rowgroups with duplicated columns

    XMLWordPrintableJSON

    Details

      Description

      When reading a row group using duplicated columns I receive a segfault.

      import pandas as pd
      import pyarrow as pa
      import pyarrow.parquet as pq
      df = pd.DataFrame({
      "col": ["A", "B"]
      })
      
      table = pa.Table.from_pandas(df)
      buf = pa.BufferOutputStream()
      
      pq.write_table(table, buf)
      
      parquet_file = pq.ParquetFile(buf.getvalue())
      
      parquet_file.read_row_group(0)
      parquet_file.read_row_group(0, columns=["col"])
      
      # boom
      parquet_file.read_row_group(0, columns=["col", "col"])
      
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                uwe Uwe Korn
                Reporter:
                fjetter Florian Jetter
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1.5h
                  1.5h