Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-7614

[Python] Slow performance in test_parquet.py::test_set_data_page_size

    XMLWordPrintableJSON

    Details

      Description

      Slowest test durations:

      3.73s call     pyarrow/tests/test_parquet.py::test_set_data_page_size
      0.05s call     pyarrow/tests/test_parquet.py::test_nested_list_nonnullable_roundtrip_bug
      0.03s call     pyarrow/tests/test_parquet.py::test_compression_level
      0.03s call     pyarrow/tests/test_parquet.py::test_dictionary_array_automatically_read
      0.02s call     pyarrow/tests/test_parquet.py::test_statistics_convert_logical_types
      0.02s call     pyarrow/tests/test_parquet.py::test_large_list_records
      0.01s call     pyarrow/tests/test_parquet.py::test_write_nested_zero_length_array_chunk_failure
      0.01s call     pyarrow/tests/test_parquet.py::test_parquet_write_disable_statistics
      0.01s call     pyarrow/tests/test_parquet.py::test_single_pylist_column_roundtrip[int]
      0.01s call     pyarrow/tests/test_parquet.py::test_special_chars_filename
      

      This suggests to me there is something wrong with the feature (possibly doing unnecessary work)

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jorisvandenbossche Joris Van den Bossche
                Reporter:
                wesm Wes McKinney
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 50m
                  50m