Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-7614

[Python] Slow performance in test_parquet.py::test_set_data_page_size

    XMLWordPrintableJSON

Details

    Description

      Slowest test durations:

      3.73s call     pyarrow/tests/test_parquet.py::test_set_data_page_size
      0.05s call     pyarrow/tests/test_parquet.py::test_nested_list_nonnullable_roundtrip_bug
      0.03s call     pyarrow/tests/test_parquet.py::test_compression_level
      0.03s call     pyarrow/tests/test_parquet.py::test_dictionary_array_automatically_read
      0.02s call     pyarrow/tests/test_parquet.py::test_statistics_convert_logical_types
      0.02s call     pyarrow/tests/test_parquet.py::test_large_list_records
      0.01s call     pyarrow/tests/test_parquet.py::test_write_nested_zero_length_array_chunk_failure
      0.01s call     pyarrow/tests/test_parquet.py::test_parquet_write_disable_statistics
      0.01s call     pyarrow/tests/test_parquet.py::test_single_pylist_column_roundtrip[int]
      0.01s call     pyarrow/tests/test_parquet.py::test_special_chars_filename
      

      This suggests to me there is something wrong with the feature (possibly doing unnecessary work)

      Attachments

        Issue Links

          Activity

            People

              jorisvandenbossche Joris Van den Bossche
              wesm Wes McKinney
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 50m
                  50m