Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
Description
Compare with the legacy version:
In [5]: d1 = pq.ParquetDataset("test_partitioned") In [6]: d2 = pq.ParquetDataset("test_partitioned", use_legacy_dataset=False) In [7]: d1.pieces[0] <ipython-input-30-45c15fc36b93>:1: DeprecationWarning: ParquetDataset.pieces attribute is deprecated d1.pieces[0] Out[7]: ParquetDatasetPiece('test_partitioned/B=a/1f73a8652e6242b58de7582b1a514907.parquet', row_group=None, partition_keys=[('B', 0)]) In [8]: d2.fragments[0] Out[8]: <pyarrow._dataset.ParquetFileFragment at 0x7fec0f88c710>
Attachments
Issue Links
- links to