Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-14257

[Doc][Python] dataset doc build fails

    XMLWordPrintableJSON

Details

    Description

      >>>-------------------------------------------------------------------------
      Exception in /home/antoine/arrow/dev/docs/source/python/dataset.rst at block ending on line 578
      Specify :okexcept: as an option in the ipython:: block to suppress this message
      ---------------------------------------------------------------------------
      ArrowNotImplementedError                  Traceback (most recent call last)
      <ipython-input-66-0fdb20f82a93> in <module>
      ----> 1 ds.write_dataset(scanner, new_root, format="parquet", partitioning=new_part)
      
      ~/arrow/dev/python/pyarrow/dataset.py in write_dataset(data, base_dir, basename_template, format, partitioning, partitioning_flavor, schema, filesystem, file_options, use_threads, max_partitions, file_visitor)
          861     _filesystemdataset_write(
          862         scanner, base_dir, basename_template, filesystem, partitioning,
      --> 863         file_options, max_partitions, file_visitor
          864     )
      
      ~/arrow/dev/python/pyarrow/_dataset.pyx in pyarrow._dataset._filesystemdataset_write()
      
      ~/arrow/dev/python/pyarrow/error.pxi in pyarrow.lib.check_status()
      
      ArrowNotImplementedError: Asynchronous scanning is not supported by SyncScanner
      /home/antoine/arrow/dev/cpp/src/arrow/dataset/file_base.cc:367  scanner->ScanBatchesAsync()
      <<<-------------------------------------------------------------------------
      

      Attachments

        Issue Links

          Activity

            People

              jorisvandenbossche Joris Van den Bossche
              apitrou Antoine Pitrou
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2h 20m
                  2h 20m