[ARROW-13425] [Dev][Archery] Archery import pandas which imports pyarrow

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 6.0.0
• Component/s: Archery, Benchmarking, Developer Tools
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/29092
• Assignee: Antoine Pitrou
• Reporter: Antoine Pitrou
• Created: 21/Jul/21 16:05
• Updated: 11/Jan/23 08:33
• Resolved: 02/Aug/21 18:27

Description

Just got this error when trying to run benchmarks on a PR:

Traceback (most recent call last):
  File "/home/antoine/miniconda3/envs/pyarrow/bin/archery", line 33, in <module>
    sys.exit(load_entry_point('archery', 'console_scripts', 'archery')())
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/core.py", line 764, in __call__
    return self.main(*args, **kwargs)
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/core.py", line 717, in main
    rv = self.invoke(ctx)
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/core.py", line 1137, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/core.py", line 1137, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/core.py", line 956, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/decorators.py", line 17, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/home/antoine/arrow/dev/dev/archery/archery/cli.py", line 634, in benchmark_diff
    no_counters, ren_counters)
  File "/home/antoine/arrow/dev/dev/archery/archery/cli.py", line 650, in _format_comparisons_with_pandas
    import pandas as pd
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/pandas/__init__.py", line 50, in <module>
    from pandas.core.api import (
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/pandas/core/api.py", line 29, in <module>
    from pandas.core.arrays import Categorical
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/pandas/core/arrays/__init__.py", line 20, in <module>
    from pandas.core.arrays.string_arrow import ArrowStringArray
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/pandas/core/arrays/string_arrow.py", line 65, in <module>
    import pyarrow.compute as pc
  File "/home/antoine/arrow/dev/python/pyarrow/compute.py", line 18, in <module>
    from pyarrow._compute import (  # noqa
ImportError: cannot import name 'ProjectOptions' from 'pyarrow._compute' (/home/antoine/arrow/dev/python/pyarrow/_compute.cpython-37m-x86_64-linux-gnu.so)

Since Archery is a tool for developing Arrow, current PyArrow may be broken or incompatible with the currently available Arrow C++.

Issue Links

• links to: GitHub Pull Request #10769