[BEAM-12874] Installing apache-beam after tensorflow on Macbook M1 fails with pyarrow error

• Type: Bug
• Status: Open
• Priority: P3
• Resolution: Unresolved
• Component/s: sdk-py-core
• Assignee: Unassigned
• Reporter: Brian Hulette
• Created: 10/Sep/21 20:31
• Updated: 04/Jun/22 21:40

Description

PC : MacBook Air M1
OS : macOS 11.5.2

_I installed Tensorflow from apple repository. (Version 0.1a3)
I need to install apache-beam for my object-detection and i used
pip3 install apache beam

The command was executed.

_ Collecting apache-beam
Using cached apache_beam-2.32.0-cp38-cp38-macosx_11_0_arm64.whl
Collecting dill<0.3.2,>=0.3.1.1
Using cached dill-0.3.1.1-py3-none-any.whl
Collecting pyarrow<5.0.0,>=0.15.1
Using cached pyarrow-4.0.1.tar.gz (711 kB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing wheel metadata ... done
Collecting typing-extensions<3.8.0,>=3.7.0
Using cached typing_extensions-3.7.4.3-py3-none-any.whl (22 kB)
Collecting future<1.0.0,>=0.18.2
Using cached future-0.18.2-py3-none-any.whl
Requirement already satisfied: requests<3.0.0,>=2.24.0 in ./miniforge3/envs/grpcprova/lib/python3.8/site-packages (from apache-beam) (2.26.0)
Requirement already satisfied: grpcio<2,>=1.29.0 in ./miniforge3/envs/grpcprova/lib/python3.8/site-packages (from apache-beam) (1.33.2)
Collecting python-dateutil<3,>=2.8.0
Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
Collecting orjson<4.0
Using cached orjson-3.6.3-cp38-cp38-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl (434 kB)
Collecting oauth2client<5,>=2.0.1
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting hdfs<3.0.0,>=2.1.0
Using cached hdfs-2.6.0-py3-none-any.whl (33 kB)
Collecting crcmod<2.0,>=1.7
Using cached crcmod-1.7-cp38-cp38-macosx_11_0_arm64.whl
Collecting pymongo<4.0.0,>=3.8.0
Using cached pymongo-3.12.0-cp38-cp38-macosx_11_0_arm64.whl
Requirement already satisfied: numpy<1.21.0,>=1.14.3 in ./miniforge3/envs/grpcprova/lib/python3.8/site-packages (from apache-beam) (1.18.5)
Collecting pytz>=2018.3
Using cached pytz-2021.1-py2.py3-none-any.whl (510 kB)
Collecting fastavro<2,>=0.21.4
Using cached fastavro-1.4.4-cp38-cp38-macosx_11_0_arm64.whl
Requirement already satisfied: protobuf<4,>=3.12.2 in ./miniforge3/envs/grpcprova/lib/python3.8/site-packages (from apache-beam) (3.17.3)
Collecting avro-python3!=1.9.2,<1.10.0,>=1.8.1
Using cached avro_python3-1.9.2.1-py3-none-any.whl
Collecting pydot<2,>=1.2.0
Using cached pydot-1.4.2-py2.py3-none-any.whl (21 kB)
Collecting httplib2<0.20.0,>=0.8
Using cached httplib2-0.19.1-py3-none-any.whl (95 kB)
Requirement already satisfied: six>=1.5.2 in ./miniforge3/envs/grpcprova/lib/python3.8/site-packages (from grpcio<2,>=1.29.0->apache-beam) (1.16.0)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing<3,>=2.4.2 in ./miniforge3/envs/grpcprova/lib/python3.8/site-packages (from httplib2<0.20.0,>=0.8->apache-beam) (2.4.7)
Requirement already satisfied: rsa>=3.1.4 in ./miniforge3/envs/grpcprova/lib/python3.8/site-packages (from oauth2client<5,>=2.0.1->apache-beam) (4.7.2)
Requirement already satisfied: pyasn1-modules>=0.0.5 in ./miniforge3/envs/grpcprova/lib/python3.8/site-packages (from oauth2client<5,>=2.0.1->apache-beam) (0.2.8)
Requirement already satisfied: pyasn1>=0.1.7 in ./miniforge3/envs/grpcprova/lib/python3.8/site-packages (from oauth2client<5,>=2.0.1->apache-beam) (0.4.8)
Requirement already satisfied: idna<4,>=2.5 in ./miniforge3/envs/grpcprova/lib/python3.8/site-packages (from requests<3.0.0,>=2.24.0->apache-beam) (3.2)
Requirement already satisfied: certifi>=2017.4.17 in ./miniforge3/envs/grpcprova/lib/python3.8/site-packages (from requests<3.0.0,>=2.24.0->apache-beam) (2021.5.30)
Requirement already satisfied: charset-normalizer~=2.0.0 in ./miniforge3/envs/grpcprova/lib/python3.8/site-packages (from requests<3.0.0,>=2.24.0->apache-beam) (2.0.4)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in ./miniforge3/envs/grpcprova/lib/python3.8/site-packages (from requests<3.0.0,>=2.24.0->apache-beam) (1.26.6)
Building wheels for collected packages: pyarrow
Building wheel for pyarrow (PEP 517) ... error

Originall reported here: https://github.com/apache/beam/pull/15449