[ARROW-5879] [C++][Python] Clean up linking of optional libraries within C++ and to Python extensions

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Component/s: C++, Python
• External issue URL: https://github.com/apache/arrow/issues/22294
• Assignee: Unassigned
• Reporter: Wes McKinney
• Created: 08/Jul/19 17:40
• Updated: 11/Jan/23 07:43
• Resolved: 07/Jan/20 23:46

Description

Optional modules such as

• Flight (and its dependents, including OpenSSL)
• Parquet
• Gandiva

are all linked unconditionally to pyarrow.lib. It would be better IMHO to only link these libraries to the corresponding Cython extension rather than link everything to every extension.

Relatedly, libraries like OpenSSL are being included in linking with all shared libraries. We should clean this up to only link to the relevant shared libraries where it is required, like libparquet (for encryption support) and libarrow_flight (for using gRPC with TLS)