[FLINK-23345] Migrate to the next version of Python `requests` when released

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.14.0
• Fix Version/s: 1.10.4, 1.14.0, 1.13.3, 1.11.7, 1.12.8
• Component/s: API / Python
• Labels: pull-request-available
• Assignee: Dian Fu
• Reporter: Jarek Potiuk
• Created: 11/Jul/21 11:54
• Updated: 15/Dec/21 01:40
• Resolved: 10/Sep/21 02:31

Description

Hello Maintainers, 

I am a PMC member of Apache Airflow, and I wanted to give you a bit of heads-up with rather important migration to the upcoming version of `requests` library in your Python release. 

Since you are using `requests` library in your project (at least indirectly via apache-beam), you are affected.

As discussed at length in https://issues.apache.org/jira/browse/LEGAL-572 we found out that the 'chardet` library used by `requests` library was a mandatory dependency to requests and since it has LGPL licence, we should not release any Apache Software with it. 

Since then (and since in Airflow we rely on requests heavily) we have been working with the requests maintainers and "charset-normalizer" maintainer to make it possible to replace `chardet` with MIT-licensed `charset-normalizer` instead so that requests library can be used in Python releases by Apache projects.

This was a bumpy road but finally the PR by ash has been merged: https://github.com/psf/requests/pull/5797 and we hope soon a new version of requests library will be released. 

This is just a heads-up. I will let you know when it is released, but I have a kind requests as well - I might ask the maintainers to release a release candidate of requests and maybe you could help to test it before it is released, that would be some re-assurance for the maintainers of requests who are very concerned about stability of their releases.

Let me know if you need any more information and whether you would like to help in testing the candidate when it is out.

Issue Links

• causes: FLINK-24260 py35-cython fails due to could not find requests>=2.26.0
• is related to: BEAM-12598 Migrate to the next version of Python `requests` when released
• links to: GitHub Pull Request #17219