[ARROW-12061] Proxy set as environment variables doesn't seems to be picked up

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Duplicate
• Affects Version/s: 3.0.0
• Component/s: R
• Environment: QA
• External issue URL: https://github.com/apache/arrow/issues/27888
• Assignee: Unassigned
• Reporter: Karthikeyan Janakiraman
• Created: 23/Mar/21 14:20
• Updated: 11/Jan/23 08:24
• Resolved: 23/Mar/21 16:00

Description

I am using arrow 3.0.0 to read parquet from AWS S3. I have set the proxy in R terminal using Sys.setenv however it doesn't seemed to have picked up when arrow tries to hit the S3 bucket. Appreciate any help here please. 

 

> Sys.setenv(http_proxy="http://proxy:9099")
> Sys.setenv(https_proxy="http://proxy:9099")
> Sys.setenv(HTTPS_PROXY="http://proxy:9099")
> Sys.setenv(HTTP_PROXY="http://proxy:9099")
> Sys.getenv("http_proxy")
[1] "http://proxy:9099"
> df <- read_parquet("s3://my_bucket/test-parquet/refinement.parquet?region=eu-west-1")
Error: IOError: When reading information for key 'test-parquet/refinement.parquet' in bucket 'my_bucket': AWS Error [code 99]: Unable to connect to endpoint with address : 52.218.57.8
>

Issue Links

• duplicates: ARROW-8900 [C++] Respect HTTP(S)_PROXY for S3 Filesystems and/or expose proxy options as parameters
• is duplicated by: ARROW-12062 Proxy set as environment variables doesn't seems to be picked up