Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-12126

[R] Help with using arrow to read parquet from S3

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Information Provided
    • 3.0.0
    • None
    • R
    • None
    • QA

    Description

      I am following the document here[https://arrow.apache.org/docs/r/articles/fs.html] to read parquet file from AWS S3. 

      Below are the steps I have tried and finding errors, it will be great if you could advise what is going wrong here please,

      df <- read_parquet("s3://access_key:secret_key@s3://my_bucket/test-parquet/refinement.parquet?region=eu-west-1")
      
      Error: IOError: When reading information for key '/my_bucket/test-parquet/refineme
      nt.parquet' in bucket 's3': AWS Error [code 100]: No response body. with address : 52.218.84.83
      
      FileSystem object
       
      > bucket <- s3_bucket("my_bucket")
      > df <- read_parquet(bucket$path("test-parquet/refinement.parquet"))
       
      Error: IOError: When reading information for key 'test-parquet/refinement.parquet' in bucket 'my_bucket': AWS Error [code 15]: No response body. with address : 52.218.40.184 >
      

      Attachments

        Issue Links

          Activity

            People

              npr Neal Richardson
              karthik_j Karthikeyan Janakiraman
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: