[OAK-9646] Avoid S3 Incomplete Read Warning

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: oak-http
• Assignee: Unassigned
• Reporter: Ankita Agarwal
• Created: 16/Dec/21 18:35
• Updated: 16/Dec/21 18:36

Description

While using S3DataStore, the following logs are observed occasionally:

WARN [com.amazonaws.services.s3.internal.S3AbortableInputStream.close():178] Not all bytes were read from the S3ObjectInputStream,
aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged 
GET or drain the input stream after use.

 

[1] https://github.com/aws/aws-sdk-java/blob/master/aws-java-sdk-s3/src/main/java/com/amazonaws/services/s3/internal/S3AbortableInputStream.java#L174-L187
[2] https://github.com/aws/aws-sdk-java/issues/1211
[3] https://github.com/aws/aws-sdk-java/issues/1657

Issue Links

• relates to: JCR-4369 Avoid S3 Incomplete Read Warning