Details
-
Bug
-
Status: Open
-
Minor
-
Resolution: Unresolved
-
3.3.6
-
None
Description
we are using the wrong default value for the async drain threshold in org.apache.hadoop.fs.s3a.impl.OpenFileSupport
builderSupport.getPositiveLong(ASYNC_DRAIN_THRESHOLD, defaultReadAhead))
this means the drain threshold isn't being taken up in random io unless you have a very small readahead
Attachments
Issue Links
- relates to
-
HADOOP-16202 Enhance openFile() for better read performance against object stores
- Resolved
- links to