-
Type:
Sub-task
-
Status: Resolved
-
Priority:
Minor
-
Resolution: Duplicate
-
Affects Version/s: 2.8.0
-
Fix Version/s: None
-
Component/s: fs/s3
-
Labels:None
S3AOutputStream uses LocalDirAllocator to choose a directory from the comma-separated list of buffers —but it creates a new instance for every output stream. This misses a key point of the allocator: for it to do round-robin allocation, it needs to remember the last disk written to. If a new instance is used for every file: no history.
- is superceded by
-
HADOOP-13560 S3ABlockOutputStream to support huge (many GB) file writes
-
- Resolved
-