Details
Description
Changes needed to get the Vector IO code stable.
Specifically
- consistent behaviour across implementations
- broader testing
- resilience
+Ideally, abfs support. (s3a prefetching needs this too; see HADOOP-19144)
This work will be shaped by the experience of merging support into libraries and identifying issues/improvement opportunities
the patches which MUST be cherrypicked from this to any branch with vector IO support are (currently)
Attachments
Issue Links
- is related to
-
HADOOP-19211 AliyunOSS: Support vectored read API
-
- Open
-
- relates to
-
HADOOP-19144 S3A prefetching to support Vector IO
-
- Open
-
-
HADOOP-18103 High performance vectored read API in Hadoop
-
- Resolved
-
1.
|
add options to disable range merging of vectored io |
|
Open | Unassigned |
2.
|
S3A: Recover from Vector IO read failures |
|
Open | Unassigned |
3.
|
S3A: Support ByteBufferPositionedReadable through vector IO |
|
Open | Steve Loughran |