[HADOOP-18791] S3A prefetching: switch to prefetching for chosen read policies

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.3.6
• Component/s: fs/s3
• Assignee: Unassigned
• Reporter: Steve Loughran
• Created: 05/Jul/23 13:23
• Updated: 13/Jul/23 05:44

Description

before switching to prefetching input stream everywhere, add an option to list which of the fs.option.openfile.read.policy policies to switch too, e.g

fs.s3a.inputstream.prefetch.policies=whole-file, sequential, adaptive

this would leave random and vectored on s3a input stream.