Details
-
Sub-task
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
3.4.0
-
Reviewed
Description
The following tests are failing when prefetching is enabled:
testRandomIORandomPolicy - expects stream to be opened 4 times (once for every random read), but prefetching will only open twice.
testDecompressionSequential128K - expects stream to be opened once, but prefetching will open once for each block the file has. landsat file used in the test has size 42MB, prefetching block size = 8MB, expected open count is 6.
testReadWithNormalPolicy - same as above.
testRandomIONormalPolicy - executes random IO, but with a normal policy. S3AInputStream will abort the stream and change the policy, prefetching handles random IO by caching blocks so doesn't do any of that.
testRandomReadOverBuffer - multiple assertions failing here, also depends a lot on readAhead values, not very relevant for prefetching
Attachments
Attachments
Issue Links
- is required by
-
HADOOP-18243 Rebase s3a prefetching feature branch on top of trunk
-
- Resolved
-
- links to