Details
-
Sub-task
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
3.4.0
-
Reviewed
Description
prefetching stream's SingleFilePerBlockCache uses Files.tempFile() to allocate a temp file.
it should be using LocalDirAllocator to allocate space from a list of dirs, taking a config key to use. for s3a we will use the Constants.BUFFER_DIR option, which on yarn deployments is fixed under the env.LOCAL_DIR path, so automatically cleaned up on container exit
Attachments
Issue Links
- links to