Details
-
Sub-task
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
-
None
Description
Right now, most of the examples use
Path stagingDir = new Path(fs.getWorkingDirectory(), UUID.randomUUID().toString());
to get the staging directory. This results in home directories filled with directories that have to be manually deleted one by one. The MRRSleep example is the only example which uses TEZ_AM_STAGING_DIR, but that defaults to '/tmp/tez/staging', which breaks for more than one user.
It would be good to have a standardized way of handling staging directories for Tez. Optimally, it would be nice if Tez would handle the lifecycle of its staging directory itself.